00000100:00100000:3.0:1787826295.767250:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c7df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+15:2401:x1874668789544320:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 207us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826295.772290:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2802 00000100:00100000:3.0:1787826295.814422:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778574464 00000100:00100000:3.0:1787826295.814507:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778574464 00000100:00100000:3.0:1787826295.814846:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214 00000100:00100000:3.0:1787826295.814896:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:6518:x1874668778574464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826295.815135:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:6518:x1874668778574464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 244us (1301us total) trans 4294968085 rc 0/0 00000100:00100000:3.0:1787826295.815144:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214 00000100:00100000:3.0:1787826295.861489:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789545600 00000100:00100000:3.0:1787826295.861496:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789545600 00010000:00010000:3.0:1787826295.861523:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f3497ecf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa7d1 expref: 17 pid: 8432 timeout: 3033 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826295.861566:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2807 00000100:00100000:3.0:1787826295.861577:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789545600:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826295.861587:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826295.861602:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f3497ecf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xaa:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa7d1 expref: 17 pid: 8432 timeout: 3033 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.864505:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f3497ecf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xaa:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa7d1 expref: 17 pid: 8432 timeout: 3033 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.864553:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f3497ecf lrc: 0/0,0 mode: --/PR res: [0x280000401:0xaa:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa7d1 expref: 17 pid: 8432 timeout: 3033 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.864585:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826295.912315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826295.916178:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778575104 00000100:00100000:3.0:1787826295.916190:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778575104 00000100:00100000:3.0:1787826295.916280:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3215 00000100:00100000:3.0:1787826295.916291:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:23877:x1874668778575104:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826295.916435:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:23877:x1874668778575104:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 146us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826295.916443:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3215 00000100:00100000:3.0:1787826295.918621:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778575232 00000100:00100000:3.0:1787826295.918632:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778575232 00000100:00100000:3.0:1787826295.918705:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216 00000100:00100000:3.0:1787826295.918715:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:23877:x1874668778575232:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826295.919062:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:23877:x1874668778575232:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 348us (1328us total) trans 4294968102 rc 0/0 00000100:00100000:3.0:1787826295.919072:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216 00000100:00100000:3.0:1787826295.925588:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826295.941692:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789546624 00000100:00100000:3.0:1787826295.941705:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789546624 00010000:00010000:3.0:1787826295.941758:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3498287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa6a expref: 15 pid: 8430 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826295.941806:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789546752 00000100:00100000:3.0:1787826295.941809:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789546752 00010000:00010000:3.0:1787826295.941823:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034c29308/0x68019081f3497ed6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa7d8 expref: 13 pid: 8605 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826295.941879:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2810 00000100:00100000:3.0:1787826295.941890:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+15:2401:x1874668789546624:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826295.941910:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826295.941938:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3498287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xab:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa6a expref: 15 pid: 8430 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.941955:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3498287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xab:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa6a expref: 15 pid: 8430 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.941987:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3498287 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xab:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa6a expref: 15 pid: 8430 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.942010:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826295.943815:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+13:2401:x1874668789546624:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1917us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826295.943825:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2810 00000100:00100000:3.0:1787826295.949637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826295.960284:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778575872 00000100:00100000:3.0:1787826295.960301:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778575872 00000100:00100000:3.0:1787826295.995462:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789548288 00000100:00100000:3.0:1787826295.995484:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789548288 00010000:00010000:3.0:1787826295.995550:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f34971b6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9ee0 expref: 191 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826295.995595:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2816 00000100:00100000:3.0:1787826295.995608:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c7ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+191:2402:x1874668789548288:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826295.995627:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826295.995634:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f34971b6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9ee0 expref: 191 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.995649:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f34971b6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9ee0 expref: 191 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.995682:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf8:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:3.0:1787826295.995689:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349895d lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.995714:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349895d lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826295.995722:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826295.995799:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c7ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+191:2402:x1874668789548288:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 193us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826295.995808:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2816 00000100:00100000:3.0:1787826296.007409:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778576640 00000100:00100000:3.0:1787826296.007424:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778576640 00000100:00100000:3.0:1787826296.009194:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778576768 00000100:00100000:3.0:1787826296.009202:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778576768 00000100:00100000:3.0:1787826296.009266:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3220 00000100:00100000:3.0:1787826296.009277:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:23877:x1874668778576768:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826296.009459:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:23877:x1874668778576768:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 173us (851us total) trans 4294968103 rc 0/0 00000100:00100000:3.0:1787826296.009467:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3220 00000100:00100000:3.0:1787826296.014778:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.019353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.024977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.025085:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.034208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.040625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.054726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826296.062475:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7086f2/0x68019081f349899c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xac:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.062505:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3497f8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa81e expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.062516:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9f44c26/0x68019081f349829c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa7f expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.062525:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xac:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787826296.062530:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826296.062536:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7086f2/0x68019081f349899c lrc: 5/0,1 mode: --/PW res: [0x280000401:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.062603:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9f44c26/0x68019081f349829c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa7f expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.062623:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9f44c26/0x68019081f349829c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa7f expref: 10 pid: 8433 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.062648:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778577664:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826296.062782:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3497f8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa81e expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.062806:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3497f8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa81e expref: 14 pid: 8432 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.062817:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778577792:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826296.062844:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15bada80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826296.071141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.072659:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.100828:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789550720 00000100:00100000:3.0:1787826296.100841:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789550720 00010000:00010000:3.0:1787826296.100925:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fda8400/0x68019081f34967c9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9a95 expref: 32 pid: 12105 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.100969:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789550592 00000100:00100000:3.0:1787826296.100972:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789550592 00010000:00010000:3.0:1787826296.100987:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f3497203 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9eee expref: 207 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.101019:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2824 00000100:00100000:3.0:1787826296.101030:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2402:x1874668789550720:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.101049:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.101058:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fda8400/0x68019081f34967c9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9a95 expref: 32 pid: 12105 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101071:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fda8400/0x68019081f34967c9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9a95 expref: 32 pid: 12105 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101102:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:3.0:1787826296.101109:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101120:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101128:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.101196:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2402:x1874668789550720:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 167us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.101205:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2824 00000100:00100000:3.0:1787826296.101225:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2825 00000100:00100000:3.0:1787826296.101232:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+207:2402:x1874668789550592:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.101241:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.101246:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f3497203 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9eee expref: 207 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101257:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f3497203 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9eee expref: 207 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101271:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f3497203 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9eee expref: 207 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101291:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:3.0:1787826296.101296:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101304:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101313:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.101336:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.101355:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+206:2402:x1874668789550592:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 123us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.101362:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2825 00000001:00080000:3.0:1787826296.107176:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015892 00000100:00100000:3.0:1787826296.107390:0:23877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:23877:1874668778578176:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826296.107499:0:23877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826296.107555:0:23877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15bad540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826296.108616:0:23877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:23877:1874668778578176:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826296.108786:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015893 00000100:00100000:3.0:1787826296.108890:0:23877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbe940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:23877:1874668778578304:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826296.108932:0:23877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826296.108951:0:23877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15badc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826296.109489:0:23877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbe940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:23877:1874668778578304:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826296.109559:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015894 00010000:00010000:3.0:1787826296.109593:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.109605:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.109614:0:23877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.109621:0:23877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf27bf8e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.109626:0:23877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.109636:0:23877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.109658:0:23877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:3.0:1787826296.109661:0:23877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826296.109667:0:23877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.109675:0:23877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8e00/0x68019081f34989a3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826296.109794:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x45:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826296.109911:0:23877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].40, 64 off10800 00000001:00080000:3.0:1787826296.109920:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015895 00010000:00010000:3.0:1787826296.109949:0:23877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:3.0:1787826296.109952:0:23877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826296.109960:0:23877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f349898e lrc: 0/0,0 mode: --/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fadb2 expref: 210 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.110079:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+209:84116:x1874668789550464:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 23578us (23770us total) trans 8590015896 rc 0/0 00000100:00100000:3.0:1787826296.110089:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2517 00000020:00080000:3.0:1787826296.110093:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787826296.120302:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110719 00000100:00100000:3.0:1787826296.120320:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+209:84116:x1874668789550976:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826296.120363:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.120395:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f34989aa lrc: 2/0,0 mode: --/CR res: [0x200000403:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fadb9 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.120790:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f34989b1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.120810:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f34989b1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.120825:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f34989b1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.120905:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfb:0x0]: returning size 158 00010000:00010000:3.0:1787826296.121037:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f34989aa lrc: 0/0,0 mode: --/CR res: [0x200000403:0xfb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fadb9 expref: 212 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.121057:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f34989b1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fadb9 expref: 211 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.121068:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfb:0x0].0x0 (ffff9bbe0bd66000) 00010000:00010000:3.0:1787826296.121071:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826296.121075:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe167d6c00, rc 0) 00000100:00100000:3.0:1787826296.121165:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+211:84116:x1874668789550976:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 849us (6446us total) trans 8590015897 rc 0/0 00000100:00100000:3.0:1787826296.121174:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110719 00000100:00100000:3.0:1787826296.134187:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789551232 00000100:00100000:3.0:1787826296.134198:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789551232 00010000:00010000:3.0:1787826296.134251:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a04cbd8/0x68019081f34982b1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa86 expref: 13 pid: 8432 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.134548:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2826 00000100:00100000:3.0:1787826296.134559:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+13:2401:x1874668789551232:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.134581:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.134610:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a04cbd8/0x68019081f34982b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa86 expref: 13 pid: 8432 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.134625:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a04cbd8/0x68019081f34982b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa86 expref: 13 pid: 8432 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.134653:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a04cbd8/0x68019081f34982b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faa86 expref: 13 pid: 8432 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.134673:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.134762:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+12:2401:x1874668789551232:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 204us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.134770:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2826 00000100:00100000:3.0:1787826296.142801:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789551360 00000100:00100000:3.0:1787826296.142815:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789551360 00010000:00010000:3.0:1787826296.142912:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8db0a22/0x68019081f3498050 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa856 expref: 11 pid: 45681 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.142953:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2827 00000100:00100000:3.0:1787826296.142963:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789551360:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.142980:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.143006:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8db0a22/0x68019081f3498050 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa856 expref: 11 pid: 45681 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.143022:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8db0a22/0x68019081f3498050 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa856 expref: 11 pid: 45681 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.143049:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8db0a22/0x68019081f3498050 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa856 expref: 11 pid: 45681 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.143067:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826296.143071:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826296.143079:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029c9cf99/0x68019081f34989bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.143089:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029c9cf99/0x68019081f34989bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.143176:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.143246:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789551360:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 283us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.143254:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2827 00000100:00100000:3.0:1787826296.178336:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2828 00000100:00100000:3.0:1787826296.178354:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2402:x1874668789551872:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.178374:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.178381:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3496863 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9acd expref: 31 pid: 6516 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178395:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3496863 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9acd expref: 31 pid: 6516 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178425:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3496863 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9acd expref: 31 pid: 6516 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178454:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfb:0x0].0x0 (ffff9bbe0bd66000) 00010000:00010000:3.0:1787826296.178461:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4c00/0x68019081f34989c6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178471:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4c00/0x68019081f34989c6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178478:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.178566:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789551872:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 218us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.178574:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2828 00000100:00100000:3.0:1787826296.178597:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2829 00000100:00100000:3.0:1787826296.178605:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+215:2401:x1874668789551744:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.178612:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.178617:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f349721f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9ef5 expref: 215 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178628:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f349721f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9ef5 expref: 215 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178642:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f349721f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9ef5 expref: 215 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178652:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfb:0x0].0x0 (ffff9bbe0bd66000) 00010000:00010000:3.0:1787826296.178655:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4c00/0x68019081f34989c6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178663:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4c00/0x68019081f34989c6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178670:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4c00/0x68019081f34989c6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.178703:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.178721:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+214:2401:x1874668789551744:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 118us (4235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.178726:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2829 00000100:00100000:3.0:1787826296.185217:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.215702:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789552768 00000100:00100000:3.0:1787826296.215715:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789552768 00000100:00100000:3.0:1787826296.215795:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2519 00000100:00100000:3.0:1787826296.215807:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+219:84116:x1874668789552768:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:3.0:1787826296.215930:0:23877:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000403:0xfc:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf27bf8200/0x68019081f34989d4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fadc0 expref: 219 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826296.216218:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015907 00000100:00100000:3.0:1787826296.234782:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789552896 00000100:00100000:3.0:1787826296.234802:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789552896 00010000:00010000:3.0:1787826296.234900:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349723b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9efc expref: 223 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.234942:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789553024 00000100:00100000:3.0:1787826296.234945:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789553024 00010000:00010000:3.0:1787826296.234961:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08367600/0x68019081f349693c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9b7c expref: 30 pid: 23845 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.234990:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2832 00000100:00100000:3.0:1787826296.235001:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+223:2401:x1874668789552896:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.235022:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.235030:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349723b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9efc expref: 223 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.235047:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349723b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9efc expref: 223 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.235079:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349723b lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9efc expref: 223 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.235101:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfc:0x0].0x0 (ffff9bbf41055b00) 00010000:00010000:3.0:1787826296.235108:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f34989e9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.235124:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f34989e9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.235132:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.235598:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+222:2401:x1874668789552896:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 598us (6088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.235606:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2832 00000100:00100000:3.0:1787826296.261946:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2835 00000100:00100000:3.0:1787826296.261957:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789553664:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.261967:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.261977:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b67333d/0x68019081f3498049 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa84f expref: 10 pid: 8433 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.261988:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b67333d/0x68019081f3498049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa84f expref: 10 pid: 8433 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.262008:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826296.262013:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826296.262020:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f3498a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.262033:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f3498a05 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.262058:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.270740:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789553664:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 8768us (9158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.270758:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2835 00000100:00100000:3.0:1787826296.291121:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789554176 00000100:00100000:3.0:1787826296.291131:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789554176 00010000:00010000:3.0:1787826296.291188:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34969eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9bbb expref: 29 pid: 45683 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.291248:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789554048 00000100:00100000:3.0:1787826296.291252:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789554048 00010000:00010000:3.0:1787826296.291267:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3497257 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9f03 expref: 231 pid: 46361 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.291299:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2836 00000100:00100000:3.0:1787826296.291310:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789554176:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.291334:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.291343:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34969eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9bbb expref: 29 pid: 45683 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.291356:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34969eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9bbb expref: 29 pid: 45683 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.291384:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34969eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f9bbb expref: 29 pid: 45683 timeout: 3034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.291402:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfd:0x0].0x0 (ffff9bbe0bd66400) 00010000:00010000:3.0:1787826296.291409:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4800/0x68019081f3498a0c lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.291423:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4800/0x68019081f3498a0c lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.291431:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.291509:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789554176:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 199us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.291525:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2836 00000100:00100000:3.0:1787826296.302692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.308884:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.317267:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789554688 00000100:00100000:3.0:1787826296.317276:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789554688 00010000:00010000:3.0:1787826296.317322:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be128b1b/0x68019081f3498114 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa89c expref: 13 pid: 8605 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.317375:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2838 00000100:00100000:3.0:1787826296.317384:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789554688:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.317398:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.317417:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be128b1b/0x68019081f3498114 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa89c expref: 13 pid: 8605 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.317429:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be128b1b/0x68019081f3498114 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa89c expref: 13 pid: 8605 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.317462:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be128b1b/0x68019081f3498114 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa89c expref: 13 pid: 8605 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.317482:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.317531:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789554688:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 149us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.317539:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2838 00000100:00100000:3.0:1787826296.319287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826296.319814:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029c9cf99/0x68019081f3498a28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.319824:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029c9cf99/0x68019081f3498a28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.319846:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029c9cf99/0x68019081f3498a28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.319882:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029c9cf99/0x68019081f3498a28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.319890:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029c9cf99/0x68019081f3498a28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.319896:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf27bf9400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826296.319900:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029c9cf99/0x68019081f3498a28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.319909:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029c9cf99/0x68019081f3498a28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.319922:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029c9cf99/0x68019081f3498a28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.319930:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029c9cf99/0x68019081f3498a28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.319975:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+7:2400:x1874668789554560:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 9396us (11141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.319983:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6037 00000040:00080000:3.0:1787826296.322169:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826296.322176:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826296.322463:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9652 count 52 00000040:00080000:3.0:1787826296.322473:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1787826296.337373:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.354651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.362895:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.366501:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.383622:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789555968 00000100:00100000:3.0:1787826296.383631:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789555968 00010000:00010000:3.0:1787826296.383679:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093e53738/0x68019081f34980ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa88e expref: 9 pid: 8433 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.383721:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2843 00000100:00100000:3.0:1787826296.383732:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789555968:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826296.383765:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826296.383796:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093e53738/0x68019081f34980ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa88e expref: 9 pid: 8433 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.383813:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093e53738/0x68019081f34980ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa88e expref: 9 pid: 8433 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.383876:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093e53738/0x68019081f34980ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fa88e expref: 9 pid: 8433 timeout: 3034 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.383898:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826296.383904:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826296.383911:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071b47b8d/0x68019081f3498a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.383923:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071b47b8d/0x68019081f3498a4b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.383960:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826296.384035:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789555968:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 304us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.384044:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2843 00000100:00100000:3.0:1787826296.403547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.411004:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe09c76600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826296.416786:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778582144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826296.417524:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015939 00010000:00010000:3.0:1787826296.417762:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498a52 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.417781:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498a52 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.417789:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498a52 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.417796:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3ddc4400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.417802:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498a52 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.417810:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498a52 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.417830:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xff:0x0].0x0 (ffff9bbe0bd66200) 00010000:00010000:3.0:1787826296.418407:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826296.418417:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498a52 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xff:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.418426:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498a52 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xff:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826296.418623:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x4a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826296.419532:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].42, 64 off10904 00000001:00080000:3.0:1787826296.419560:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015940 00010000:00010000:3.0:1787826296.419638:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xff:0x0].0x0 (ffff9bbe0bd66200) 00010000:00010000:3.0:1787826296.419643:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826296.423469:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f3498a3d lrc: 0/0,0 mode: --/PW res: [0x200000403:0xff:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fadd5 expref: 250 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.423813:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+249:84116:x1874668789556224:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 35251us (35486us total) trans 8590015941 rc 0/0 00000100:00100000:3.0:1787826296.423826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2522 00000020:00080000:3.0:1787826296.423843:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787826296.432278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826296.473521:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789557120 00000100:00100000:3.0:1787826296.473540:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789557120 00010000:00010000:3.0:1787826296.477174:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4bce9cb/0x68019081f3498a6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.477207:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4bce9cb/0x68019081f3498a6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.477252:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4bce9cb/0x68019081f3498a6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.477263:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4bce9cb/0x68019081f3498a6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.477274:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4bce9cb/0x68019081f3498a6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.477282:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826296.477288:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4bce9cb/0x68019081f3498a6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.477299:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4bce9cb/0x68019081f3498a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.477332:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4bce9cb/0x68019081f3498a6e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.477342:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4bce9cb/0x68019081f3498a6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826296.477536:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789556864:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 26912us (27138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.477553:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6039 00000100:00100000:3.0:1787826296.569781:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789557760 00000100:00100000:3.0:1787826296.569791:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789557760 00000100:00100000:3.0:1787826296.569900:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110725 00000100:00100000:3.0:1787826296.569911:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+257:84119:x1874668789557760:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826296.569935:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.569957:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498a7c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fade3 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570024:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570038:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570050:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570063:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570070:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570077:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570153:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6a00/0x68019081f3498a91 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570161:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6a00/0x68019081f3498a91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570168:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6a00/0x68019081f3498a91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.570209:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xce:0x0]: returning size 158 00000004:00200000:3.0:1787826296.570214:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.570234:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6a00/0x68019081f3498a91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570246:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6a00/0x68019081f3498a91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570254:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570260:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570267:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570276:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe167d6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.570280:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570288:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570300:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.570303:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.570307:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570313:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498a83 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570327:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570332:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570351:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570357:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe167d6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.570360:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570365:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570376:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x5636f1f9 (ffff9bbe010a0e00) 00010000:00010000:3.0:1787826296.570379:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.570382:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570388:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498a8a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5636f1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570417:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498a7c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fade3 expref: 259 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570431:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6a00/0x68019081f3498a91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fade3 expref: 258 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.570439:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xce:0x0].0x0 (ffff9bbe010a0500) 00010000:00010000:3.0:1787826296.570450:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826296.570453:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe167d6a00, rc 0) 00000100:00100000:3.0:1787826296.570666:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+258:84119:x1874668789557760:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 755us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826296.570674:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110725 00000004:00010000:1.0:1787826296.647982:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5a00/0x68019081f3498d31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.647994:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5a00/0x68019081f3498d31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648000:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5200/0x68019081f3498d23 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648006:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5200/0x68019081f3498d23 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648012:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5200/0x68019081f3498d23 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648016:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3ddc5200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.648019:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5200/0x68019081f3498d23 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648025:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5200/0x68019081f3498d23 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648033:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.648045:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.648048:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5200/0x68019081f3498d23 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648054:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5200/0x68019081f3498d23 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648064:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3498d2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2e4f95aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648069:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3498d2a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2e4f95aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648075:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3498d2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2e4f95aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648080:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3ddc4600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.648083:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3498d2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2e4f95aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648090:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3498d2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2e4f95aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648096:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x2e4f95aa (ffff9bbe0dcf9d00) 00010000:00010000:1.0:1787826296.648098:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.648101:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3498d2a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x2e4f95aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648107:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3498d2a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x2e4f95aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648127:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3498d1c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fae8b expref: 288 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648138:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5a00/0x68019081f3498d31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fae8b expref: 287 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648144:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe6:0x0].0x0 (ffff9bbe0dcf9600) 00010000:00010000:1.0:1787826296.648146:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.648148:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf3ddc5a00, rc 0) 00010000:00010000:1.0:1787826296.648153:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.648160:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5800/0x68019081f3498d38 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fae92 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648181:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648189:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648197:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648207:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648213:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648220:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648268:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4000/0x68019081f3498d4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648276:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4000/0x68019081f3498d4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.648285:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4000/0x68019081f3498d4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.648304:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe7:0x0]: returning size 158 00000004:00200000:1.0:1787826296.648310:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.648320:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4000/0x68019081f3498d4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.651725:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.652024:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6400/0x68019081f3498d54 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faed8 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652089:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652104:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652116:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652131:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652138:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652144:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652250:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498d69 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652258:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498d69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652265:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498d69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.652288:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf1:0x0]: returning size 158 00000004:00200000:3.0:1787826296.652292:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.652309:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498d69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.652319:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498d69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.653983:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.653995:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654002:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654007:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe167d7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.654011:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654018:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654033:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.654036:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.654040:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654046:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7e00/0x68019081f3498d5b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654060:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654065:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654070:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654074:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe167d6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.654077:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654082:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654087:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x5c68cb9b (ffff9bbe010a0e00) 00010000:00010000:3.0:1787826296.654089:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.654091:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654096:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6600/0x68019081f3498d62 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5c68cb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654136:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6400/0x68019081f3498d54 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faed8 expref: 290 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654148:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6800/0x68019081f3498d69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faed8 expref: 289 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654155:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf1:0x0].0x0 (ffff9bbe010a0900) 00010000:00010000:3.0:1787826296.654157:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826296.654159:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe167d6800, rc 0) 00010000:00010000:3.0:1787826296.654168:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.654182:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6000/0x68019081f3498d70 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faedf expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654221:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654232:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654240:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654255:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654262:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654269:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654371:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f3498d85 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654381:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f3498d85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654389:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f3498d85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.654413:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf2:0x0]: returning size 158 00000004:00200000:3.0:1787826296.654418:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.654438:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f3498d85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654459:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f3498d85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654467:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654478:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654485:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654493:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe167d7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.654501:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654512:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654529:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.654533:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.654536:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654543:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7c00/0x68019081f3498d77 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654553:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654559:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654565:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654570:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe167d6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.654574:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654580:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654587:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xaeec8e38 (ffff9bbe010a0200) 00010000:00010000:3.0:1787826296.654589:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.654593:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654598:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6e00/0x68019081f3498d7e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xaeec8e38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654631:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6000/0x68019081f3498d70 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faedf expref: 291 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654645:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6c00/0x68019081f3498d85 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faedf expref: 290 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654652:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf2:0x0].0x0 (ffff9bbe010a0d00) 00010000:00010000:3.0:1787826296.654655:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826296.654659:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe167d6c00, rc 0) 00010000:00010000:3.0:1787826296.654664:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.654708:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7a00/0x68019081f3498d8c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faee6 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654737:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654751:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654764:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654779:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654801:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654812:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654891:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7600/0x68019081f3498da1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654900:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7600/0x68019081f3498da1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654906:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7600/0x68019081f3498da1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.654923:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf3:0x0]: returning size 158 00000004:00200000:3.0:1787826296.654927:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.654936:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7600/0x68019081f3498da1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654944:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7600/0x68019081f3498da1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654950:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654960:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654966:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654971:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe167d7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.654974:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654980:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654987:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.654990:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.654993:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.654998:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7800/0x68019081f3498d93 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655009:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655014:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655021:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655027:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe167d6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.655029:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655035:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655041:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xc88fc0e (ffff9bbe010a0700) 00010000:00010000:3.0:1787826296.655043:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.655046:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655051:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d6200/0x68019081f3498d9a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xc88fc0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655072:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7a00/0x68019081f3498d8c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faee6 expref: 292 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655082:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7600/0x68019081f3498da1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faee6 expref: 291 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655088:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf3:0x0].0x0 (ffff9bbe010a0b00) 00010000:00010000:3.0:1787826296.655090:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826296.655092:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe167d7600, rc 0) 00010000:00010000:3.0:1787826296.655096:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.655103:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7400/0x68019081f3498da8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faeed expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655122:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655130:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655137:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655147:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655153:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655158:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655198:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057a00/0x68019081f3498dbd lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655206:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057a00/0x68019081f3498dbd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655212:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057a00/0x68019081f3498dbd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.655227:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf4:0x0]: returning size 158 00000004:00200000:3.0:1787826296.655229:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.655238:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057a00/0x68019081f3498dbd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655246:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057a00/0x68019081f3498dbd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655253:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655261:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655266:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655271:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe167d7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.655274:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655280:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655288:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.655290:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.655293:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655298:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7000/0x68019081f3498daf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655307:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655312:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655318:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655323:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf42057200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.655326:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655331:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655338:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x24e91927 (ffff9bbe010a0800) 00010000:00010000:3.0:1787826296.655341:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.655344:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655349:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057200/0x68019081f3498db6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x24e91927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655370:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe167d7400/0x68019081f3498da8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faeed expref: 293 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655381:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057a00/0x68019081f3498dbd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faeed expref: 292 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655388:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf4:0x0].0x0 (ffff9bbe010a0a00) 00010000:00010000:3.0:1787826296.655390:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826296.655391:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf42057a00, rc 0) 00010000:00010000:3.0:1787826296.655395:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.655402:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42056a00/0x68019081f3498dc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faef4 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655423:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655431:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655439:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655462:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655469:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655476:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655517:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cbe00/0x68019081f3498dd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655525:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cbe00/0x68019081f3498dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655531:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cbe00/0x68019081f3498dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.655546:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf5:0x0]: returning size 158 00000004:00200000:3.0:1787826296.655550:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.655559:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cbe00/0x68019081f3498dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655566:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cbe00/0x68019081f3498dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655572:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655582:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655588:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655594:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf42057e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.655597:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655602:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655610:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.655612:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.655615:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655620:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057e00/0x68019081f3498dcb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655629:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655634:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655640:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655644:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf42057600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.655647:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655653:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655660:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x5ea2be49 (ffff9bbe010a0300) 00010000:00010000:3.0:1787826296.655662:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.655664:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655669:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42057600/0x68019081f3498dd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5ea2be49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655690:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf42056a00/0x68019081f3498dc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faef4 expref: 294 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655701:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cbe00/0x68019081f3498dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faef4 expref: 293 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655706:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf5:0x0].0x0 (ffff9bbe010a0c00) 00010000:00010000:3.0:1787826296.655708:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826296.655710:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe091cbe00, rc 0) 00010000:00010000:3.0:1787826296.655714:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.655721:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca600/0x68019081f3498de0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faefb expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655742:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.655750:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.655955:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4000/0x68019081f3498d4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656229:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656245:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656256:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656263:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656314:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca800/0x68019081f3498df5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656382:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca800/0x68019081f3498df5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656390:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca800/0x68019081f3498df5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.656411:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf6:0x0]: returning size 158 00000004:00200000:3.0:1787826296.656414:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.656424:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca800/0x68019081f3498df5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656433:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca800/0x68019081f3498df5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656474:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656482:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656489:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656498:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3ddc5000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.656501:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656503:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656513:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656519:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656520:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656525:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe091cb400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.656534:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.656534:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656536:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.656540:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656548:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.656550:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.656553:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656559:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb400/0x68019081f3498de7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656569:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656574:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656580:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656585:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe091ca400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.656588:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656594:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656601:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xa965d386 (ffff9bbe010a0000) 00010000:00010000:1.0:1787826296.656603:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656603:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.656606:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656610:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5000/0x68019081f3498d3f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656612:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca400/0x68019081f3498dee lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xa965d386 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656622:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656627:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656633:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656635:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca600/0x68019081f3498de0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faefb expref: 295 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656638:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3ddc4400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.656641:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656646:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca800/0x68019081f3498df5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faefb expref: 294 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.656648:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656654:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf6:0x0].0x0 (ffff9bbe010a0400) 00010000:00010000:1.0:1787826296.656655:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xf9b363 (ffff9bbe0dcf9800) 00010000:00010000:3.0:1787826296.656656:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.656658:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.656658:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe091ca800, rc 0) 00010000:00010000:3.0:1787826296.656663:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.656670:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091caa00/0x68019081f3498dfc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faf02 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656696:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656704:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656711:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656722:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656728:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656734:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656867:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca000/0x68019081f3498e11 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656875:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca000/0x68019081f3498e11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656882:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca000/0x68019081f3498e11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.656898:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf7:0x0]: returning size 158 00000004:00200000:3.0:1787826296.656901:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.656910:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca000/0x68019081f3498e11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656917:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca000/0x68019081f3498e11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656923:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656932:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656938:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656942:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe091cba00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.656946:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656952:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656960:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.656962:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.656965:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656971:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cba00/0x68019081f3498e03 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656980:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656985:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656990:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.656995:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe091ca200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.656998:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657003:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657009:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x31d82069 (ffff9bbe010a0100) 00010000:00010000:3.0:1787826296.657011:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.657013:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657018:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca200/0x68019081f3498e0a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x31d82069 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657039:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091caa00/0x68019081f3498dfc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf02 expref: 296 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657049:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091ca000/0x68019081f3498e11 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf02 expref: 295 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657054:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf7:0x0].0x0 (ffff9bbe010a0600) 00010000:00010000:3.0:1787826296.657056:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826296.657058:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe091ca000, rc 0) 00010000:00010000:3.0:1787826296.657062:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.657069:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb200/0x68019081f3498e18 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faf09 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657089:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657096:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657104:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657116:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657122:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657128:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657169:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb600/0x68019081f3498e2d lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657177:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb600/0x68019081f3498e2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657183:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb600/0x68019081f3498e2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.657199:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf8:0x0]: returning size 158 00000004:00200000:3.0:1787826296.657202:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.657211:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb600/0x68019081f3498e2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657219:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb600/0x68019081f3498e2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657226:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657235:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657240:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657244:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe091cb000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.657247:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657252:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657259:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.657261:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.657264:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657269:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb000/0x68019081f3498e1f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657277:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657283:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657288:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657293:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe091cac00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.657296:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657302:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657308:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x7d3e0392 (ffff9bbe08124400) 00010000:00010000:3.0:1787826296.657310:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.657313:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657318:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cac00/0x68019081f3498e26 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x7d3e0392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657406:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb200/0x68019081f3498e18 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf09 expref: 297 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657418:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe091cb600/0x68019081f3498e2d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf09 expref: 296 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657424:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf8:0x0].0x0 (ffff9bbe08124100) 00010000:00010000:3.0:1787826296.657427:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826296.657429:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe091cb600, rc 0) 00010000:00010000:3.0:1787826296.657433:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.657451:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3498e34 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faf10 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657474:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657482:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657489:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657499:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657506:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657511:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657550:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3498e49 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657557:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3498e49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657563:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3498e49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.657577:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf9:0x0]: returning size 158 00000004:00200000:3.0:1787826296.657580:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.657589:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3498e49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657597:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3498e49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657603:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657613:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657618:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657622:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.657625:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657630:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657638:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.657640:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.657642:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657647:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3498e3b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657656:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657662:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657667:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657671:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.657674:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657679:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657685:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xc26b1ac5 (ffff9bbe08124300) 00010000:00010000:3.0:1787826296.657688:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.657690:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657696:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3498e42 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xc26b1ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657714:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3498e34 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf10 expref: 298 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657725:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3498e49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf10 expref: 297 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657731:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf9:0x0].0x0 (ffff9bbe08124d00) 00010000:00010000:3.0:1787826296.657733:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.657771:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.657780:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4400/0x68019081f3498d46 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xf9b363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.657817:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5800/0x68019081f3498d38 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fae92 expref: 298 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657835:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606400, rc 0) 00010000:00010000:1.0:1787826296.657837:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4000/0x68019081f3498d4d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fae92 expref: 297 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657841:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.657843:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe7:0x0].0x0 (ffff9bbe0dcf9500) 00010000:00010000:1.0:1787826296.657845:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.657847:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf3ddc4000, rc 0) 00010000:00010000:3.0:1787826296.657849:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3498e50 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faf17 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.657874:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.657895:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657902:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657911:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657920:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657926:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826296.657929:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778583424:0@lo:400:kworker.0 00010000:00010000:3.0:1787826296.657931:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826296.657954:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778583936:0@lo:400:kworker.0 00000100:00100000:1.0:1787826296.657966:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778584448:0@lo:400:kworker.0 00010000:00010000:3.0:1787826296.657971:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3498e65 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826296.657978:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778583808:0@lo:400:kworker.0 00010000:00010000:3.0:1787826296.657978:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3498e65 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.657984:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3498e65 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826296.657998:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfa:0x0]: returning size 158 00000004:00200000:3.0:1787826296.658001:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.658009:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3498e65 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658016:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3498e65 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658022:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658031:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658036:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658040:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.658043:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658049:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658058:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.658061:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.658063:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658068:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3498e57 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658074:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.658077:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658082:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5c00/0x68019081f3498e6c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb098 expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658082:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658089:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658093:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.658096:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658102:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658109:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x84da7f63 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826296.658112:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.658115:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658117:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658120:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3498e5e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x84da7f63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658126:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658133:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658138:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3498e50 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf17 expref: 300 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658144:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658148:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3498e65 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf17 expref: 299 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658151:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658155:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe08124700) 00010000:00010000:3.0:1787826296.658157:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.658158:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658159:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00010000:00010000:3.0:1787826296.658163:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826296.658169:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3498e81 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faf1e expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658173:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658179:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658185:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658187:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658191:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3ddc4200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.658194:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658348:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658357:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658376:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.658379:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.658382:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658388:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4200/0x68019081f3498e73 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658388:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658398:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658403:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658404:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658411:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658411:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658417:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3ddc5400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.658419:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658420:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658430:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658437:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xa84ce5e8 (ffff9bbe0dcf9100) 00010000:00010000:1.0:1787826296.658439:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.658452:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658458:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5400/0x68019081f3498e7a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xa84ce5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658474:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3498e96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658479:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5c00/0x68019081f3498e6c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb098 expref: 300 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658482:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3498e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658489:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.658489:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3498e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658491:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826296.658495:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5c00/0x68019081f3498e6c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb098 expref: 300 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658503:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf3ddc5c00, rc -2) 00000004:00200000:3.0:1787826296.658503:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfb:0x0]: returning size 158 00000004:00200000:3.0:1787826296.658506:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826296.658514:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3498e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658520:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3498e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658527:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658535:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658540:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658544:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.658547:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658552:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658558:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826296.658560:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.658563:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658568:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3498e88 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658577:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826296.658581:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+298:2401:x1874668789558400:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 27502us (29883us total) trans 0 rc -2/-2 00010000:00010000:3.0:1787826296.658583:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658588:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826296.658590:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3240 00010000:00010000:3.0:1787826296.658593:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826296.658596:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658601:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658607:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x668f7d11 (ffff9bbe08124800) 00010000:00010000:3.0:1787826296.658609:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826296.658612:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658617:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3498e8f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x668f7d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658622:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3c00/0x68019081f3498e9d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fae99 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658635:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3498e81 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf1e expref: 299 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658647:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658647:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3498e96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faf1e expref: 298 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658654:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfb:0x0].0x0 (ffff9bbe08124b00) 00010000:00010000:1.0:1787826296.658655:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658656:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826296.658658:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00010000:00010000:3.0:1787826296.658662:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.658663:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658668:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3498eab lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faf25 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658672:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658679:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658686:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658686:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3498eb9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658693:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3498eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658700:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3498eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658710:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3498ec0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x23082aff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658716:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3498ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x23082aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826296.658723:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3498ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x23082aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658726:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2a00/0x68019081f3498ec7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658734:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2a00/0x68019081f3498ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658740:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2a00/0x68019081f3498ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.658755:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe8:0x0]: returning size 158 00000004:00200000:1.0:1787826296.658758:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.658768:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2a00/0x68019081f3498ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658776:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2a00/0x68019081f3498ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658785:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658790:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658795:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658799:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0caa3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.658802:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658808:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658815:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.658817:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.658819:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658824:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3400/0x68019081f3498ea4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658845:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658874:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658880:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658886:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0caa2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.658889:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658896:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658904:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x5c9e237a (ffff9bbe0dcf9900) 00010000:00010000:1.0:1787826296.658906:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.658909:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658915:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2400/0x68019081f3498eb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x5c9e237a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.658936:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3c00/0x68019081f3498e9d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fae99 expref: 300 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659310:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2a00/0x68019081f3498ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fae99 expref: 299 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659319:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe8:0x0].0x0 (ffff9bbe0dcf9f00) 00010000:00010000:1.0:1787826296.659321:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.659324:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0caa2a00, rc 0) 00010000:00010000:1.0:1787826296.659329:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.659341:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2e00/0x68019081f3498ece lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faea0 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659428:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659438:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659454:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659466:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659472:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659478:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659523:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3600/0x68019081f3498ee3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659531:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3600/0x68019081f3498ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659538:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3600/0x68019081f3498ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.659553:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe9:0x0]: returning size 158 00000004:00200000:1.0:1787826296.659556:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.659566:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3600/0x68019081f3498ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659573:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3600/0x68019081f3498ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659584:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659589:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659594:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659599:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0caa2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.659602:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659608:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659616:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.659618:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.659621:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659627:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2c00/0x68019081f3498ed5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659636:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659642:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659648:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659653:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0caa2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.659656:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659661:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659668:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x48bd162c (ffff9bbe0dcf9400) 00010000:00010000:1.0:1787826296.659670:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.659672:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659677:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2200/0x68019081f3498edc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x48bd162c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659696:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2e00/0x68019081f3498ece lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faea0 expref: 301 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659706:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3600/0x68019081f3498ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faea0 expref: 300 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659712:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe9:0x0].0x0 (ffff9bbe0dcf9a00) 00010000:00010000:1.0:1787826296.659714:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.659716:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0caa3600, rc 0) 00010000:00010000:1.0:1787826296.659720:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.659727:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2600/0x68019081f3498eea lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faea7 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659747:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659754:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659761:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659771:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659777:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659783:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.659823:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3000/0x68019081f3498eff lrc: 3/1,0 mode: --/PR res: [0x200000403:0xea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660451:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3000/0x68019081f3498eff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660461:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3000/0x68019081f3498eff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.660486:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xea:0x0]: returning size 158 00000004:00200000:1.0:1787826296.660489:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.660500:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3000/0x68019081f3498eff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660509:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3000/0x68019081f3498eff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660520:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660526:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660532:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660537:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0caa3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.660540:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660546:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660555:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.660558:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.660561:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660566:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3e00/0x68019081f3498ef1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660575:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660581:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660587:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660591:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0caa2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.660594:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660599:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660606:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x825c62b1 (ffff9bbe0dcf9300) 00010000:00010000:1.0:1787826296.660607:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.660610:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660615:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2000/0x68019081f3498ef8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x825c62b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660638:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2600/0x68019081f3498eea lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faea7 expref: 302 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660648:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3000/0x68019081f3498eff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faea7 expref: 301 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660654:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xea:0x0].0x0 (ffff9bbe0dcf9200) 00010000:00010000:1.0:1787826296.660656:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.660658:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0caa3000, rc 0) 00010000:00010000:1.0:1787826296.660664:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.660674:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3800/0x68019081f3498f06 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faeae expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660701:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660711:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660719:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.660735:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661194:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661203:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661274:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f3498f1b lrc: 3/1,0 mode: --/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661282:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f3498f1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661289:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f3498f1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.661307:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xeb:0x0]: returning size 158 00000004:00200000:1.0:1787826296.661310:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.661321:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f3498f1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661329:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f3498f1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661340:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661347:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661353:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661358:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0caa3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.661515:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661524:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661532:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.661534:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.661537:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661543:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3200/0x68019081f3498f0d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661552:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661558:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661564:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661570:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0caa2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.661573:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661579:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661584:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xf3e2cdc5 (ffff9bbe0dcf9b00) 00010000:00010000:1.0:1787826296.661586:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.661589:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661595:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa2800/0x68019081f3498f14 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xf3e2cdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661624:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0caa3800/0x68019081f3498f06 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faeae expref: 304 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661636:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f3498f1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faeae expref: 302 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661645:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xeb:0x0].0x0 (ffff9bbe1342fd00) 00010000:00010000:1.0:1787826296.661648:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.661650:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d400, rc 0) 00010000:00010000:1.0:1787826296.661656:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.661664:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c000/0x68019081f3498f30 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faeb5 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661688:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661696:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661703:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661714:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661720:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.661727:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665636:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f3498fae lrc: 3/1,0 mode: --/PR res: [0x200000403:0xec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665647:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f3498fae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665656:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f3498fae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.665688:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xec:0x0]: returning size 158 00000004:00200000:1.0:1787826296.665692:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.665710:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f3498fae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665721:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f3498fae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665733:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665739:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665745:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665750:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.665753:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665760:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665769:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.665772:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.665775:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665781:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f3498f3e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665792:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665798:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665803:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665808:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993da00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.665811:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665816:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.665823:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xfc9d58af (ffff9bbe1342ff00) 00010000:00010000:1.0:1787826296.665825:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.665828:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.666025:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f3498f45 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xfc9d58af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.666056:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c000/0x68019081f3498f30 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faeb5 expref: 306 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.666068:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f3498fae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faeb5 expref: 305 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.666075:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xec:0x0].0x0 (ffff9bbe1342fb00) 00010000:00010000:1.0:1787826296.666077:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.666079:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993cc00, rc 0) 00010000:00010000:1.0:1787826296.666086:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.667049:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f3498fca lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faebc expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667434:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667457:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667467:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667483:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667559:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667566:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667653:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f3498fdf lrc: 3/1,0 mode: --/PR res: [0x200000403:0xed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667662:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f3498fdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667670:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f3498fdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.667693:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xed:0x0]: returning size 158 00000004:00200000:1.0:1787826296.667697:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.667714:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f3498fdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667725:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f3498fdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667737:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667743:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667750:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667756:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.667759:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667766:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667776:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.667779:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.667782:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667789:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f3498fd1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667803:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667809:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667815:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.667820:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993ce00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.667823:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672512:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672551:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xd3e31891 (ffff9bbe1342f400) 00010000:00010000:1.0:1787826296.672555:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.672564:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672572:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f3498fd8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xd3e31891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672634:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f3498fca lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faebc expref: 307 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672652:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f3498fdf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faebc expref: 306 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672659:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xed:0x0].0x0 (ffff9bbe1342f600) 00010000:00010000:1.0:1787826296.672661:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.672664:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c200, rc 0) 00010000:00010000:1.0:1787826296.672677:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.672693:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ca00/0x68019081f3498fe6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faec3 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672739:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672752:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672761:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672778:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672785:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672792:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.672907:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f3498ffb lrc: 3/1,0 mode: --/PR res: [0x200000403:0xee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.673744:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f3498ffb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.673757:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f3498ffb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.673789:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xee:0x0]: returning size 158 00000004:00200000:1.0:1787826296.673793:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.673812:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f3498ffb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.673822:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f3498ffb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.673835:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.673840:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.673848:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674259:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.674264:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674272:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674284:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.674287:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.674290:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674296:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f3498fed lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674311:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674317:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674322:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674328:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.674331:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674337:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674344:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x25a8890 (ffff9bbe1342f300) 00010000:00010000:1.0:1787826296.674347:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.674350:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674355:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f3498ff4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x25a8890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674470:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ca00/0x68019081f3498fe6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faec3 expref: 308 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674484:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f3498ffb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faec3 expref: 307 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674559:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xee:0x0].0x0 (ffff9bbe1342f200) 00010000:00010000:1.0:1787826296.674562:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.674565:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00010000:00010000:1.0:1787826296.674575:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.674588:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f3499002 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faeca expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674622:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674633:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674640:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674654:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674661:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674667:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674739:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3499017 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674748:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3499017 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674754:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3499017 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.674772:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xef:0x0]: returning size 158 00000004:00200000:1.0:1787826296.674776:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.674787:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3499017 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674795:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3499017 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674806:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674811:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674817:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674821:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.674824:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674830:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.674839:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.674841:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.674844:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675016:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f3499009 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675030:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675035:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675041:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675046:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3ddc4e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.675049:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675054:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675061:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x580af33e (ffff9bbe1342f000) 00010000:00010000:1.0:1787826296.675063:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.675066:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675071:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4e00/0x68019081f3499010 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x580af33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675092:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f3499002 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faeca expref: 309 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675176:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc4600/0x68019081f3499017 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faeca expref: 308 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675184:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xef:0x0].0x0 (ffff9bbe1342f800) 00010000:00010000:1.0:1787826296.675186:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.675189:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf3ddc4600, rc 0) 00010000:00010000:1.0:1787826296.675194:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826296.675203:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5200/0x68019081f349901e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8faed1 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675226:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675234:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675240:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675250:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675257:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675263:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675306:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499033 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675315:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499033 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675321:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499033 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826296.675336:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf0:0x0]: returning size 158 00000004:00200000:1.0:1787826296.675339:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826296.675347:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499033 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675356:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499033 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675585:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675591:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675598:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675603:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.675607:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675613:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675623:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826296.675625:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.675628:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675634:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499025 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675644:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675650:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675657:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675663:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826296.675666:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675672:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675679:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xdb72b89c (ffff9bbe1342f700) 00010000:00010000:1.0:1787826296.675682:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826296.675684:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675690:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349902c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xdb72b89c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675713:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3ddc5200/0x68019081f349901e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faed1 expref: 310 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675724:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499033 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8faed1 expref: 309 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826296.675731:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf0:0x0].0x0 (ffff9bbe1342fe00) 00010000:00010000:1.0:1787826296.675733:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826296.675735:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826296.675820:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+308:2400:x1874668789558144:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 51222us (58918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826296.675831:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3239 00000100:00100000:3.0:1787826297.154867:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778584576 00000100:00100000:3.0:1787826297.155045:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778584576 00000100:00100000:3.0:1787826297.155127:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:3.0:1787826297.155142:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778584576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826297.155183:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 672134336 pending 0 free 3894804480 avail 3663282176 00000100:00100000:3.0:1787826297.155275:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778584576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.155284:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000040:00080000:3.0:1787826297.345045:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826297.345058:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826297.345235:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9655 count 103 00000040:00080000:3.0:1787826297.345247:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826297.345450:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102df840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778584704:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826297.345578:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826297.349963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.353615:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102df840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778584704:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826297.358139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.361637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.361710:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.361737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.361784:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789559168 00000100:00100000:3.0:1787826297.361796:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789559168 00000100:00100000:3.0:1787826297.361867:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789559296 00000100:00100000:3.0:1787826297.361870:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789559296 00000100:00100000:3.0:1787826297.361895:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789559424 00000100:00100000:3.0:1787826297.361898:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789559424 00000100:00100000:3.0:1787826297.361922:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110729 00000100:00100000:3.0:1787826297.361932:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+27:84131:x1874668789559168:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.364812:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.364838:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.364864:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.364886:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.364894:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.364900:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.364934:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.364947:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.364953:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826297.366583:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xce:0x0]: returning size 158 00000004:00200000:3.0:1787826297.366598:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826297.366624:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366651:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366661:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366668:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366677:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366684:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.366689:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366697:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366715:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826297.366719:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.366725:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366732:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34991b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366747:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366752:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366759:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366764:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.366767:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366774:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366781:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x99ca2f2 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826297.366784:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.366787:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366793:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34991bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x99ca2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366809:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366816:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366823:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366828:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.366831:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366837:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366844:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xce:0x0].0x0 (ffff9bbe0a651d00) 00010000:00010000:3.0:1787826297.366846:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.366864:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.366871:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f34991c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.367100:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:84131:x1874668789559168:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 5163us (5471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.367112:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110729 00000100:00100000:3.0:1787826297.368668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.368712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.369085:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789559680 00000100:00100000:1.0:1787826297.369097:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789559680 00000100:00100000:1.0:1787826297.369163:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789559808 00000100:00100000:1.0:1787826297.369166:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789559808 00000100:00100000:1.0:1787826297.369194:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110732 00000100:00100000:1.0:1787826297.369206:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+26:84132:x1874668789559680:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826297.369243:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787826297.369261:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110733 00010000:00010000:1.0:1787826297.369271:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34991c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb1a2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.369277:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+26:84133:x1874668789559808:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.369357:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369374:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369387:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369403:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369410:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369415:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369453:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369461:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369468:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826297.369513:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd0:0x0]: returning size 158 00010000:00010000:1.0:1787826297.369518:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826297.369519:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787826297.369532:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826297.369538:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369542:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826297.369557:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xcf:0x0]: returning size 158 00010000:00010000:3.0:1787826297.369557:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369572:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369579:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369586:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369592:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.369596:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369604:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369617:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826297.369620:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.369625:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369631:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34991d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369643:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369649:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369656:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369657:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369671:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826297.369674:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369676:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369691:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369692:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369706:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.369711:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xe7d7399b (ffff9bbe08124300) 00010000:00010000:1.0:1787826297.369712:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369715:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.369720:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369726:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369730:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34991d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xe7d7399b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369740:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xcf:0x0].0x0 (ffff9bbf1127f400) 00010000:00010000:1.0:1787826297.369745:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826297.369749:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369750:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369767:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369768:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f34991e5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369784:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369793:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.369797:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369804:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369818:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd0:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:1.0:1787826297.369820:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34991c9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1a2 expref: 28 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369822:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.369827:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.369839:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34991de lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369840:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826297.369847:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826297.369877:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34991c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1a2 expref: 28 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.369892:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:1.0:1787826297.369953:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+27:84132:x1874668789559680:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 749us (1293us total) trans 8590015951 rc 301/301 00000100:00100000:3.0:1787826297.370374:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+27:84133:x1874668789559808:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1101us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.370383:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110733 00000100:00100000:1.0:1787826297.371622:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110732 00000100:00100000:3.0:1787826297.382833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.382998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.387824:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.400627:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789560704 00000100:00100000:3.0:1787826297.400640:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789560704 00000100:00100000:3.0:1787826297.400771:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110737 00000100:00100000:3.0:1787826297.400783:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+28:84132:x1874668789560704:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.400812:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.400840:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349921d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb1b7 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.404754:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499224 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.404781:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499224 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.404797:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499224 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826297.404811:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x101:0x0]: returning size 0 00010000:00010000:1.0:1787826297.405333:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349921d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1b7 expref: 31 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.405361:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499224 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1b7 expref: 30 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.405371:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe1342f700) 00010000:00010000:1.0:1787826297.405375:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826297.405380:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:1.0:1787826297.405595:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+30:84132:x1874668789560704:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4813us (5038us total) trans 8590015954 rc 0/0 00000100:00100000:1.0:1787826297.405607:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110737 00010000:00010000:3.0:1787826297.434650:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f3499232 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.434662:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f3499232 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.434691:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.434708:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.434717:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435032:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f3499232 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435041:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f3499232 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435048:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f3499232 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435055:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.435068:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f3499232 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435077:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f3499232 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435087:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826297.435090:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.435095:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f3499232 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435101:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f3499232 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435114:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435121:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435127:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435235:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.435239:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435246:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435254:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x2e29a7aa (ffff9bbe08124300) 00010000:00010000:3.0:1787826297.435257:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.435260:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.435327:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499239 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x2e29a7aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.435476:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+29:84132:x1874668789561216:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 11560us (11967us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826297.435485:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110740 00000100:00100000:3.0:1787826297.440048:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789561472 00000100:00100000:3.0:1787826297.440061:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789561472 00000100:00100000:3.0:1787826297.440141:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110741 00000100:00100000:3.0:1787826297.440154:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+29:84132:x1874668789561472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.440182:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.440223:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3499240 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb1be expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.440282:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.440298:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.440312:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.440473:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3499240 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1be expref: 31 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.440504:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1be expref: 30 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.440514:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826297.440517:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826297.440522:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc 0) 00000100:00100000:3.0:1787826297.440607:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+30:84132:x1874668789561472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 455us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.440615:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110741 00000100:00100000:3.0:1787826297.441685:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789561728 00000100:00100000:3.0:1787826297.441694:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789561728 00000100:00100000:3.0:1787826297.441792:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110742 00000100:00100000:3.0:1787826297.441803:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+30:84131:x1874668789561728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.442393:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.442425:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349924e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb1c5 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.443769:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499255 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x102:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.443789:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499255 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.443801:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499255 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826297.443813:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x102:0x0]: returning size 0 00010000:00010000:3.0:1787826297.443999:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349924e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1c5 expref: 33 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.444020:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499255 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1c5 expref: 32 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.444030:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826297.444034:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826297.444037:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826297.444174:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84131:x1874668789561728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2372us (2589us total) trans 8590015955 rc 0/0 00000100:00100000:3.0:1787826297.444183:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110742 00000100:00100000:1.0:1787826297.448429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.449453:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789561984 00000100:00100000:3.0:1787826297.449475:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789561984 00000100:00100000:1.0:1787826297.449780:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.451023:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789562240 00000100:00100000:1.0:1787826297.451036:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789562240 00000100:00100000:1.0:1787826297.451080:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110743 00000100:00100000:1.0:1787826297.451091:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84132:x1874668789561984:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826297.451209:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499263 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.451246:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499263 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.451266:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499263 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826297.451474:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b2e5fa5 reply state 00000000a6eb20fb transno 8590015956 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499263 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.451586:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110744 00000100:00100000:3.0:1787826297.451598:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84131:x1874668789562240:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.451636:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826297.451661:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499255 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x102:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1c5 expref: 34 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451682:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826297.451695:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826297.451713:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451723:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451731:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451746:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451753:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451760:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451803:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451811:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451818:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451826:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451832:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.451837:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451846:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.451876:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826297.451879:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.452691:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.452708:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349926a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.452729:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.452736:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.452744:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.452749:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.452754:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.452765:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.452778:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xde15747 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826297.452780:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.452784:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.452790:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499271 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xde15747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.453607:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499263 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x101:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.453625:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:1.0:1787826297.453628:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826297.453633:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826297.454029:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84131:x1874668789562240:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 2427us (4269us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826297.454041:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110744 00000100:00100000:1.0:1787826297.454157:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84132:x1874668789561984:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 3067us (5744us total) trans 8590015956 rc 0/0 00000100:00100000:1.0:1787826297.454165:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110743 00000100:00100000:1.0:1787826297.457985:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.458046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.458310:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110746 00000100:00100000:1.0:1787826297.458323:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84131:x1874668789562496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826297.458332:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826297.458350:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349927f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x102:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb1d3 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.458384:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x102:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.458400:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.458424:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.458572:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349927f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1d3 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.458589:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1d3 expref: 35 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.458596:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:1.0:1787826297.458599:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826297.458601:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:1.0:1787826297.458639:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84131:x1874668789562496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 320us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.458645:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110746 00000100:00100000:1.0:1787826297.460568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.464587:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789563008 00000100:00100000:3.0:1787826297.464601:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789563008 00000100:00100000:3.0:1787826297.464713:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110748 00000100:00100000:3.0:1787826297.464726:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84131:x1874668789563008:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.464832:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34992a2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.464934:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34992a2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.464951:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34992a2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826297.465153:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098c51b72 reply state 0000000074a0e18c transno 8590015958 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34992a2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.465174:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f34992a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x102:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.465183:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:3.0:1787826297.465186:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826297.465190:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826297.465480:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84131:x1874668789563008:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 756us (949us total) trans 8590015958 rc 0/0 00000100:00100000:3.0:1787826297.466060:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110748 00000100:00100000:1.0:1787826297.470844:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.471060:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789563392 00000100:00100000:3.0:1787826297.471074:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789563392 00000100:00100000:3.0:1787826297.471207:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110749 00000100:00100000:3.0:1787826297.471220:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84133:x1874668789563392:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.471331:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826297.471369:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f3499294 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1da expref: 39 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471393:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe16cc5800) 00010000:00010000:3.0:1787826297.471417:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826297.471461:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471475:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471486:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471811:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471820:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471828:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471928:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471936:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471944:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471951:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.471956:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471964:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471974:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826297.471977:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.471980:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.471987:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992a9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.472000:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.472007:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.472012:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.472016:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.472019:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.472025:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.472031:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xc9ae5c7 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826297.472033:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.472036:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.472042:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xc9ae5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.472153:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84133:x1874668789563392:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 934us (1322us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826297.472162:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110749 00000100:00100000:1.0:1787826297.474188:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.477200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.477512:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789563776 00000100:00100000:3.0:1787826297.477523:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789563776 00000100:00100000:3.0:1787826297.477589:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2525 00000100:00100000:3.0:1787826297.477601:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84132:x1874668789563776:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826297.478059:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+40:84132:x1874668789563776:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 457us (866us total) trans 8590015959 rc 0/0 00000100:00100000:3.0:1787826297.478068:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2525 00000100:00100000:3.0:1787826297.482181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.487003:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789564160 00000100:00100000:3.0:1787826297.487012:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789564160 00000100:00100000:3.0:1787826297.487086:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110751 00000100:00100000:3.0:1787826297.487098:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84132:x1874668789564160:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826297.487250:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84132:x1874668789564160:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 153us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.487258:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110751 00000100:00100000:3.0:1787826297.488120:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789564288 00000100:00100000:3.0:1787826297.488126:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789564288 00000100:00100000:3.0:1787826297.488169:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110752 00000100:00100000:3.0:1787826297.488177:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84133:x1874668789564288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.488197:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.488224:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992be lrc: 2/0,0 mode: --/PR res: [0x200000403:0x103:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb1e8 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.488411:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x103:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.488428:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.488450:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.488651:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e8 expref: 43 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.488672:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e8 expref: 42 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.488681:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826297.488684:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826297.488688:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826297.488792:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+42:84133:x1874668789564288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 615us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.488799:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110752 00000100:00100000:3.0:1787826297.491560:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.515713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.525929:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789565824 00000100:00100000:1.0:1787826297.525940:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789565824 00000100:00100000:1.0:1787826297.525998:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110756 00000100:00100000:1.0:1787826297.526007:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84131:x1874668789565824:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826297.526083:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84131:x1874668789565824:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 77us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.526090:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110756 00000100:00100000:3.0:1787826297.535510:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789566080 00000100:00100000:3.0:1787826297.535531:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789566080 00000100:00100000:3.0:1787826297.535623:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110757 00000100:00100000:3.0:1787826297.535636:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+47:84132:x1874668789566080:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.535675:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.535702:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb1fd expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.535787:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.535804:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.535826:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826297.535874:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x101:0x0]: returning size 0 00000004:00200000:3.0:1787826297.535879:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826297.535901:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.535930:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34992f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1fd expref: 50 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.535948:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1fd expref: 49 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.535958:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826297.535960:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826297.535964:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826297.536047:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84132:x1874668789566080:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 414us (4651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.536056:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110757 00000100:00100000:1.0:1787826297.537929:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.549221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.549393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.549430:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789566848 00000100:00100000:1.0:1787826297.549451:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789566848 00010000:00010000:1.0:1787826297.549580:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34992b7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e1 expref: 50 pid: 25759 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.549632:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2852 00000100:00100000:1.0:1787826297.549644:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2401:x1874668789566848:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826297.549664:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826297.549672:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34992b7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e1 expref: 50 pid: 25759 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.549688:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34992b7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e1 expref: 50 pid: 25759 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.549719:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:1.0:1787826297.549726:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499304 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.549738:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499304 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.549748:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499304 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.549772:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826297.551006:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2401:x1874668789566848:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1355us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.551020:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2852 00000100:00100000:1.0:1787826297.551069:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789566720 00000100:00100000:1.0:1787826297.551076:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789566720 00000100:00100000:1.0:1787826297.551130:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6040 00000100:00100000:1.0:1787826297.551138:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2400:x1874668789566720:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826297.551156:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826297.551182:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349930b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb20b expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826297.551210:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826297.552501:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0:0x0].0x0 since=2935s v=(0 0) 00010000:00010000:1.0:1787826297.552509:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826297.552526:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349930b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb20b expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.552558:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349930b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb20b expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.552577:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:1.0:1787826297.552649:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789566720:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1509us (3254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.552659:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6040 00000100:00080000:1.0:1787826297.552714:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826297.561282:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789567104 00000100:00100000:1.0:1787826297.561296:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789567104 00000100:00100000:1.0:1787826297.561369:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110759 00000100:00100000:1.0:1787826297.561382:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84133:x1874668789567104:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826297.561540:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84133:x1874668789567104:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 160us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.561549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110759 00000100:00100000:1.0:1787826297.581234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.581285:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.581389:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789567616 00000100:00100000:3.0:1787826297.581394:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789567616 00000100:00100000:3.0:1787826297.581460:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2531 00000100:00100000:3.0:1787826297.581473:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84131:x1874668789567616:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826297.582714:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84131:x1874668789567616:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1238us (1489us total) trans 8590015966 rc 0/0 00000100:00100000:3.0:1787826297.582726:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2531 00000100:00100000:1.0:1787826297.585340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.585542:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789567872 00000100:00100000:3.0:1787826297.585556:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789567872 00000100:00100000:3.0:1787826297.585633:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110761 00000100:00100000:3.0:1787826297.585644:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84133:x1874668789567872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.585674:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.585712:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499319 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb212 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.585892:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x103:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.585911:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795200/0x68019081f34992e8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1f6 expref: 50 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.585921:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.585968:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795200/0x68019081f34992e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1f6 expref: 50 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.585985:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795200/0x68019081f34992e8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1f6 expref: 50 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.586003:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafc000 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778585216:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826297.586128:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826297.586927:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.591667:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafc000 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778585216:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826297.591705:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.592035:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778585344:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826297.592201:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f3499327 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb219 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.592355:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41795a00, rc 0) 00000100:00100000:1.0:1787826297.592448:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84132:x1874668789568000:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5364us (5514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.592459:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6041 00010000:00010000:1.0:1787826297.594578:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.594588:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826297.594611:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x103:0x0]: returning size 0 00000004:00080000:1.0:1787826297.595499:0:45682:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb1:0x0], index 1: 0 00010000:00010000:1.0:1787826297.595642:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.595652:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.595660:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.595667:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826297.595672:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.595681:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.595695:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:1.0:1787826297.595698:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826297.595704:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.595711:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499320 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.595775:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499319 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb212 expref: 50 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.595796:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826297.595799:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826297.595805:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499319 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb212 expref: 50 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.595814:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:1.0:1787826297.595878:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84133:x1874668789567872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 10235us (10565us total) trans 8590015967 rc 301/301 00000100:00100000:1.0:1787826297.596013:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110761 00000100:00100000:1.0:1787826297.601084:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778585472:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826297.601118:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826297.601193:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2399:x1874668789568384:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 6831us (9493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.601207:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2854 00000100:00100000:1.0:1787826297.613413:0:45401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789568512 00000100:00100000:1.0:1787826297.613432:0:45401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789568512 00002000:00100000:1.0:1787826297.613584:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xb0:0x0] (0->157) req@ffff9bbf41276d00 x1874668789568512/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:653/0 lens 648/0 e 0 to 0 dl 1787826308 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826297.613600:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf41276d00 with x1874668789568512 ext(0->157) 00002000:00010000:1.0:1787826297.613608:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf41276d00 00000100:00100000:1.0:1787826297.613686:0:45401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1537 00000100:00100000:1.0:1787826297.613699:0:45401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789568512:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826297.614995:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789568768 00000100:00100000:1.0:1787826297.615003:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789568768 00000100:00100000:1.0:1787826297.615050:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2532 00000100:00100000:1.0:1787826297.615362:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84133:x1874668789568768:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826297.615818:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84133:x1874668789568768:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 758us (1131us total) trans 8590015968 rc 0/0 00000100:00100000:1.0:1787826297.615827:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2532 00000100:00100000:3.0:1787826297.635475:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.636902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.636943:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789569408 00000100:00100000:3.0:1787826297.636955:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789569408 00000100:00100000:3.0:1787826297.637023:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6043 00000100:00100000:3.0:1787826297.637036:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789569408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.637061:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.637088:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb26d expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826297.637120:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826297.637144:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=2935s v=(0 0) 00010000:00010000:3.0:1787826297.637150:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826297.637161:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb26d expref: 12 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.637183:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb26d expref: 12 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.637199:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826297.637267:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789569408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 233us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.637276:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6043 00000001:00080000:1.0:1787826297.641787:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590015968 is committed 00000001:00080000:1.0:1787826297.642052:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590015950 is committed 00000020:00080000:1.0:1787826297.642075:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbf404379c0 refcount 2 committed 0 result 0 batchid 4294970852 00000020:00080000:1.0:1787826297.642082:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe070fd400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf404376c0 00000020:00080000:1.0:1787826297.642086:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe070fd900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0df4ae00 00000020:00080000:1.0:1787826297.642114:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0ff793c0 refcount 2 committed 0 result 0 batchid 4294970851 00000020:00080000:1.0:1787826297.642117:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf41680400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0ff799c0 00000020:00080000:1.0:1787826297.642121:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf40505600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe10bade00 00000020:00080000:1.0:1787826297.642141:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe15babd80 refcount 2 committed 0 result 0 batchid 4294970850 00000020:00080000:1.0:1787826297.642144:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417caa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d56b40 00000020:00080000:1.0:1787826297.642147:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417ca600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf3fd9c000 00000020:00080000:1.0:1787826297.642162:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0ff796c0 refcount 2 committed 0 result 0 batchid 4294970849 00000020:00080000:1.0:1787826297.642165:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf40505b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0ff79180 00000020:00080000:1.0:1787826297.642168:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf40505e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe10badc00 00000020:00080000:1.0:1787826297.642190:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0fd096c0 refcount 2 committed 0 result 0 batchid 4294970848 00000020:00080000:1.0:1787826297.642193:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0fd09480 00000020:00080000:1.0:1787826297.642196:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0ddb4a00 00000020:00080000:1.0:1787826297.642212:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0ff71a80 refcount 2 committed 0 result 0 batchid 4294970847 00000020:00080000:1.0:1787826297.642215:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe06e03b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16292780 00000020:00080000:1.0:1787826297.642218:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe06e03e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe10bad200 00000020:00080000:1.0:1787826297.642235:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe15bad540 refcount 2 committed 0 result 0 batchid 4294970846 00000020:00080000:1.0:1787826297.642238:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe15bad300 00000020:00080000:1.0:1787826297.642241:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c6d4400 00000020:00080000:1.0:1787826297.642255:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0c1b4000 refcount 2 committed 0 result 0 batchid 4294970845 00000020:00080000:1.0:1787826297.642259:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf41680200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c1b40c0 00000020:00080000:1.0:1787826297.642262:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf41680000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a172a00 00000020:00080000:1.0:1787826297.642280:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0ff71d80 refcount 2 committed 0 result 0 batchid 4294970844 00000020:00080000:1.0:1787826297.642283:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf03ed4200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0ff71900 00000020:00080000:1.0:1787826297.642286:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf03ed4800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0ad4ac00 00000020:00080000:1.0:1787826297.642301:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0fd09c00 refcount 2 committed 0 result 0 batchid 4294970843 00000020:00080000:1.0:1787826297.642304:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0fd099c0 00000020:00080000:1.0:1787826297.642307:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf3fc53a00 00000020:00080000:1.0:1787826297.642329:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0fd09540 refcount 2 committed 0 result 0 batchid 4294970842 00000020:00080000:1.0:1787826297.642333:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09d78c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0fd09600 00000020:00080000:1.0:1787826297.642336:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09d78e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe134ca400 00000020:00080000:1.0:1787826297.642356:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0fd09840 refcount 2 committed 0 result 0 batchid 4294970841 00000020:00080000:1.0:1787826297.642359:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bc28100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0fd09d80 00000020:00080000:1.0:1787826297.642361:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf02c3e200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16540600 00000020:00080000:1.0:1787826297.642376:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe188b7c00 refcount 2 committed 0 result 0 batchid 4294970840 00000020:00080000:1.0:1787826297.642379:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf41680a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe188b7e40 00000020:00080000:1.0:1787826297.642382:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf41680600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe10217200 00000004:00080000:1.0:1787826297.642397:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 24 committed 00000020:00080000:1.0:1787826297.642417:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe13482b40 refcount 2 committed 0 result 0 batchid 4294970839 00000020:00080000:1.0:1787826297.642420:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf02fb4800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe13482f00 00000020:00080000:1.0:1787826297.642423:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf02fb4500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d27e200 00000004:00080000:1.0:1787826297.642447:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 27 committed 00000020:00080000:1.0:1787826297.642462:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe188b73c0 refcount 2 committed 0 result 0 batchid 4294970838 00000020:00080000:1.0:1787826297.642465:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf05e2b900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe188b7f00 00000020:00080000:1.0:1787826297.642468:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf05e2bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a173800 00000020:00080000:1.0:1787826297.642485:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe188b7cc0 refcount 2 committed 0 result 0 batchid 4294970837 00000020:00080000:3.0:1787826297.642583:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970801 00000020:00080000:1.0:1787826297.644190:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf05e2ba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe188b7b40 00000020:00080000:1.0:1787826297.644195:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf05e2b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16864e00 00000020:00080000:1.0:1787826297.644226:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0c17e840 refcount 2 committed 0 result 0 batchid 4294970836 00000020:00080000:1.0:1787826297.644230:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf03ed4700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16cae240 00000020:00080000:1.0:1787826297.644233:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf03ed4b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe10216400 00000020:00080000:1.0:1787826297.644251:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe188b70c0 refcount 2 committed 0 result 0 batchid 4294970835 00000020:00080000:1.0:1787826297.644254:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3d6c3200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe188b7480 00000020:00080000:1.0:1787826297.644256:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3d6c3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16865200 00000020:00080000:1.0:1787826297.644273:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe16cae300 refcount 2 committed 0 result 0 batchid 4294970834 00000020:00080000:1.0:1787826297.644277:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf02fb4200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16cae480 00000020:00080000:1.0:1787826297.644280:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf02fb4b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe10217e00 00000020:00080000:1.0:1787826297.644296:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17ee2240 refcount 2 committed 0 result 0 batchid 4294970833 00000020:00080000:1.0:1787826297.644299:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf03ed4400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17ee2a80 00000020:00080000:1.0:1787826297.644302:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf03ed4600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0ad7a600 00000020:00080000:1.0:1787826297.644319:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17ee2480 refcount 2 committed 0 result 0 batchid 4294970832 00000020:00080000:1.0:1787826297.644322:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf03ed4e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17ee2840 00000020:00080000:1.0:1787826297.644326:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf03ed4a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f520a00 00000020:00080000:1.0:1787826297.644342:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0a16ba80 refcount 2 committed 0 result 0 batchid 4294970831 00000020:00080000:1.0:1787826297.644345:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a16b240 00000020:00080000:1.0:1787826297.644348:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c7c6a00 00000020:00080000:1.0:1787826297.644366:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0c66d6c0 refcount 2 committed 0 result 0 batchid 4294970830 00000020:00080000:1.0:1787826297.644369:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c66dcc0 00000020:00080000:1.0:1787826297.644372:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe16055700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf27fa0c00 00000020:00080000:1.0:1787826297.644388:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe15bab480 refcount 2 committed 0 result 0 batchid 4294970829 00000020:00080000:1.0:1787826297.644392:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe16055800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe10ad8540 00000020:00080000:1.0:1787826297.644395:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe16055000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f520400 00000020:00080000:1.0:1787826297.644410:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17ae19c0 refcount 2 committed 0 result 0 batchid 4294970828 00000020:00080000:1.0:1787826297.644413:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf02fb4400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17ae1780 00000020:00080000:1.0:1787826297.644416:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf02fb4a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe1026b200 00000020:00080000:1.0:1787826297.644428:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970826 batchid updated 00000020:00080000:1.0:1787826297.644450:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0c17eb40 refcount 2 committed 0 result 0 batchid 4294970827 00000020:00080000:1.0:1787826297.644453:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf10ba7f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c17ecc0 00000020:00080000:1.0:1787826297.644456:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf10ba7500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe15bed000 00000100:00100000:1.0:1787826297.646283:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1607b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778585728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787826297.646379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826297.646449:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778586240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787826297.646475:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787826297.650101:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe083ff480/2, rc 0, transno 4294968093 00000100:00100000:1.0:1787826297.650258:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778586240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787826297.650278:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778586752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826297.650324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826297.650345:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778587264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826297.650383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787826297.650427:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe1607b480/2, rc 0, transno 4294968092 00000100:00100000:1.0:1787826297.650446:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1607b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778585728:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1787826297.650496:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970852 committed batchid 4294970826 00000020:00080000:1.0:1787826297.650642:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970826 00000100:00100000:1.0:1787826297.650668:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6052 00000100:00100000:1.0:1787826297.650682:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3644:x1874668778587008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826297.650704:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:162 count 1 00002000:00010000:1.0:1787826297.650729:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 158, mtime: 0x6a90102a, atime: 0x0, ctime: 0x6a90102a, blocks: 0x8 00010000:00010000:1.0:1787826297.651889:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e99be72/0x68019081f34993ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.651906:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=2935s v=(0 0) 00010000:00010000:1.0:1787826297.651910:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826297.651916:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e99be72/0x68019081f34993ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.651929:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e99be72/0x68019081f34993ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.651945:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e99be72/0x68019081f34993ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.651953:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e99be72/0x68019081f34993ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.651965:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00000100:00100000:1.0:1787826297.652071:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3644:x1874668778587008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1394us (3780us total) trans 4294968112 rc 0/0 00000100:00100000:1.0:1787826297.652081:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6052 00000100:00100000:1.0:1787826297.652108:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6057 00000100:00100000:1.0:1787826297.653072:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3646:x1874668778587392:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787826297.653076:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e99be72/0x68019081f34993ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.653097:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826297.653099:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826297.653101:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787826297.653106:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:165 count 1 00010000:00010000:2.0:1787826297.653113:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826297.653120:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826297.653130:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826297.653136:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826297.653659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00002000:00010000:1.0:1787826297.653971:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa5:0x0] initial LVB size: 158, mtime: 0x6a90102b, atime: 0x0, ctime: 0x6a90102b, blocks: 0x8 00010000:00010000:1.0:1787826297.653983:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34993cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.653999:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5:0x0].0x0 since=2935s v=(0 0) 00000100:00100000:3.0:1787826297.654189:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826297.654334:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826297.654344:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34993cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.654360:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34993cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.654378:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34993cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.654388:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34993cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.654416:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826297.654633:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3646:x1874668778587392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1573us (6150us total) trans 4294968113 rc 0/0 00000100:00100000:1.0:1787826297.654645:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6057 00000100:00100000:1.0:1787826297.654667:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6058 00000100:00100000:1.0:1787826297.654677:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3645:x1874668778586752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826297.654695:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:160 count 1 00002000:00010000:1.0:1787826297.654719:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa0:0x0] initial LVB size: 158, mtime: 0x6a90102a, atime: 0x0, ctime: 0x6a90102a, blocks: 0x8 00010000:00010000:1.0:1787826297.654727:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.655098:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0:0x0].0x0 since=2935s v=(0 0) 00010000:00010000:1.0:1787826297.655103:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826297.655108:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.655251:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.655265:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.655272:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.655289:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1787826297.655374:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3645:x1874668778586752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 697us (5048us total) trans 4294968115 rc 0/0 00000100:00100000:1.0:1787826297.655386:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6058 00010000:00010000:1.0:1787826297.655995:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826297.656003:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.656026:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826297.656034:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.656046:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.656062:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.656081:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f34993d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.656101:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826297.656105:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826297.656108:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826297.656352:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826297.656368:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778587648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826297.656496:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826297.656558:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778587648 00000100:00100000:1.0:1787826297.656566:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778587648 00000100:00100000:1.0:1787826297.656607:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6060 00000100:00100000:1.0:1787826297.656616:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3643:x1874668778587648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826297.656639:0:8433:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:167 count 1 00002000:00010000:1.0:1787826297.656669:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa7:0x0] initial LVB size: 158, mtime: 0x6a90102c, atime: 0x0, ctime: 0x6a90102c, blocks: 0x8 00010000:00010000:1.0:1787826297.656677:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f34993e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.656688:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa7:0x0].0x0 since=2935s v=(0 0) 00010000:00010000:1.0:1787826297.656693:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826297.656699:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f34993e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.656716:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f34993e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.656725:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f34993e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.656796:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778587776 00000100:00100000:3.0:1787826297.656802:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778587776 00010000:00010000:1.0:1787826297.656875:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f34993e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.656890:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826297.656943:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6061 00000100:00100000:3.0:1787826297.656956:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3645:x1874668778587776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826297.656970:0:45681:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:168 count 1 00002000:00010000:3.0:1787826297.656991:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa8:0x0] initial LVB size: 158, mtime: 0x6a90102c, atime: 0x0, ctime: 0x6a90102c, blocks: 0x8 00010000:00010000:3.0:1787826297.656997:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.657008:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa8:0x0].0x0 since=2935s v=(0 0) 00010000:00010000:3.0:1787826297.657012:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826297.657017:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.657021:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3643:x1874668778587648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 403us (523us total) trans 4294968116 rc 0/0 00000100:00100000:1.0:1787826297.657036:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6060 00010000:00010000:3.0:1787826297.657038:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.657049:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.657057:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.657067:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778587904 00000100:00100000:1.0:1787826297.657072:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778587904 00000100:00100000:1.0:1787826297.657101:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6062 00000100:00100000:1.0:1787826297.657177:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3645:x1874668778587904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826297.657247:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:168 count 1 00002000:00010000:1.0:1787826297.657268:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa8:0x0] initial LVB size: 158, mtime: 0x6a90102c, atime: 0x0, ctime: 0x6a90102c, blocks: 0x8 00010000:00010000:1.0:1787826297.657277:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f34993f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657288:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa8:0x0].0x0 since=2935s v=(0 0) 00010000:00010000:1.0:1787826297.657296:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826297.657304:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f34993f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657326:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f34993f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657348:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f34993f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657371:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f34993f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657389:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787826297.657489:0:45681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1787826297.657552:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3645:x1874668778587904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 441us (501us total) trans 4294968101 rc 0/0 00000100:00100000:1.0:1787826297.657569:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6062 00000100:00100000:3.0:1787826297.657586:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3645:x1874668778587776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 633us (883us total) trans 4294968117 rc 0/0 00010000:00010000:1.0:1787826297.657591:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826297.657600:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e22f34f/0x68019081f34993f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.657601:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6061 00010000:00010000:1.0:1787826297.657612:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826297.657618:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e22f34f/0x68019081f34993f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657637:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e22f34f/0x68019081f34993f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657657:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e22f34f/0x68019081f34993f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657681:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e22f34f/0x68019081f34993f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657700:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826297.657708:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657716:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826297.657720:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657733:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657886:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657894:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f34993eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.657914:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826297.657916:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826297.657919:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826297.658944:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826297.659597:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826297.659613:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826297.660699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.660756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.660845:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789570048 00000100:00100000:2.0:1787826297.660878:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789570048 00000100:00100000:2.0:1787826297.661014:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789570176 00000100:00100000:2.0:1787826297.661018:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789570176 00000100:00100000:2.0:1787826297.661048:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6064 00000100:00100000:3.0:1787826297.661115:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6065 00000100:00100000:3.0:1787826297.661127:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:84133:x1874668789570176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.661152:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.661176:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb27b expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.661215:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb26d expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.661237:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826297.661243:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826297.661250:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.661295:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb26d expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.661312:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb26d expref: 13 pid: 8605 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.661563:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:84131:x1874668789570048:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826297.661576:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826297.661591:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb274 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.661613:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f3499343 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb227 expref: 13 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.661621:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826297.661624:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826297.661628:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.661656:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f3499343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb227 expref: 13 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.661666:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f3499343 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb227 expref: 13 pid: 19335 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.661682:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41275a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778588288:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826297.661764:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778588160:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826297.661788:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826297.661801:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826297.662247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.662333:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789570304 00000100:00100000:3.0:1787826297.662339:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789570304 00000100:00100000:3.0:1787826297.662389:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6066 00000100:00100000:3.0:1787826297.662398:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789570304:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787826297.665029:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778588160:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826297.665082:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.665114:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:3.0:1787826297.665189:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84133:x1874668789570176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4065us (4432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.665201:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6065 00000100:00100000:2.0:1787826297.666824:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41275a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778588288:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826297.667482:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.667586:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826297.667699:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84131:x1874668789570048:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 6638us (7010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.667732:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6064 00000001:00080000:3.0:1787826297.669262:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968101 is committed 00000001:00080000:3.0:1787826297.669291:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968091 is committed 00000100:00100000:1.0:1787826297.669626:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789570304:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 7220us (7371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.669641:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6066 00000100:00100000:2.0:1787826297.672649:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.672718:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.672971:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789570432 00000100:00100000:2.0:1787826297.672983:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789570432 00000100:00100000:3.0:1787826297.673016:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789570560 00000100:00100000:3.0:1787826297.673020:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789570560 00010000:00010000:2.0:1787826297.673036:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb26d expref: 11 pid: 8605 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.673043:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f3499343 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb227 expref: 13 pid: 19335 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.674199:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2855 00000100:00100000:3.0:1787826297.674221:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789570432:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826297.674388:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826297.674423:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb26d expref: 11 pid: 8605 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.674459:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb26d expref: 11 pid: 8605 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.674490:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f3499358 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb26d expref: 11 pid: 8605 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.674514:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826297.674519:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826297.674530:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 10 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.674543:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 10 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.674593:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 10 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.674610:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778588416:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826297.674738:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826297.674771:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2856 00000100:00100000:3.0:1787826297.676154:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf12439450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789570560:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826297.676180:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826297.676213:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f3499343 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb227 expref: 13 pid: 19335 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.676233:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f3499343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb227 expref: 13 pid: 19335 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.676260:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f3499343 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb227 expref: 13 pid: 19335 timeout: 3035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.676277:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826297.676282:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826297.676292:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.676303:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.676344:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.676360:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0330c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778588544:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826297.676716:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826297.678110:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.678430:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789570816 00000100:00100000:3.0:1787826297.678452:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789570816 00000100:00100000:3.0:1787826297.678709:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110767 00000100:00100000:3.0:1787826297.678724:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84132:x1874668789570816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.678840:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826297.679045:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f34992fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x101:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1fd expref: 31 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.679073:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826297.679080:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826297.679122:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.679151:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.679162:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826297.679368:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f455cc27 reply state 000000009cb1f93c transno 8590015969 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.679383:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.679390:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826297.679393:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826297.679395:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826297.679736:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84132:x1874668789570816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1014us (1683us total) trans 8590015969 rc 0/0 00000100:00100000:3.0:1787826297.679745:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110767 00000100:00100000:3.0:1787826297.686941:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778588416:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826297.686982:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826297.687225:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789570432:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 13005us (14583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.687239:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2855 00000100:00100000:2.0:1787826297.687712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.687814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.687896:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789570944 00000100:00100000:1.0:1787826297.687908:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789570944 00002000:00100000:1.0:1787826297.687963:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xb1:0x0] (0->157) req@ffff9bbf41275680 x1874668789570944/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:653/0 lens 648/0 e 0 to 0 dl 1787826308 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826297.687977:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf41275680 with x1874668789570944 ext(0->157) 00002000:00010000:1.0:1787826297.687985:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf41275680 00000100:00100000:1.0:1787826297.688009:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789571072 00000100:00100000:1.0:1787826297.688012:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789571072 00002000:00100000:1.0:1787826297.688032:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xb0:0x0] (0->157) req@ffff9bbf41277480 x1874668789571072/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:653/0 lens 648/0 e 0 to 0 dl 1787826308 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826297.688040:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf41277480 with x1874668789571072 ext(0->157) 00002000:00010000:1.0:1787826297.688043:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf41277480 00000100:00100000:1.0:1787826297.688065:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1538 00000100:00100000:1.0:1787826297.688076:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41275680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789570944:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787826297.688231:0:45397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1539 00000100:00100000:3.0:1787826297.688243:0:45397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41277480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789571072:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787826297.691293:0:45397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41277480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789571072:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 3038us (3463us total) trans 4294968118 rc 0/0 00000100:00100000:1.0:1787826297.691314:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41275680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789570944:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 3236us (3600us total) trans 4294968102 rc 0/0 00000100:00100000:3.0:1787826297.691314:0:45397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1539 00000100:00100000:1.0:1787826297.691328:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1538 00002000:00100000:3.0:1787826297.691334:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xb0:0x0] (0->157) req@ffff9bbf41277480 x1874668789571072/t4294968118(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:653/0 lens 648/448 e 0 to 0 dl 1787826308 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826297.691338:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xb1:0x0] (0->157) req@ffff9bbf41275680 x1874668789570944/t4294968102(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:653/0 lens 648/448 e 0 to 0 dl 1787826308 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826297.691370:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf41275680 with x1874668789570944 ext(0->157) 00002000:00100000:3.0:1787826297.691371:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf41277480 with x1874668789571072 ext(0->157) 00002000:00010000:3.0:1787826297.691382:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf41277480 00002000:00010000:1.0:1787826297.691383:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf41275680 00000100:00100000:2.0:1787826297.692407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.692550:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0330c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778588544:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826297.692582:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826297.692634:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf12439450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789570560:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 17855us (19916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.692646:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2856 00000100:00100000:3.0:1787826297.695297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789571200 00000100:00100000:3.0:1787826297.695315:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789571200 00000100:00100000:3.0:1787826297.696055:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789571328 00000100:00100000:3.0:1787826297.696060:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789571328 00000100:00100000:3.0:1787826297.696098:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789571456 00000100:00100000:3.0:1787826297.696102:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789571456 00000100:00100000:3.0:1787826297.696129:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110768 00000100:00100000:3.0:1787826297.696141:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84132:x1874668789571200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.696173:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.696200:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499415 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb282 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.696278:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499415 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb282 expref: 35 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.696298:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499415 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb282 expref: 35 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.696321:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826297.696327:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826297.696331:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826297.696402:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84132:x1874668789571200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 265us (4002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.696410:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110768 00000100:00100000:3.0:1787826297.696432:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110769 00000100:00100000:3.0:1787826297.696451:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84131:x1874668789571328:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826297.696615:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84131:x1874668789571328:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 165us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.696622:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110769 00000100:00100000:3.0:1787826297.696638:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110770 00000100:00100000:3.0:1787826297.696645:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84133:x1874668789571456:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826297.696697:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84133:x1874668789571456:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 52us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.696703:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110770 00000100:00100000:1.0:1787826297.706259:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.706316:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.706501:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789571584 00000100:00100000:2.0:1787826297.706514:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789571584 00000100:00100000:2.0:1787826297.706583:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789571712 00000100:00100000:2.0:1787826297.706586:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789571712 00000100:00100000:2.0:1787826297.706617:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6067 00000100:00100000:2.0:1787826297.706628:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789571584:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826297.706712:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6068 00000100:00100000:2.0:1787826297.706721:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789571712:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826297.712008:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789571712:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 5281us (5684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.712021:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6068 00000100:00100000:2.0:1787826297.712058:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789571840 00000100:00100000:2.0:1787826297.712068:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789571840 00000100:00100000:2.0:1787826297.712113:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6069 00000100:00100000:2.0:1787826297.712123:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789571840:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826297.712333:0:25038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb0:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826297.712337:0:25038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb0:0x0] updating lvb mtime from disk: 0 -> 1787826215 00002000:00010000:2.0:1787826297.712340:0:25038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb0:0x0] updating lvb atime from disk: 0 -> 1787826215 00002000:00010000:2.0:1787826297.712343:0:25038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb0:0x0] updating lvb ctime from disk: 0 -> 1787826215 00002000:00010000:2.0:1787826297.712346:0:25038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb0:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826297.712376:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789571840:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 254us (1184us total) trans 4294968103 rc 0/0 00000100:00100000:2.0:1787826297.712384:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6069 00000001:00080000:1.0:1787826297.715066:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968102 is committed 00000100:00100000:2.0:1787826297.715615:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789571584:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 8975us (9356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.715631:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6067 00000100:00100000:3.0:1787826297.717564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.718765:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789572096 00000100:00100000:1.0:1787826297.718781:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789572096 00000100:00100000:1.0:1787826297.718894:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110771 00000100:00100000:1.0:1787826297.718907:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84132:x1874668789572096:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826297.718999:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.719022:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1be expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.719033:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 4/0,1 mode: --/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.719079:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1be expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.719095:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1be expref: 33 pid: 25756 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.719115:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa97840 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778588672:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826297.719236:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37600 going to sleep for 11 seconds 00010000:00010000:2.0:1787826297.728705:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826297.728801:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.729000:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.729038:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.729077:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789572352 00000100:00100000:2.0:1787826297.729088:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789572352 00000100:00100000:2.0:1787826297.729154:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789572736 00000100:00100000:2.0:1787826297.729158:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789572736 00000100:00100000:2.0:1787826297.729186:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110772 00000100:00100000:2.0:1787826297.729198:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84131:x1874668789572352:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826297.729277:0:7736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826297.729313:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349933c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x102:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb220 expref: 35 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.729338:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:2.0:1787826297.729346:0:7736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826297.729387:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.729404:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.729416:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.729978:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110773 00000100:00100000:3.0:1787826297.729994:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84133:x1874668789572736:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.730028:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826297.730047:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499351 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x103:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb22e expref: 34 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.730062:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826297.730067:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826297.730089:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.730099:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.730107:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826297.730214:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056b1b4d2 reply state 00000000e78b5690 transno 8590015970 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.730229:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.730235:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826297.730238:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826297.730241:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826297.730403:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84133:x1874668789572736:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 413us (1362us total) trans 8590015970 rc 0/0 00000100:00100000:3.0:1787826297.730411:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110773 00000004:00010000:2.0:1787826297.731040:0:7736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f23c0090 reply state 0000000079f369d5 transno 8590015971 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731057:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731066:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:2.0:1787826297.731069:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826297.731072:0:7736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826297.731106:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa97840 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778588672:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826297.731141:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84131:x1874668789572352:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1944us (2348us total) trans 8590015971 rc 0/0 00000100:00100000:2.0:1787826297.731149:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110772 00000100:00100000:2.0:1787826297.731183:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789572480 00000100:00100000:2.0:1787826297.731190:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789572480 00010000:00010000:1.0:1787826297.731200:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731218:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1be expref: 36 pid: 25756 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.731256:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2857 00000100:00100000:2.0:1787826297.731266:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789572480:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826297.731282:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826297.731290:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1be expref: 36 pid: 25756 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731303:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1be expref: 36 pid: 25756 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731322:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499247 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x101:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1be expref: 36 pid: 25756 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731335:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:2.0:1787826297.731340:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731351:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731358:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731383:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826297.731407:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2401:x1874668789572480:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 143us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.731414:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2857 00010000:00010000:2.0:1787826297.731463:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731471:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731498:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731506:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731514:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731520:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826297.731525:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731535:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731546:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:2.0:1787826297.731548:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826297.731552:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.731558:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349941c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x101:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.731595:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84132:x1874668789572096:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 12691us (14044us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826297.731604:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110771 00000100:00100000:3.0:1787826297.739886:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.742980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.743026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.743076:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789572992 00000100:00100000:3.0:1787826297.743087:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789572992 00000100:00100000:3.0:1787826297.743145:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789573120 00000100:00100000:3.0:1787826297.743148:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789573120 00000100:00100000:3.0:1787826297.743171:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110774 00000100:00100000:3.0:1787826297.743182:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84133:x1874668789572992:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.743210:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.743237:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499431 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x103:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb289 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.743313:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499431 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb289 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.743331:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499431 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb289 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.743353:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826297.743356:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826297.743361:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826297.743447:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84133:x1874668789572992:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 254us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.743455:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110774 00000100:00100000:3.0:1787826297.743477:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110775 00000100:00100000:3.0:1787826297.743484:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84131:x1874668789573120:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.743495:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.743505:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x102:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb290 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.743530:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb290 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.743552:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb290 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.743570:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:3.0:1787826297.743573:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826297.743576:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607e00, rc 0) 00000100:00100000:3.0:1787826297.743600:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84131:x1874668789573120:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 116us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.743606:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110775 00000100:00100000:1.0:1787826297.745623:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789572864 00000100:00100000:1.0:1787826297.745642:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789572864 00000100:00100000:1.0:1787826297.745786:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6070 00000100:00100000:1.0:1787826297.745800:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789572864:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826297.745873:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.745897:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f3499327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb219 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.745908:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826297.745912:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826297.745918:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.745963:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f3499327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb219 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.745980:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f3499327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb219 expref: 11 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.745998:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa97840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778588800:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826297.746109:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37600 going to sleep for 11 seconds 00000040:00080000:2.0:1787826297.751145:0:54802:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826297.751159:0:54802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826297.751745:0:54802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826297.751758:0:54802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:2.0:1787826297.752082:0:54802:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826297.752087:0:54802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826297.752469:0:54802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826297.752477:0:54802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:2.0:1787826297.752611:0:54802:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826297.752614:0:54802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826297.753301:0:54802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826297.753310:0:54802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:2.0:1787826297.753519:0:54802:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826297.753523:0:54802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826297.754799:0:54802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826297.754814:0:54802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1787826297.765143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.765180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.765241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.765485:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789573248 00000100:00100000:2.0:1787826297.765498:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789573248 00000100:00100000:2.0:1787826297.765564:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789573376 00000100:00100000:2.0:1787826297.765567:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789573376 00000100:00100000:2.0:1787826297.765594:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6071 00000100:00100000:2.0:1787826297.765605:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789573248:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826297.765813:0:25038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb0:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826297.765817:0:25038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb0:0x0] updating lvb mtime from disk: 0 -> 1787826215 00002000:00010000:2.0:1787826297.765819:0:25038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb0:0x0] updating lvb atime from disk: 0 -> 1787826215 00002000:00010000:2.0:1787826297.765821:0:25038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb0:0x0] updating lvb ctime from disk: 0 -> 1787826215 00002000:00010000:2.0:1787826297.765823:0:25038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb0:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826297.765926:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789573248:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 321us (794us total) trans 4294968119 rc 0/0 00000100:00100000:2.0:1787826297.765935:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6071 00000100:00100000:2.0:1787826297.765957:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6072 00000100:00100000:2.0:1787826297.765964:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789573376:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826297.766052:0:25038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb1:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826297.766055:0:25038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb1:0x0] updating lvb mtime from disk: 0 -> 1787826215 00002000:00010000:2.0:1787826297.766057:0:25038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb1:0x0] updating lvb atime from disk: 0 -> 1787826215 00002000:00010000:2.0:1787826297.766059:0:25038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb1:0x0] updating lvb ctime from disk: 0 -> 1787826215 00002000:00010000:2.0:1787826297.766062:0:25038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb1:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826297.766087:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789573376:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 124us (906us total) trans 4294968104 rc 0/0 00000100:00100000:2.0:1787826297.766095:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6072 00000100:00100000:2.0:1787826297.766120:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789573504 00000100:00100000:2.0:1787826297.766125:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789573504 00010000:00010000:2.0:1787826297.766149:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f3499327 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb219 expref: 13 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.766183:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2858 00000100:00100000:2.0:1787826297.766190:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789573504:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826297.766202:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826297.766213:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f3499327 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb219 expref: 13 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.766229:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f3499327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb219 expref: 13 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.766260:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826297.766265:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826297.766272:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.766288:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.766312:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826297.766344:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789573504:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 154us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.766351:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2858 00010000:00010000:1.0:1787826297.766718:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f3499327 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb219 expref: 12 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.766736:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa97840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778588800:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826297.766759:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.766772:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.766781:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.766804:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.766814:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.766823:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.766960:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826297.766966:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.766976:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.766993:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.767002:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349943f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.767063:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789572864:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 21267us (27221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.767072:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6070 00000100:00100000:2.0:1787826297.772326:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789573760 00000100:00100000:2.0:1787826297.772339:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789573760 00000100:00100000:2.0:1787826297.772420:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110776 00000100:00100000:2.0:1787826297.772447:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84132:x1874668789573760:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826297.772644:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.772668:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.772681:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.773145:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.773158:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499415 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb282 expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.773168:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.773213:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499415 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb282 expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.773229:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499415 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb282 expref: 37 pid: 23845 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.773246:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778588928:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826297.773356:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826297.780671:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.780718:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.780768:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789574016 00000100:00100000:3.0:1787826297.780779:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789574016 00000100:00100000:3.0:1787826297.780849:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789574272 00000100:00100000:3.0:1787826297.780873:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789574272 00000100:00100000:3.0:1787826297.780902:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110777 00000100:00100000:3.0:1787826297.780913:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84131:x1874668789574016:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.780995:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.781016:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1d3 expref: 39 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.781027:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.781069:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1d3 expref: 39 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.781083:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1d3 expref: 39 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.781100:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b9680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778589056:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826297.781201:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826297.781224:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110778 00000100:00100000:3.0:1787826297.781233:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84133:x1874668789574272:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.781261:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.781272:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e8 expref: 39 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.781279:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.781296:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e8 expref: 39 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.781305:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e8 expref: 39 pid: 7736 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.781329:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778589184:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826297.781365:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826297.784794:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778588928:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826297.784830:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.784995:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b9680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778589056:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826297.785012:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.785167:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778589184:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826297.785183:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.791013:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2860 00000100:00100000:3.0:1787826297.791037:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+42:2402:x1874668789574656:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826297.791057:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826297.791069:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e8 expref: 42 pid: 7736 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.791085:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e8 expref: 42 pid: 7736 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.791107:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f34992c5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x103:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1e8 expref: 42 pid: 7736 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.791122:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826297.791133:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.791155:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.791176:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.791223:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826297.791304:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789574656:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 276us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.794616:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2861 00000100:00100000:1.0:1787826297.794639:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789574528:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826297.794667:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826297.794682:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1d3 expref: 40 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.794702:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1d3 expref: 40 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.794743:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499286 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x102:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb1d3 expref: 40 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.794763:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:1.0:1787826297.794769:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.794787:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.794801:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.794832:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826297.794897:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789574528:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 269us (5462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.794905:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2861 00010000:00010000:1.0:1787826297.794978:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.794988:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.795049:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.795058:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.795065:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.795072:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826297.795077:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.795086:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.795096:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:1.0:1787826297.795100:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826297.795104:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.795111:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499454 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.795160:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84131:x1874668789574016:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 14249us (14505us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826297.795170:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110777 00000100:00100000:3.0:1787826297.795558:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2860 00010000:00010000:2.0:1787826297.796299:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.796311:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.796360:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.796368:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.796374:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.796381:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826297.796386:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.796394:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.796409:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:2.0:1787826297.796412:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826297.796416:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.796423:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349945b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.796506:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84133:x1874668789574272:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 15272us (15785us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826297.796515:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110778 00000001:00080000:3.0:1787826297.799743:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015973 00000001:00080000:3.0:1787826297.800078:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015974 00000100:00100000:3.0:1787826297.800214:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778589312:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1787826297.800303:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826297.800350:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826297.800365:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778589312 00000100:00100000:1.0:1787826297.800374:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778589312 00000100:00100000:1.0:1787826297.800493:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3245 00000100:00100000:1.0:1787826297.800506:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45683:x1874668778589312:12345-0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1787826297.800622:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45683:x1874668778589312:12345-0@lo:1000:mdt00_009.0 Request processed in 118us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.800631:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3245 00000100:00100000:3.0:1787826297.800700:0:45683:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968101 gen 2 00000004:00080000:3.0:1787826297.800708:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968057 committed transno 4294968101 00000004:00080000:3.0:1787826297.800740:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968058 committed transno 4294968101 00000004:00080000:3.0:1787826297.800751:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968059 committed transno 4294968101 00000004:00080000:3.0:1787826297.800762:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968060 committed transno 4294968101 00000004:00080000:3.0:1787826297.800774:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968061 committed transno 4294968101 00000004:00080000:3.0:1787826297.800786:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968062 committed transno 4294968101 00000004:00080000:3.0:1787826297.800808:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968063 committed transno 4294968101 00000004:00080000:3.0:1787826297.800817:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968064 committed transno 4294968101 00000004:00080000:3.0:1787826297.800843:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968065 committed transno 4294968101 00000004:00080000:3.0:1787826297.800893:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968066 committed transno 4294968101 00000004:00080000:3.0:1787826297.800905:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968067 committed transno 4294968101 00000004:00080000:3.0:1787826297.800918:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968068 committed transno 4294968101 00000004:00080000:3.0:1787826297.800927:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968069 committed transno 4294968101 00000004:00080000:3.0:1787826297.800942:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe17f1cb40, transno 4294968070 00000004:00080000:3.0:1787826297.800957:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe1607a940, transno 4294968071 00000004:00080000:3.0:1787826297.800960:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe17f1ed00, transno 4294968072 00000004:00080000:3.0:1787826297.800963:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe17f1c780, transno 4294968073 00000004:00080000:3.0:1787826297.800966:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe16078f00, transno 4294968074 00000004:00080000:3.0:1787826297.800969:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe16078780, transno 4294968075 00000004:00080000:3.0:1787826297.800972:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe160792c0, transno 4294968076 00000004:00080000:3.0:1787826297.800974:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe16078000, transno 4294968077 00000004:00080000:3.0:1787826297.800977:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dd2b840, transno 4294968078 00000004:00080000:3.0:1787826297.800981:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968079 committed transno 4294968101 00000004:00080000:3.0:1787826297.800994:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968080 committed transno 4294968101 00000004:00080000:3.0:1787826297.801006:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968081 committed transno 4294968101 00000004:00080000:3.0:1787826297.801017:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968082 committed transno 4294968101 00000004:00080000:3.0:1787826297.801027:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968083 committed transno 4294968101 00000004:00080000:3.0:1787826297.801041:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968084 committed transno 4294968101 00000004:00080000:3.0:1787826297.801053:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968085 committed transno 4294968101 00000004:00080000:3.0:1787826297.801063:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968086 committed transno 4294968101 00000004:00080000:3.0:1787826297.801073:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968087 committed transno 4294968101 00000004:00080000:3.0:1787826297.801083:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968088 committed transno 4294968101 00000004:00080000:3.0:1787826297.801096:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968089 committed transno 4294968101 00000004:00080000:3.0:1787826297.801104:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968090 committed transno 4294968101 00000004:00080000:3.0:1787826297.801117:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe1607b480, transno 4294968092 00000004:00080000:3.0:1787826297.801120:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe083ff480, transno 4294968093 00000004:00080000:3.0:1787826297.801123:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe1607b840, transno 4294968094 00000004:00080000:3.0:1787826297.801126:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe083fc780, transno 4294968095 00000004:00080000:3.0:1787826297.801129:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe16079680, transno 4294968096 00000004:00080000:3.0:1787826297.801131:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe083ffc00, transno 4294968097 00000004:00080000:3.0:1787826297.801134:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe16078b40, transno 4294968098 00000004:00080000:3.0:1787826297.801137:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe083fe1c0, transno 4294968099 00000004:00080000:3.0:1787826297.801140:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a1161c0, transno 4294968100 00000004:00080000:3.0:1787826297.801143:0:45683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a1152c0, transno 4294968101 00000100:00100000:3.0:1787826297.801152:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778589312:0@lo:1000:mdt00_009.0 00000001:00080000:3.0:1787826297.801310:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015975 00000100:00100000:3.0:1787826297.801376:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778589440:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1787826297.803306:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826297.803344:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff719c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826297.803711:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789574784 00000100:00100000:2.0:1787826297.803718:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789574784 00000100:00100000:2.0:1787826297.803756:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6073 00000100:00100000:2.0:1787826297.803765:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789574784:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826297.803805:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.803832:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 11 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.803842:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826297.803847:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826297.803871:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.803914:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 11 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.803932:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 11 pid: 45681 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.803949:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778589568:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826297.804127:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56e40 going to sleep for 11 seconds 00000004:00080000:3.0:1787826297.804265:0:38204:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 6 changes, 0 in progress, 0 in flight, 19 done 00000100:00100000:3.0:1787826297.805678:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778589440:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1787826297.807395:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789574912 00000100:00100000:2.0:1787826297.807415:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789574912 00000100:00100000:2.0:1787826297.807574:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6074 00000100:00100000:2.0:1787826297.807588:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789574912:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00000001:00080000:3.0:1787826297.807637:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015976 00010000:00010000:2.0:1787826297.807653:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.807679:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.807690:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826297.807696:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826297.807704:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.807704:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.807726:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.807762:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.807777:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 13 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.807793:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a106940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778589696:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826297.807916:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787826297.809580:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809589:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.809594:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809604:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809627:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826297.809630:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826297.809636:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809642:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349944d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x101:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809683:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62a00/0x68019081f3499041 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809690:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62a00/0x68019081f3499041 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809695:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62a00/0x68019081f3499041 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809705:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3fd62a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.809708:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62a00/0x68019081f3499041 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809715:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62a00/0x68019081f3499041 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.809723:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xcf:0x0].0x0 (ffff9bbf1127f400) 00010000:00010000:3.0:1787826297.809725:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826297.809729:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62a00/0x68019081f3499041 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.811285:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62a00/0x68019081f3499041 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813394:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813426:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813450:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813465:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813471:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813481:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813488:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826297.813493:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813501:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813513:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xcf:0x0].0x0 (ffff9bbf1127f400) 00010000:00010000:1.0:1787826297.813516:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826297.813521:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813527:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f3499470 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813546:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813553:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813558:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813563:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826297.813566:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813577:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813585:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xcf:0x0].0x0 (ffff9bbf1127f400) 00010000:00010000:1.0:1787826297.813587:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826297.813590:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.813595:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499446 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.813912:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778589568:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826297.813941:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.818208:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84132:x1874668789573760:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 45760us (45957us total) trans 8590015977 rc 0/0 00000100:00100000:1.0:1787826297.818229:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110776 00000020:00080000:1.0:1787826297.818241:0:45683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826297.827872:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.827957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.827995:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.828290:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789575296 00000100:00100000:3.0:1787826297.828299:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789575296 00000100:00100000:3.0:1787826297.828379:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2533 00000100:00100000:3.0:1787826297.828393:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84132:x1874668789575296:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787826297.828953:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x101:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826297.829008:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015978 00010000:00010000:3.0:1787826297.829055:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499477 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x101:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829082:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499477 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829095:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499477 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829106:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499477 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829114:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499477 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829121:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499477 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829188:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826297.829309:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84132:x1874668789575296:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 918us (1350us total) trans 8590015979 rc 0/0 00000100:00100000:3.0:1787826297.829331:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2533 00000020:00080000:3.0:1787826297.829336:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826297.829378:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789575040 00000100:00100000:3.0:1787826297.829384:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789575040 00010000:00010000:3.0:1787826297.829414:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 12 pid: 45681 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.829457:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789575424 00000100:00100000:3.0:1787826297.829461:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789575424 00010000:00010000:3.0:1787826297.829480:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 14 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.829513:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2862 00000100:00100000:3.0:1787826297.829522:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789575040:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826297.829535:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826297.829559:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 12 pid: 45681 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829573:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 12 pid: 45681 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829598:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f3499400 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb27b expref: 12 pid: 45681 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829620:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826297.829625:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826297.829631:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829641:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829670:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826297.829696:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789575040:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 174us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.829704:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2862 00000100:00100000:3.0:1787826297.829722:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2863 00000100:00100000:3.0:1787826297.829743:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40515c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789575424:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826297.829753:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826297.829769:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 14 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829782:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 14 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829796:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f3499407 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb274 expref: 14 pid: 8432 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829808:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826297.829811:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826297.829815:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829822:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829841:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826297.829885:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40515c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789575424:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 156us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.829891:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2863 00010000:00010000:3.0:1787826297.829960:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829976:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.829996:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830005:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830012:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830019:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826297.830023:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830033:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830045:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830054:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e7dfbc/0x68019081f3499462 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.830105:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789574784:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 26341us (26903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.830115:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6073 00010000:00010000:3.0:1787826297.830141:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830149:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830164:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830171:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830177:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830184:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826297.830187:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830194:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830209:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.830216:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f3499469 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.830256:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789574912:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 22673us (24250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.830263:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6074 00010000:00010000:1.0:1787826297.834202:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826297.834206:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826297.834209:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826297.835681:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789575680 00000100:00100000:2.0:1787826297.835694:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789575680 00000100:00100000:2.0:1787826297.835787:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110779 00000100:00100000:2.0:1787826297.835801:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84133:x1874668789575680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826297.836622:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349947e lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.836648:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349947e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.836663:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349947e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.836903:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499485 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x103:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.836919:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499431 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb289 expref: 42 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.836929:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499485 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.837128:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499431 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb289 expref: 42 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.837148:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499431 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb289 expref: 42 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.837166:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778589824:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826297.837296:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d563c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826297.844376:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789575936 00000100:00100000:3.0:1787826297.844394:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789575936 00000100:00100000:3.0:1787826297.844484:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110780 00000100:00100000:3.0:1787826297.844497:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84131:x1874668789575936:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.844607:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349948c lrc: 3/0,1 mode: --/PW res: [0x200000403:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.844630:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349948c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.844645:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349948c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.844885:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499493 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x102:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.844900:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb290 expref: 44 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.844917:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499493 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.844973:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb290 expref: 44 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.844989:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb290 expref: 44 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.845007:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778589952:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826297.845128:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826297.847915:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826297.848442:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499431 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb289 expref: 44 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.848463:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778589824:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826297.848491:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499485 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.848501:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499485 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.848506:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499485 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x103:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826297.848660:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015980 00000001:00080000:3.0:1787826297.848817:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015982 00000001:00080000:3.0:1787826297.848962:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015983 00000100:00100000:3.0:1787826297.849067:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088ba1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778590080:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826297.849134:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826297.849174:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826297.849349:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778590080 00000100:00100000:1.0:1787826297.849356:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778590080 00000100:00100000:1.0:1787826297.849404:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3247 00000100:00100000:1.0:1787826297.849414:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:12105:x1874668778590080:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787826297.849520:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:12105:x1874668778590080:12345-0@lo:1000:mdt00_004.0 Request processed in 108us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.849533:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3247 00000100:00100000:3.0:1787826297.850777:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088ba1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778590080:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787826297.851042:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015984 00000100:00100000:3.0:1787826297.851128:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088ba1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778590208:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826297.851193:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826297.851262:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826297.854432:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.854519:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789576192 00000100:00100000:2.0:1787826297.854529:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789576192 00010000:00010000:2.0:1787826297.854574:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb290 expref: 48 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.854617:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2865 00000100:00100000:2.0:1787826297.854628:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2402:x1874668789576192:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826297.854645:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826297.854651:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb290 expref: 48 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.854666:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb290 expref: 48 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.854689:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:2.0:1787826297.854694:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499493 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.854709:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499493 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.854717:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499493 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.854738:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826297.854783:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2402:x1874668789576192:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 158us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.854792:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2865 00010000:00010000:3.0:1787826297.860171:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499438 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb290 expref: 47 pid: 12105 timeout: 3035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.860206:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778589952:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826297.860240:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499493 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.860255:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499493 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.860262:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499493 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x102:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826297.860425:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015981 00000001:00080000:3.0:1787826297.860573:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015987 00000001:00080000:3.0:1787826297.860612:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015988 00000100:00100000:3.0:1787826297.860710:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778590336:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826297.860784:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826297.860791:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789576448 00000100:00100000:2.0:1787826297.860800:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789576448 00000100:00100000:3.0:1787826297.860825:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826297.860909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2534 00000100:00100000:3.0:1787826297.860922:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84133:x1874668789576448:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787826297.861121:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x103:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826297.861163:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015990 00010000:00010000:3.0:1787826297.861203:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861222:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861235:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861245:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861252:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861260:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861280:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826297.861382:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+52:84133:x1874668789576448:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 461us (1147us total) trans 8590015991 rc 0/0 00000100:00100000:3.0:1787826297.861392:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2534 00000020:00080000:3.0:1787826297.861398:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826297.861425:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826297.861442:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861451:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826297.861457:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861467:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861483:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826297.861487:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826297.861492:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861500:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994a1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x103:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.861513:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826297.861516:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826297.861518:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826297.861810:0:6516:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968117 gen 2 00000004:00080000:3.0:1787826297.861819:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968073 committed transno 4294968117 00000004:00080000:3.0:1787826297.861840:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968074 committed transno 4294968117 00000004:00080000:3.0:1787826297.861925:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968075 committed transno 4294968117 00000004:00080000:3.0:1787826297.861942:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968076 committed transno 4294968117 00000004:00080000:3.0:1787826297.861954:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968077 committed transno 4294968117 00000004:00080000:3.0:1787826297.861964:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968078 committed transno 4294968117 00000004:00080000:3.0:1787826297.861975:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968079 committed transno 4294968117 00000004:00080000:3.0:1787826297.861989:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968080 committed transno 4294968117 00000004:00080000:3.0:1787826297.862020:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968081 committed transno 4294968117 00000004:00080000:3.0:1787826297.862053:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968082 committed transno 4294968117 00000004:00080000:3.0:1787826297.862063:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968083 committed transno 4294968117 00000004:00080000:3.0:1787826297.862076:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968084 committed transno 4294968117 00000004:00080000:3.0:1787826297.862087:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968085 committed transno 4294968117 00000004:00080000:3.0:1787826297.862099:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a563840, transno 4294968086 00000004:00080000:3.0:1787826297.862115:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a562580, transno 4294968087 00000004:00080000:3.0:1787826297.862120:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf3fc792c0, transno 4294968088 00000004:00080000:3.0:1787826297.862124:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf3db77840, transno 4294968089 00000004:00080000:3.0:1787826297.862128:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf3db74780, transno 4294968090 00000004:00080000:3.0:1787826297.862131:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a561e00, transno 4294968091 00000004:00080000:3.0:1787826297.862134:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0aa96940, transno 4294968092 00000004:00080000:3.0:1787826297.862136:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf3db75e00, transno 4294968093 00000004:00080000:3.0:1787826297.862139:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dd2a940, transno 4294968094 00000004:00080000:3.0:1787826297.862143:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968095 committed transno 4294968117 00000004:00080000:3.0:1787826297.862157:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968096 committed transno 4294968117 00000004:00080000:3.0:1787826297.862189:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968097 committed transno 4294968117 00000004:00080000:3.0:1787826297.862203:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968098 committed transno 4294968117 00000004:00080000:3.0:1787826297.862219:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968099 committed transno 4294968117 00000004:00080000:3.0:1787826297.862230:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968100 committed transno 4294968117 00000004:00080000:3.0:1787826297.862244:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968101 committed transno 4294968117 00000004:00080000:3.0:1787826297.862254:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968102 committed transno 4294968117 00000004:00080000:3.0:1787826297.862264:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968103 committed transno 4294968117 00000004:00080000:3.0:1787826297.862289:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968104 committed transno 4294968117 00000004:00080000:3.0:1787826297.862300:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968105 committed transno 4294968117 00000004:00080000:3.0:1787826297.862309:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968106 committed transno 4294968117 00000004:00080000:3.0:1787826297.862319:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968107 committed transno 4294968117 00000004:00080000:3.0:1787826297.862331:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf3fc7a580, transno 4294968108 00000004:00080000:3.0:1787826297.862335:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf05cbc000, transno 4294968109 00000004:00080000:3.0:1787826297.862338:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a31da40, transno 4294968110 00000004:00080000:3.0:1787826297.862343:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf05cbf480, transno 4294968111 00000004:00080000:3.0:1787826297.862347:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf05cbf840, transno 4294968112 00000004:00080000:3.0:1787826297.862351:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a31fc00, transno 4294968113 00000004:00080000:3.0:1787826297.862356:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf05cbda40, transno 4294968114 00000004:00080000:3.0:1787826297.862360:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf05cbc780, transno 4294968115 00000004:00080000:3.0:1787826297.862365:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a563c00, transno 4294968116 00000004:00080000:3.0:1787826297.862370:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a5630c0, transno 4294968117 00000100:00100000:3.0:1787826297.862381:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778590336:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787826297.862696:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590015989 00000100:00100000:3.0:1787826297.862837:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16079a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778590464:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826297.862991:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826297.863597:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff713c0 going to sleep for 11 seconds 00000040:00080000:1.0:1787826297.868709:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826297.868721:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826297.869150:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9658 count 103 00000040:00080000:1.0:1787826297.869162:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787826297.869422:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa961c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778590592:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826297.869590:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826297.870630:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826297.873495:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826297.873505:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f34994af lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.873514:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826297.873519:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f34994af lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.873529:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f34994af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.873548:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:3.0:1787826297.873555:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826297.873562:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f34994af lrc: 1/0,0 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.873573:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f34994af lrc: 0/0,0 mode: --/PW res: [0x200000403:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.873591:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826297.873593:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826297.873596:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826297.881221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.881345:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789576832 00000100:00100000:2.0:1787826297.881354:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789576832 00000100:00100000:2.0:1787826297.881424:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110781 00000100:00100000:2.0:1787826297.881445:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84137:x1874668789576832:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826297.881492:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd1:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826297.881644:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84137:x1874668789576832:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 211us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.881652:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110781 00000100:00100000:1.0:1787826297.881708:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa961c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778590592:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826297.885202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826297.885378:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.887921:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789576960 00000100:00100000:2.0:1787826297.887946:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789577088 00000100:00100000:3.0:1787826297.887949:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789576960 00000100:00100000:2.0:1787826297.887953:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789577088 00000100:00100000:3.0:1787826297.888037:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110782 00000100:00100000:3.0:1787826297.888049:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84139:x1874668789576960:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826297.888091:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd3:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826297.888161:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110783 00000100:00100000:2.0:1787826297.888172:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84138:x1874668789577088:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826297.888191:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826297.888252:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84139:x1874668789576960:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 204us (3063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.888257:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84138:x1874668789577088:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 85us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.888265:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110782 00000100:00100000:2.0:1787826297.888276:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110783 00000100:00100000:1.0:1787826297.904993:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.913041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.913097:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.914512:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.914660:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789577344 00000100:00100000:3.0:1787826297.914673:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789577344 00000100:00100000:3.0:1787826297.914754:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789577472 00000100:00100000:3.0:1787826297.914758:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789577472 00000100:00100000:3.0:1787826297.914780:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789577728 00000100:00100000:3.0:1787826297.914783:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789577728 00000100:00100000:3.0:1787826297.914809:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110785 00000100:00100000:3.0:1787826297.914821:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84139:x1874668789577344:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.914949:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.914972:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.914986:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915003:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915011:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915019:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915050:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915058:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915066:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826297.915122:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd3:0x0]: returning size 158 00000004:00200000:3.0:1787826297.915127:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826297.915144:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915159:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915167:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915175:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915184:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915191:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.915196:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915206:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915221:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826297.915225:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.915229:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915236:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f34994cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915250:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915257:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915264:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915271:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.915274:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915281:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915290:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xa3902d5f (ffff9bbf14059000) 00010000:00010000:3.0:1787826297.915293:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.915296:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915308:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f34994d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa3902d5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915325:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.915327:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110786 00010000:00010000:3.0:1787826297.915336:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915345:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826297.915347:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84138:x1874668789577472:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.915354:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.915358:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915365:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915373:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd3:0x0].0x0 (ffff9bbf1127fe00) 00010000:00010000:3.0:1787826297.915376:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.915380:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.915387:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34994d9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915390:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915403:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915413:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915429:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915449:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915458:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915482:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915491:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915499:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826297.915524:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd2:0x0]: returning size 158 00000004:00200000:1.0:1787826297.915528:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826297.915536:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915547:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915555:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915562:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915569:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915576:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826297.915580:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915588:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915598:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826297.915602:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826297.915606:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915613:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34994e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915626:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915633:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915639:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915645:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826297.915648:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915653:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915660:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x41409164 (ffff9bbe1342f300) 00010000:00010000:1.0:1787826297.915663:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826297.915666:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915677:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34994e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x41409164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915689:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915696:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915702:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915708:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826297.915711:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915717:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915725:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd2:0x0].0x0 (ffff9bbf1127fd00) 00010000:00010000:1.0:1787826297.915727:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826297.915731:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.915737:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34994ee lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.916479:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110787 00000100:00100000:2.0:1787826297.916495:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84137:x1874668789577728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826297.916514:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826297.916535:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f34994f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb297 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.916637:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.916651:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.916663:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826297.916674:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd1:0x0]: returning size 158 00000100:00100000:1.0:1787826297.917114:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84138:x1874668789577472:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1770us (4014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826297.917125:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110786 00010000:00010000:2.0:1787826297.917265:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.917275:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.917282:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.917294:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826297.917299:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.917307:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.917408:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd1:0x0].0x0 (ffff9bbf1127f200) 00010000:00010000:2.0:1787826297.917412:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826297.917418:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.917425:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f34994fc lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.917480:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f34994f5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb297 expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.917493:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826297.917495:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826297.917499:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f34994f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb297 expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.917509:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:3.0:1787826297.923137:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84139:x1874668789577344:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 8300us (10094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.923158:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110785 00000100:00100000:2.0:1787826297.930727:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84137:x1874668789577728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 14194us (16182us total) trans 8590015996 rc 301/301 00000100:00100000:2.0:1787826297.930745:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110787 00000100:00100000:2.0:1787826297.938586:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.938646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.938688:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789577984 00000100:00100000:2.0:1787826297.938700:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789577984 00000100:00100000:2.0:1787826297.938772:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789578240 00000100:00100000:2.0:1787826297.938775:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789578240 00000100:00100000:2.0:1787826297.938799:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110788 00000100:00100000:2.0:1787826297.938809:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a106940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84138:x1874668789577984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826297.938837:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826297.938888:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349950a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb29e expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826297.938905:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110789 00000100:00100000:3.0:1787826297.938920:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84139:x1874668789578240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826297.938943:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.938958:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499511 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb2a5 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939032:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939032:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939065:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939065:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939093:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939093:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826297.939114:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd3:0x0]: returning size 158 00000004:00200000:2.0:1787826297.939115:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd2:0x0]: returning size 158 00010000:00010000:3.0:1787826297.939219:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939220:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939243:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939244:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939266:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939266:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939283:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.939284:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826297.939293:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939293:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939313:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939313:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939340:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd2:0x0].0x0 (ffff9bbf1127fd00) 00010000:00010000:3.0:1787826297.939341:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd3:0x0].0x0 (ffff9bbf1127fe00) 00010000:00010000:2.0:1787826297.939345:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826297.939347:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826297.939351:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939352:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939368:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349951f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939370:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499518 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939423:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349950a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb29e expref: 61 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939461:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826297.939464:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826297.939468:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349950a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb29e expref: 61 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.939480:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3800, rc 0) 00000100:00100000:2.0:1787826297.939553:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a106940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84138:x1874668789577984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 745us (982us total) trans 8590015998 rc 301/301 00010000:00010000:3.0:1787826297.939558:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499511 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2a5 expref: 60 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.939566:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110788 00010000:00010000:3.0:1787826297.939577:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826297.939581:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826297.939587:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499511 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2a5 expref: 59 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.939600:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606800, rc 0) 00000100:00100000:3.0:1787826297.939629:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84139:x1874668789578240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 714us (983us total) trans 8590015997 rc 301/301 00000100:00100000:3.0:1787826297.939638:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110789 00000100:00100000:2.0:1787826297.942966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.943036:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789578368 00000100:00100000:3.0:1787826297.943048:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789578368 00000100:00100000:3.0:1787826297.943120:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110790 00000100:00100000:3.0:1787826297.943132:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84137:x1874668789578368:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826297.943177:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd1:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826297.943326:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84137:x1874668789578368:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 196us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826297.943340:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110790 00000100:00100000:2.0:1787826297.944305:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.944341:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.944371:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789578496 00000100:00100000:2.0:1787826297.944378:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789578496 00000100:00100000:2.0:1787826297.944424:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789578624 00000100:00100000:2.0:1787826297.944427:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789578624 00000100:00100000:2.0:1787826297.944456:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110791 00000100:00100000:2.0:1787826297.944465:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84138:x1874668789578496:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826297.944499:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826297.944595:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84138:x1874668789578496:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 131us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.944602:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110791 00000100:00100000:2.0:1787826297.944619:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110792 00000100:00100000:2.0:1787826297.944625:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84139:x1874668789578624:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826297.944642:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd3:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826297.944695:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84139:x1874668789578624:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 69us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.944703:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110792 00000100:00100000:1.0:1787826297.960071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.963117:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789578880 00000100:00100000:3.0:1787826297.963140:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789578880 00000100:00100000:1.0:1787826297.965203:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110793 00000100:00100000:1.0:1787826297.965220:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84139:x1874668789578880:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826297.965247:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826297.965277:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499534 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb2ac expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.966010:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349953b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.966030:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349953b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.966044:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349953b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826297.966055:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x104:0x0]: returning size 0 00010000:00010000:1.0:1787826297.966114:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499534 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2ac expref: 61 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.966135:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349953b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2ac expref: 60 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826297.966145:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe1342f300) 00010000:00010000:1.0:1787826297.966148:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826297.966153:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826297.966236:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84139:x1874668789578880:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1020us (6180us total) trans 8590015999 rc 0/0 00000100:00100000:1.0:1787826297.966245:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110793 00000100:00100000:2.0:1787826297.981373:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826297.981590:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789579264 00000100:00100000:3.0:1787826297.981603:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789579264 00000100:00100000:3.0:1787826297.981668:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3251 00000100:00100000:3.0:1787826297.981680:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+60:2400:x1874668789579264:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826297.981746:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826297.981771:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499549 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb2b3 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.981844:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.981886:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.981901:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.981919:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.981927:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.981934:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.981991:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982000:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982007:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982014:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.982020:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982029:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982043:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826297.982046:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.982051:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982059:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499550 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982072:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982079:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982085:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982091:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826297.982095:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982102:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982109:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x4da4d1bb (ffff9bbf14059000) 00010000:00010000:3.0:1787826297.982112:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826297.982115:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982122:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499557 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x4da4d1bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982159:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499549 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2b3 expref: 61 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982170:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826297.982172:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826297.982176:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499549 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2b3 expref: 61 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826297.982186:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607a00, rc -2) 00000100:00100000:3.0:1787826297.983071:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+60:2400:x1874668789579264:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 1386us (1701us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826297.983084:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3251 00000100:00100000:3.0:1787826297.984879:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826297.989930:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789579136 00000100:00100000:2.0:1787826297.989950:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789579136 00000100:00100000:2.0:1787826297.990046:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110794 00000100:00100000:2.0:1787826297.990058:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84139:x1874668789579136:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826297.990133:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826297.990169:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349953b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x104:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2ac expref: 60 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990197:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe1342f300) 00010000:00010000:2.0:1787826297.990210:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826297.990241:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990258:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990271:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990289:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990296:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990304:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990380:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990389:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990396:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990403:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990591:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826297.990597:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990612:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990622:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826297.990625:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826297.990630:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990637:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349955e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990650:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990656:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990663:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990668:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826297.990670:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990677:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990685:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x35e1636 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826297.990688:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826297.990690:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826297.990702:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499565 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x35e1636 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826297.990875:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84139:x1874668789579136:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 798us (6009us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826297.990884:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110794 00000100:00100000:3.0:1787826297.997776:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.001027:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789579648 00000100:00100000:2.0:1787826298.001037:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789579648 00000100:00100000:2.0:1787826298.001115:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110796 00000100:00100000:2.0:1787826298.001126:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84139:x1874668789579648:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.001150:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.001177:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499581 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb2f2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.001218:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.001234:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.001247:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.001379:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499581 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f2 expref: 63 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.001412:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f2 expref: 62 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.001430:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826298.001441:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826298.001446:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:2.0:1787826298.001504:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84139:x1874668789579648:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 380us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.001512:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110796 00000100:00100000:3.0:1787826298.011058:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789579904 00000100:00100000:3.0:1787826298.011073:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789579904 00000100:00100000:3.0:1787826298.011157:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789580160 00000100:00100000:3.0:1787826298.011161:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789580160 00000100:00100000:3.0:1787826298.011199:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110797 00000100:00100000:3.0:1787826298.011210:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84139:x1874668789579904:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.011344:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.011368:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.011383:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826298.011704:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc98cd47 reply state 0000000090c9073f transno 8590016001 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.011721:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.011730:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:3.0:1787826298.011733:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826298.011738:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826298.011915:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84139:x1874668789579904:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 705us (1009us total) trans 8590016001 rc 0/0 00000100:00100000:3.0:1787826298.011924:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110797 00000100:00100000:3.0:1787826298.011952:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110798 00000100:00100000:3.0:1787826298.011960:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84137:x1874668789580160:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.011993:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.012016:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499573 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x105:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2eb expref: 64 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.012035:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81500) 00010000:00010000:3.0:1787826298.012045:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826298.012065:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.012075:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.012082:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.012099:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.012108:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.012114:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014088:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014110:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014118:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014472:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.014480:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014492:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014514:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826298.014518:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.014523:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014530:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499596 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014551:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014557:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014563:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014569:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.014572:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014578:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014586:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xff841895 (ffff9bbf14059000) 00010000:00010000:3.0:1787826298.014589:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.014592:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.014599:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349959d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xff841895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.021008:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84137:x1874668789580160:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 9028us (10021us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826298.021028:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110798 00000100:00100000:3.0:1787826298.029040:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.033025:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.034319:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789580288 00000100:00100000:2.0:1787826298.034336:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789580288 00000100:00100000:2.0:1787826298.037822:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789580672 00000100:00100000:2.0:1787826298.037831:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789580672 00000100:00100000:2.0:1787826298.037997:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110801 00000100:00100000:2.0:1787826298.038007:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84138:x1874668789580672:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.038020:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.038037:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb307 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.038718:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f34995c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.038734:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f34995c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.038744:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f34995c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.038756:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x106:0x0]: returning size 0 00010000:00010000:2.0:1787826298.038813:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb307 expref: 68 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.038831:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f34995c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb307 expref: 67 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.038840:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.038843:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826298.038846:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3800, rc 0) 00000100:00100000:2.0:1787826298.040510:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84138:x1874668789580672:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2489us (7484us total) trans 8590016002 rc 0/0 00000100:00100000:2.0:1787826298.040525:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110801 00000100:00100000:3.0:1787826298.043126:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789580800 00000100:00100000:3.0:1787826298.043140:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789580800 00000100:00100000:3.0:1787826298.043215:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2536 00000100:00100000:3.0:1787826298.043227:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84139:x1874668789580800:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.043491:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84139:x1874668789580800:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 264us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.043501:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2536 00000100:00100000:3.0:1787826298.049791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.051522:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789581056 00000100:00100000:1.0:1787826298.051543:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789581056 00000100:00100000:1.0:1787826298.051633:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110802 00000100:00100000:1.0:1787826298.051646:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84137:x1874668789581056:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.051765:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 3/0,1 mode: --/PW res: [0x200000403:0x105:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.051788:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.051803:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.053964:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789581312 00000100:00100000:3.0:1787826298.053973:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789581312 00000100:00100000:3.0:1787826298.054028:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2537 00000100:00100000:3.0:1787826298.054038:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84139:x1874668789581312:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.054289:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84139:x1874668789581312:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 251us (466us total) trans 8590016004 rc 0/0 00000100:00100000:3.0:1787826298.054299:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2537 00000100:00100000:1.0:1787826298.065476:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789582080 00000100:00100000:1.0:1787826298.065481:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789582080 00000100:00100000:1.0:1787826298.065519:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3252 00000100:00100000:1.0:1787826298.065530:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+73:2402:x1874668789582080:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826298.065610:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.065621:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34995dc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb315 expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065675:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065685:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065695:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065712:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065720:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065726:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065785:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065793:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065800:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065807:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.065812:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065820:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065834:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826298.065838:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.065844:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065874:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34995e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065890:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065898:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065905:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065910:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.065914:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065920:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065928:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xb65af147 (ffff9bbe1342f400) 00010000:00010000:1.0:1787826298.065931:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.065934:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065941:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f34995ea lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xb65af147 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065973:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34995dc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb315 expref: 75 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.065984:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826298.065987:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826298.065991:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f34995dc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb315 expref: 75 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.066007:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc -2) 00000100:00100000:1.0:1787826298.066096:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+74:2402:x1874668789582080:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 567us (775us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826298.066106:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3252 00000100:00100000:2.0:1787826298.066343:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110804 00000100:00100000:2.0:1787826298.066358:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84139:x1874668789581696:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.066423:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84139:x1874668789581696:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 70us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.066444:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110804 00000100:00100000:2.0:1787826298.066465:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110805 00000100:00100000:2.0:1787826298.066472:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84138:x1874668789581952:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.066507:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.066527:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f34995c0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb307 expref: 72 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066548:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.066556:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826298.066574:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066584:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066593:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066606:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066613:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066619:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066655:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066661:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066667:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066673:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.066676:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066683:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066691:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826298.066693:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.066696:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066702:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f34995f1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066712:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066718:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066724:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066729:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.066731:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066737:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066744:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x3c002ebb (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826298.066747:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.066749:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.066756:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f34995f8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x3c002ebb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.066797:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84138:x1874668789581952:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 324us (1419us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826298.066804:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110805 00000100:00100000:1.0:1787826298.075215:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.075329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.075479:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789582464 00000100:00100000:3.0:1787826298.075493:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789582464 00000100:00100000:3.0:1787826298.075568:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110806 00000100:00100000:3.0:1787826298.075580:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84139:x1874668789582464:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.075607:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.075636:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34995ff lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb34d expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.076155:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.076178:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34995a4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f9 expref: 71 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.076189:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.076246:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34995a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f9 expref: 71 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.076264:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34995a4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f9 expref: 71 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.076283:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078b40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778590720:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.076415:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.077132:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789582592 00000100:00100000:3.0:1787826298.077139:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789582592 00000100:00100000:3.0:1787826298.077187:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110807 00000100:00100000:3.0:1787826298.077197:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84138:x1874668789582592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.077215:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.077235:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349960d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.077268:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499614 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.077282:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499614 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.077295:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499614 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.077489:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349960d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x106:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb354 expref: 74 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.077512:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499614 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb354 expref: 73 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.077522:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:3.0:1787826298.077525:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826298.077529:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00000100:00100000:3.0:1787826298.077577:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84138:x1874668789582592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 381us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.077585:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110807 00000100:00100000:2.0:1787826298.078478:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789582208 00000100:00100000:2.0:1787826298.078491:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789582208 00000100:00100000:2.0:1787826298.078576:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2538 00000100:00100000:2.0:1787826298.078588:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84137:x1874668789582208:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.078686:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84137:x1874668789582208:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 100us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.078695:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2538 00000100:00100000:1.0:1787826298.084325:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.084375:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.084424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.084456:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078b40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778590720:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.084471:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789583232 00000100:00100000:1.0:1787826298.084479:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789583232 00010000:00010000:3.0:1787826298.084497:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.084553:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2539 00000100:00100000:1.0:1787826298.084566:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84137:x1874668789583232:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.084890:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84137:x1874668789583232:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 325us (464us total) trans 8590016005 rc 0/0 00000100:00100000:1.0:1787826298.084900:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2539 00000100:00100000:2.0:1787826298.085675:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789582720 00000100:00100000:2.0:1787826298.085682:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789582720 00010000:00010000:2.0:1787826298.085719:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34995a4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f9 expref: 76 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.085748:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2866 00000100:00100000:2.0:1787826298.085756:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+76:2401:x1874668789582720:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.085769:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.085776:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34995a4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f9 expref: 76 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.085790:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34995a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f9 expref: 76 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.085816:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34995a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f9 expref: 76 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.085834:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826298.085839:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.086006:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.086016:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.086046:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.086139:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+75:2401:x1874668789582720:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 383us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.086148:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2866 00010000:00010000:3.0:1787826298.086264:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086273:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826298.086298:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x104:0x0]: returning size 0 00000004:00080000:3.0:1787826298.086483:0:23845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb1:0x0], index 0: 0 00010000:00010000:3.0:1787826298.086590:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086600:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086609:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086616:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.086622:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086633:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086646:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:3.0:1787826298.086661:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826298.086665:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086673:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499606 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086801:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34995ff lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb34d expref: 75 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086814:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826298.086818:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826298.086822:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f34995ff lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb34d expref: 75 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.086833:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826298.086925:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84139:x1874668789582464:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 11346us (11595us total) trans 8590016007 rc 301/301 00000100:00100000:3.0:1787826298.086932:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110806 00000100:00100000:2.0:1787826298.091244:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.091346:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.093920:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.094644:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789583872 00000100:00100000:1.0:1787826298.094660:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789583872 00000100:00100000:1.0:1787826298.095332:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2540 00000100:00100000:1.0:1787826298.095348:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84139:x1874668789583872:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.095905:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84139:x1874668789583872:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 558us (1995us total) trans 8590016008 rc 0/0 00000100:00100000:1.0:1787826298.095952:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2540 00000100:00100000:1.0:1787826298.100162:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110809 00000100:00100000:1.0:1787826298.100186:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84138:x1874668789583360:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.100217:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.100248:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499629 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb35b expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.100266:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826298.100334:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499629 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb35b expref: 77 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.100353:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499629 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb35b expref: 77 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.100365:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:1.0:1787826298.100369:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.100374:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:2.0:1787826298.100484:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789584000 00000100:00100000:2.0:1787826298.100493:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789584000 00000100:00100000:2.0:1787826298.100553:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110810 00000100:00100000:2.0:1787826298.100563:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84137:x1874668789583616:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.100662:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84138:x1874668789583360:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 485us (9432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.100670:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110809 00000100:00100000:1.0:1787826298.100710:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110811 00000100:00100000:1.0:1787826298.100717:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84139:x1874668789584000:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.100725:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.100737:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499630 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb362 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.100793:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499637 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.100805:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499637 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.100815:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499637 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826298.100882:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x104:0x0]: returning size 0 00000004:00200000:1.0:1787826298.100886:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826298.100909:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499637 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.100934:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499630 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb362 expref: 79 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.100952:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499637 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb362 expref: 78 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.100959:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826298.100962:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826298.100965:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:2.0:1787826298.101337:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84137:x1874668789583616:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 772us (9988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.101347:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110810 00000100:00100000:1.0:1787826298.101393:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84139:x1874668789584000:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 675us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.101401:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110811 00000100:00100000:2.0:1787826298.106587:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.106800:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789584128 00000100:00100000:1.0:1787826298.106813:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789584128 00000100:00100000:1.0:1787826298.106918:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6075 00000100:00100000:1.0:1787826298.106929:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789584128:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.106952:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.106981:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb369 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826298.107020:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826298.107048:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=2936s v=(0 0) 00010000:00010000:1.0:1787826298.107053:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.107168:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb369 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.107194:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb369 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.107212:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826298.107293:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789584128:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 364us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.107300:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6075 00000100:00100000:1.0:1787826298.112182:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789584512 00000100:00100000:1.0:1787826298.112197:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789584512 00000100:00100000:1.0:1787826298.112277:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2541 00000100:00100000:1.0:1787826298.112289:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84138:x1874668789584512:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.112481:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84138:x1874668789584512:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 194us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.112490:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2541 00000100:00100000:1.0:1787826298.112557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789584384 00000100:00100000:1.0:1787826298.112562:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789584384 00000100:00100000:1.0:1787826298.112645:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110812 00000100:00100000:1.0:1787826298.112653:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84137:x1874668789584384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.112666:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.112704:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499645 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb370 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.112823:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.112844:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34995d5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb30e expref: 78 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.112881:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.112925:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34995d5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb30e expref: 78 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.112941:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34995d5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb30e expref: 78 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.112956:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778590848:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.113041:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.115504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.117714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.118630:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778590848:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.118672:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.119632:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.120240:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789585152 00000100:00100000:1.0:1787826298.120247:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789585152 00010000:00010000:1.0:1787826298.120281:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34995d5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb30e expref: 82 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.123661:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2867 00000100:00100000:1.0:1787826298.123701:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2399:x1874668789585152:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.123732:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.123747:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34995d5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb30e expref: 82 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.123768:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34995d5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb30e expref: 82 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.123798:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34995d5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb30e expref: 82 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.123821:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:1.0:1787826298.123828:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.123842:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.123893:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.124051:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826298.124152:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.124162:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.124192:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x105:0x0]: returning size 0 00000100:00100000:2.0:1787826298.124408:0:38205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a12c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:38205:1874668778590976:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787826298.124498:0:38205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.125096:0:38205:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1787826298.125210:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb2:0x0], index 1: 0 00010000:00010000:2.0:1787826298.125366:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.125377:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.125384:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.125391:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.125397:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.125405:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.125426:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:2.0:1787826298.125429:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.125447:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.125455:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349964c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.125529:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499645 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb370 expref: 82 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.125540:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826298.125543:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826298.125547:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499645 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb370 expref: 82 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.125556:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826298.129181:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2399:x1874668789585152:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5499us (9548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.129192:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2867 00000100:00100000:2.0:1787826298.129935:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84137:x1874668789584384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 17276us (17994us total) trans 8590016010 rc 301/301 00000100:00100000:2.0:1787826298.129945:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110812 00000100:00100000:1.0:1787826298.132554:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.132636:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.132678:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789585280 00000100:00100000:3.0:1787826298.132690:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789585280 00000100:00100000:3.0:1787826298.132768:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6077 00000100:00100000:3.0:1787826298.132780:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84139:x1874668789585280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.132802:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.132910:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb377 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.132953:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb369 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.132963:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.132968:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.132976:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb377 expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.133027:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb369 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.133044:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb369 expref: 14 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.133060:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41274b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778591104:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.133162:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.133191:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789585536 00000100:00100000:3.0:1787826298.134170:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789585536 00000100:00100000:2.0:1787826298.134316:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110814 00000100:00100000:2.0:1787826298.134327:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84138:x1874668789585536:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.134459:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84138:x1874668789585536:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 134us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.134467:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110814 00000100:00100000:1.0:1787826298.139190:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:38205:x1874668778590976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10169us (14682us total) trans 4294968107 rc 0/0 00000100:00100000:1.0:1787826298.139208:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6076 00000100:00100000:2.0:1787826298.139376:0:38205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a12c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:38205:1874668778590976:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787826298.139400:0:38205:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xb2:0x0]-[0x2c0000401:0xe1:0x0] 00000100:00100000:2.0:1787826298.143772:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.143947:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.144007:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41274b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778591104:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826298.144059:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 3/0,0 mode: --/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb377 expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.144092:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:1.0:1787826298.144510:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789585792 00000100:00100000:1.0:1787826298.144519:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789585792 00000100:00100000:1.0:1787826298.144590:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2543 00000100:00100000:1.0:1787826298.144601:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84137:x1874668789585792:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.145005:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84137:x1874668789585792:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 403us (1245us total) trans 8590016011 rc 0/0 00000100:00100000:1.0:1787826298.145014:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2543 00000100:00100000:3.0:1787826298.150574:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84139:x1874668789585280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 17776us (18012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.150593:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6077 00000100:00100000:2.0:1787826298.151267:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.151442:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789586176 00000100:00100000:3.0:1787826298.151453:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789586176 00010000:00010000:3.0:1787826298.151505:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb369 expref: 14 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.151556:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2868 00000100:00100000:3.0:1787826298.151568:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789586176:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.151588:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.151615:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb369 expref: 14 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.151631:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb369 expref: 14 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.151661:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349963e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb369 expref: 14 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.151684:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.151690:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.151700:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb377 expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.151713:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb377 expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.151760:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb377 expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.151778:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41274b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778591360:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826298.152044:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.152375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.153325:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789586304 00000100:00100000:3.0:1787826298.153337:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789586304 00000100:00100000:3.0:1787826298.153408:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110816 00000100:00100000:3.0:1787826298.153420:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84137:x1874668789586304:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.153459:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.153487:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349966f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x105:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb385 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.153578:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499676 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x105:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.153595:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499676 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x105:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.153609:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499676 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x105:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826298.153669:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x105:0x0]: returning size 0 00000004:00200000:3.0:1787826298.153674:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826298.153697:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499676 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x105:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.153728:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349966f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb385 expref: 83 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.153748:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499676 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x105:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb385 expref: 82 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.153756:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:3.0:1787826298.153759:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826298.153763:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00000100:00100000:3.0:1787826298.153814:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84137:x1874668789586304:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 396us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.153824:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110816 00000100:00100000:2.0:1787826298.153937:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.159727:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.159803:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.160043:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789586560 00000100:00100000:1.0:1787826298.160052:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789586560 00010000:00010000:1.0:1787826298.160096:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499629 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb35b expref: 82 pid: 12105 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.160140:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2869 00000100:00100000:1.0:1787826298.160151:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2400:x1874668789586560:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.160169:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.160178:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499629 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb35b expref: 82 pid: 12105 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.161054:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499629 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb35b expref: 82 pid: 12105 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.161087:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499629 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb35b expref: 82 pid: 12105 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.161107:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:1.0:1787826298.161113:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499668 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.161132:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499668 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.161142:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499668 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.161275:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826298.161355:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2400:x1874668789586560:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1204us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.161366:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2869 00000100:00100000:2.0:1787826298.161739:0:38203:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:38203:1874668778591488:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787826298.161800:0:38203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.165269:0:38203:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.168596:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789586432 00000100:00100000:3.0:1787826298.168618:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789586432 00000100:00100000:1.0:1787826298.173717:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778591488 00000100:00100000:1.0:1787826298.173836:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778591488 00000100:00100000:1.0:1787826298.173950:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6078 00000100:00100000:1.0:1787826298.173961:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:38203:x1874668778591488:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787826298.174022:0:8432:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 194 00000100:00100000:2.0:1787826298.174881:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6079 00000100:00100000:2.0:1787826298.174893:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789586432:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.174909:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.174937:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb38c expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826298.174967:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826298.174990:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2:0x0].0x0 since=2936s v=(0 0) 00010000:00010000:2.0:1787826298.174996:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.175008:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb38c expref: 11 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.175033:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb38c expref: 11 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.175056:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2200, rc 0) 00000100:00100000:2.0:1787826298.175305:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789586432:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 413us (15591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.175322:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6079 00000100:00100000:2.0:1787826298.177300:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.179799:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:38203:x1874668778591488:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5833us (17992us total) trans 4294968121 rc 0/0 00000100:00100000:1.0:1787826298.179811:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6078 00000100:00100000:3.0:1787826298.180757:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789586944 00000100:00100000:3.0:1787826298.180768:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789586944 00002000:00100000:3.0:1787826298.180843:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xb1:0x0] (0->157) req@ffff9bbe0dbc4f00 x1874668789586944/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/0 e 0 to 0 dl 1787826309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826298.180881:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dbc4f00 with x1874668789586944 ext(0->157) 00002000:00010000:3.0:1787826298.180889:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0dbc4f00 00000100:00100000:3.0:1787826298.180912:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1540 00000100:00100000:3.0:1787826298.180922:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789586944:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.182632:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789586944:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1699us (1959us total) trans 4294968122 rc 0/0 00000100:00100000:3.0:1787826298.182649:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1540 00002000:00100000:3.0:1787826298.182666:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xb1:0x0] (0->157) req@ffff9bbe0dbc4f00 x1874668789586944/t4294968122(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/448 e 0 to 0 dl 1787826309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826298.182677:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dbc4f00 with x1874668789586944 ext(0->157) 00002000:00010000:3.0:1787826298.182684:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0dbc4f00 00000100:00100000:3.0:1787826298.183452:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.183499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.183595:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789587072 00000100:00100000:1.0:1787826298.183606:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789587072 00000100:00100000:1.0:1787826298.183668:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789587328 00000100:00100000:1.0:1787826298.183672:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789587328 00000100:00100000:1.0:1787826298.183699:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110817 00000100:00100000:1.0:1787826298.183709:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84138:x1874668789587072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.183736:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.183763:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349968b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb393 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.183879:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499692 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.183897:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499692 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.183912:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499692 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826298.183969:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x106:0x0]: returning size 0 00000004:00200000:1.0:1787826298.183974:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826298.183997:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499692 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.184029:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349968b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x106:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb393 expref: 84 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.184050:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499692 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x106:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb393 expref: 83 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.184134:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:1.0:1787826298.184138:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826298.184144:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7400, rc 0) 00000100:00100000:1.0:1787826298.184390:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84138:x1874668789587072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 681us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.184397:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110817 00000100:00100000:2.0:1787826298.187011:0:38203:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:38203:1874668778591488:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787826298.187038:0:38203:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xb2:0x0]-[0x280000401:0xe1:0x0] 00000100:00100000:1.0:1787826298.193495:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789587456 00000100:00100000:1.0:1787826298.193508:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789587456 00000100:00100000:3.0:1787826298.193556:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789587584 00000100:00100000:3.0:1787826298.193561:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789587584 00000100:00100000:3.0:1787826298.193610:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6080 00000100:00100000:3.0:1787826298.193623:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84137:x1874668789587584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.193646:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.193683:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb39a expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.193846:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb38c expref: 12 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.193899:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.193905:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.193912:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb39a expref: 12 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.194014:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb38c expref: 12 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.194032:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb38c expref: 12 pid: 25038 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.194052:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778591616:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.194287:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.194302:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110819 00000100:00100000:1.0:1787826298.194315:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84139:x1874668789587456:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.196588:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789587712 00000100:00100000:3.0:1787826298.196600:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789587712 00000100:00100000:3.0:1787826298.196693:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6081 00000100:00100000:3.0:1787826298.196705:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789587712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.196944:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.196974:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3a1 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826298.197011:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826298.197038:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2:0x0].0x0 since=2936s v=(0 0) 00010000:00010000:3.0:1787826298.197043:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.197056:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a1 expref: 16 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.197087:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a1 expref: 16 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.197105:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:3.0:1787826298.197181:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789587712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 478us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.197200:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6081 00000020:00080000:1.0:1787826298.200965:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970855 committed batchid 4294970852 00000100:00100000:2.0:1787826298.201131:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84139:x1874668789587456:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 6812us (7738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.201142:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110819 00000020:00080000:1.0:1787826298.201144:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970852 00000100:00100000:1.0:1787826298.201359:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.201380:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778591616:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.201385:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789587840 00000100:00100000:1.0:1787826298.201392:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789587840 00010000:00010000:2.0:1787826298.201420:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb39a expref: 13 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.201425:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb38c expref: 13 pid: 25038 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.201459:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607e00, rc 0) 00000100:00100000:1.0:1787826298.201467:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2870 00000100:00100000:1.0:1787826298.201478:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40514450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789587840:12345-192.168.203.9@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787826298.201489:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84137:x1874668789587584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 7871us (8020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.201497:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6080 00010000:00010000:1.0:1787826298.201499:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.201526:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb38c expref: 12 pid: 25038 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.201541:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb38c expref: 12 pid: 25038 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.201572:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fbf6c6f/0x68019081f3499684 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb38c expref: 12 pid: 25038 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.201589:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.201594:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.201604:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb39a expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.201625:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb39a expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.202155:0:45686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb39a expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.202176:0:45686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778591744:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826298.202258:0:45686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.202329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826298.203615:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.203636:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.203644:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.203723:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.203797:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.203812:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.203977:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x101:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826298.203982:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.203989:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.203996:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349940e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x101:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204032:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204038:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204043:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204048:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.204051:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204056:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204234:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x103:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826298.204237:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.204241:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204252:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349942a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x103:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204270:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204278:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204285:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204290:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.204293:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204298:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204305:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x102:0x0].0x0 (ffff9bbe1342f000) 00010000:00010000:3.0:1787826298.204307:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.204310:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204389:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499423 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x102:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204408:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204414:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204420:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204425:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.204428:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204444:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204452:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:3.0:1787826298.204454:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826298.204457:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204463:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349958f lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204475:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204481:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204486:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204491:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.204493:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204503:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204510:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:3.0:1787826298.204512:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826298.204515:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204520:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34995ce lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204531:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349961b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204537:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349961b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204543:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349961b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204548:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.204551:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349961b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204556:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349961b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204564:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:3.0:1787826298.204566:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826298.204569:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349961b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.204579:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349961b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.205274:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789588096 00000100:00100000:2.0:1787826298.205291:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789588096 00000100:00100000:2.0:1787826298.205376:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110820 00000100:00100000:2.0:1787826298.205389:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84138:x1874668789588096:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.205562:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84138:x1874668789588096:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 176us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.205572:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110820 00000100:00100000:2.0:1787826298.207577:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789588224 00000100:00100000:2.0:1787826298.207589:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789588224 00000100:00100000:2.0:1787826298.207655:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6082 00000100:00100000:2.0:1787826298.207665:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789588224:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.211985:0:45686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778591744:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826298.212022:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826298.212102:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40514450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789587840:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 10624us (10742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.212108:0:25758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789588352 00000100:00100000:1.0:1787826298.212114:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2870 00000100:00100000:2.0:1787826298.212117:0:25758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789588352 00002000:00100000:2.0:1787826298.212179:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xb2:0x0] (0->157) req@ffff9bbe0dbc5a40 x1874668789588352/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/0 e 0 to 0 dl 1787826309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826298.212191:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dbc5a40 with x1874668789588352 ext(0->157) 00002000:00010000:2.0:1787826298.212197:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0dbc5a40 00000100:00100000:2.0:1787826298.212231:0:25758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1541 00000100:00100000:2.0:1787826298.212242:0:25758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789588352:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.213919:0:25758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789588352:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1667us (1903us total) trans 4294968108 rc 0/0 00000100:00100000:2.0:1787826298.213934:0:25758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1541 00002000:00100000:2.0:1787826298.213947:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xb2:0x0] (0->157) req@ffff9bbe0dbc5a40 x1874668789588352/t4294968108(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/448 e 0 to 0 dl 1787826309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826298.213959:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dbc5a40 with x1874668789588352 ext(0->157) 00002000:00010000:2.0:1787826298.213966:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0dbc5a40 00000001:00080000:3.0:1787826298.214906:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968122 is committed 00000001:00080000:3.0:1787826298.214923:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968121 is committed 00000100:00100000:2.0:1787826298.215421:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789588224:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 7750us (7945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.215605:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.215762:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789588480 00000100:00100000:1.0:1787826298.215771:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789588480 00000100:00100000:2.0:1787826298.217532:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6082 00000100:00100000:3.0:1787826298.217684:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789588608 00000100:00100000:3.0:1787826298.217692:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789588608 00000100:00100000:3.0:1787826298.217757:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110821 00000100:00100000:3.0:1787826298.217768:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84137:x1874668789588608:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.217949:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84137:x1874668789588608:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 183us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.217956:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110821 00000100:00100000:2.0:1787826298.221114:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789588736 00000100:00100000:2.0:1787826298.221125:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789588736 00000100:00100000:1.0:1787826298.221372:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6083 00000100:00100000:1.0:1787826298.221389:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84138:x1874668789588480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.221416:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.221451:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3a8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.221492:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a1 expref: 14 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.221497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826298.221509:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.221514:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.221521:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a8 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.221564:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a1 expref: 14 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.221580:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a1 expref: 14 pid: 45681 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.221598:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778591872:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.221710:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.221873:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789588992 00000100:00100000:1.0:1787826298.221878:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789588992 00000100:00100000:1.0:1787826298.221920:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110822 00000100:00100000:1.0:1787826298.221928:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84139:x1874668789588992:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.221984:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.222015:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499637 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x104:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb362 expref: 31 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.222035:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826298.222041:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826298.222294:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 3/0,1 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.222311:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.222323:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826298.222493:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003592022e reply state 0000000049aabf6a transno 8590016014 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.222508:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.222513:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826298.222516:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826298.222519:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826298.222678:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84139:x1874668789588992:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 749us (1178us total) trans 8590016014 rc 0/0 00000100:00100000:1.0:1787826298.222686:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110822 00000100:00100000:2.0:1787826298.222929:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6084 00000100:00100000:2.0:1787826298.222944:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789588736:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.225543:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778591872:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.225587:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a8 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.225613:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826298.225868:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84138:x1874668789588480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4467us (10245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.225879:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6083 00000100:00100000:2.0:1787826298.230374:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789589120 00000100:00100000:2.0:1787826298.230385:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789589120 00010000:00010000:2.0:1787826298.230448:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a1 expref: 14 pid: 45681 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.230501:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2871 00000100:00100000:2.0:1787826298.230513:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789589120:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.230535:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.230565:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a1 expref: 14 pid: 45681 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.230584:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a1 expref: 14 pid: 45681 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.230613:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f34996a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a1 expref: 14 pid: 45681 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.230636:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.230641:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.230722:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a8 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.230750:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a8 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.230802:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a8 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.230819:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f7c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778592000:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826298.230947:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.233402:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789588736:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 10450us (12488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.233417:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6084 00000100:00100000:3.0:1787826298.235664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.235810:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f7c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778592000:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826298.235839:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.235919:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789589120:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5407us (5642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.235931:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2871 00000100:00100000:3.0:1787826298.237056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.238971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.239912:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789589248 00000100:00100000:1.0:1787826298.239920:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789589248 00000100:00100000:2.0:1787826298.240086:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789589504 00000100:00100000:2.0:1787826298.240092:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789589504 00000100:00100000:2.0:1787826298.240173:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110823 00000100:00100000:2.0:1787826298.240196:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84137:x1874668789589504:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.240216:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110824 00000100:00100000:1.0:1787826298.240223:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84139:x1874668789589248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.240236:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.240265:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3af expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.240290:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.240320:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499676 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x105:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb385 expref: 34 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.240344:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:1.0:1787826298.240346:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3af expref: 33 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.240350:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826298.240361:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3af expref: 33 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.240375:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x105:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.240380:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826298.240382:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.240385:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00010000:00010000:2.0:1787826298.240385:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.240393:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.240476:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84139:x1874668789589248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 253us (4825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.240483:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110824 00000004:00010000:2.0:1787826298.240558:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e07a981 reply state 000000008956dd91 transno 8590016015 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.240572:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.240578:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:2.0:1787826298.240580:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826298.240582:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826298.240677:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84137:x1874668789589504:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 494us (3987us total) trans 8590016015 rc 0/0 00000100:00100000:2.0:1787826298.240684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110823 00000100:00100000:2.0:1787826298.246449:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.246644:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789589760 00000100:00100000:3.0:1787826298.246655:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789589760 00000100:00100000:3.0:1787826298.247502:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6085 00000100:00100000:3.0:1787826298.247521:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789589760:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826298.247659:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb1:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826298.247664:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb1:0x0] updating lvb mtime from disk: 0 -> 1787826216 00002000:00010000:3.0:1787826298.247666:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb1:0x0] updating lvb atime from disk: 0 -> 1787826216 00002000:00010000:3.0:1787826298.247668:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb1:0x0] updating lvb ctime from disk: 0 -> 1787826216 00002000:00010000:3.0:1787826298.247670:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb1:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826298.247956:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789589760:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 439us (1526us total) trans 4294968124 rc 0/0 00000100:00100000:3.0:1787826298.247966:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6085 00000100:00100000:3.0:1787826298.250601:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789589888 00000100:00100000:3.0:1787826298.250614:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789589888 00000100:00100000:3.0:1787826298.250690:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110825 00000100:00100000:1.0:1787826298.251776:0:45405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789589632:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 6515us (12810us total) trans 4294968123 rc 0/0 00000100:00100000:1.0:1787826298.251793:0:45405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1542 00002000:00100000:1.0:1787826298.251810:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xb2:0x0] (0->157) req@ffff9bbf05cbf480 x1874668789589632/t4294968123(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/448 e 0 to 0 dl 1787826309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826298.251822:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf05cbf480 with x1874668789589632 ext(0->157) 00002000:00010000:1.0:1787826298.251830:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf05cbf480 00000100:00100000:3.0:1787826298.253412:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84137:x1874668789589888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.253456:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.253486:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f34996c3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x105:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3b6 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.253564:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f34996c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3b6 expref: 35 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.253582:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f34996c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3b6 expref: 35 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.253603:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:3.0:1787826298.253607:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826298.253611:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607a00, rc 0) 00000100:00100000:3.0:1787826298.253675:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84137:x1874668789589888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2976us (3194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.253684:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110825 00000100:00100000:3.0:1787826298.255801:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789590144 00000100:00100000:3.0:1787826298.255813:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789590144 00000100:00100000:3.0:1787826298.255950:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110826 00000100:00100000:3.0:1787826298.255961:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84139:x1874668789590144:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.256049:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 3/0,1 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.256070:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f2 expref: 35 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.256081:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 4/0,1 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.256124:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f2 expref: 35 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.256141:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f2 expref: 35 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.256158:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbf840 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778592128:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.256312:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.256426:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.256640:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789590272 00000100:00100000:1.0:1787826298.256645:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789590272 00000100:00100000:1.0:1787826298.256700:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110827 00000100:00100000:1.0:1787826298.256708:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84138:x1874668789590272:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.257041:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84138:x1874668789590272:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 332us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.257049:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110827 00000100:00100000:2.0:1787826298.259828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.260082:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6086 00000100:00100000:1.0:1787826298.260096:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789590400:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787826298.264638:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968124 is committed 00000100:00100000:1.0:1787826298.264981:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789590400:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 4881us (5327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.264995:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6086 00000100:00100000:3.0:1787826298.265402:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789590656 00000100:00100000:3.0:1787826298.265412:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789590656 00010000:00010000:3.0:1787826298.265468:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f2 expref: 36 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.265510:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2872 00000100:00100000:3.0:1787826298.265520:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2399:x1874668789590656:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.265542:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.265551:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f2 expref: 36 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.265572:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f2 expref: 36 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.265601:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:3.0:1787826298.265607:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 3/0,1 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.265619:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.265629:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.265652:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826298.265683:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2399:x1874668789590656:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 165us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.265689:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2872 00000100:00100000:2.0:1787826298.265747:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789590528 00000100:00100000:2.0:1787826298.265753:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789590528 00000100:00100000:2.0:1787826298.265791:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6087 00000100:00100000:2.0:1787826298.265798:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789590528:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826298.266028:0:45681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb2:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826298.266033:0:45681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb2:0x0] updating lvb mtime from disk: 0 -> 1787826216 00002000:00010000:2.0:1787826298.266035:0:45681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb2:0x0] updating lvb atime from disk: 0 -> 1787826216 00002000:00010000:2.0:1787826298.266038:0:45681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb2:0x0] updating lvb ctime from disk: 0 -> 1787826216 00002000:00010000:2.0:1787826298.266040:0:45681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb2:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826298.266080:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789590528:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 282us (756us total) trans 4294968109 rc 0/0 00000100:00100000:2.0:1787826298.266087:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6087 00010000:00010000:1.0:1787826298.269716:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499588 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x104:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb2f2 expref: 35 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.269753:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbf840 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778592128:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.269787:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.269800:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.269806:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.269954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826298.271176:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.271191:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.271199:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.271205:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.271210:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.271218:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.271231:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826298.271233:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826298.271238:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 2/0,0 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.271245:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f34996ca lrc: 0/0,0 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.271299:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84139:x1874668789590144:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 15340us (16105us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826298.271307:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110826 00000100:00100000:2.0:1787826298.274605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.274714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.275013:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789591040 00000100:00100000:3.0:1787826298.275019:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789591040 00000100:00100000:3.0:1787826298.275074:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110829 00000100:00100000:3.0:1787826298.275087:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84138:x1874668789591040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.275121:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.275150:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.275240:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3bd expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.275264:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3bd expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.275287:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:3.0:1787826298.275290:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826298.275295:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606600, rc 0) 00000100:00100000:3.0:1787826298.275380:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84138:x1874668789591040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 297us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.275388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110829 00000100:00100000:2.0:1787826298.281427:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.281726:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.281755:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.281838:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789591680 00000100:00100000:1.0:1787826298.281883:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789591680 00010000:00010000:1.0:1787826298.281947:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb377 expref: 14 pid: 45681 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.281989:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2873 00000100:00100000:1.0:1787826298.281999:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789591680:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.282020:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.282048:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb377 expref: 14 pid: 45681 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282064:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb377 expref: 14 pid: 45681 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282098:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826298.282103:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826298.282110:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282123:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282150:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826298.282222:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789591680:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 222us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.282230:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2873 00010000:00010000:1.0:1787826298.282289:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349965a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb377 expref: 13 pid: 45681 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.282305:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778592256:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.282341:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282359:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282366:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282391:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282400:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282408:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282416:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826298.282420:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282440:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282453:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.282467:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f34996df lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.282521:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789591168:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 7271us (7931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.282530:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6088 00000100:00100000:1.0:1787826298.282547:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789591552 00000100:00100000:1.0:1787826298.282551:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789591552 00000100:00100000:1.0:1787826298.282581:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6089 00000100:00100000:1.0:1787826298.282588:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789591552:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826298.282784:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb2:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826298.282787:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb2:0x0] updating lvb mtime from disk: 0 -> 1787826216 00002000:00010000:1.0:1787826298.282790:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb2:0x0] updating lvb atime from disk: 0 -> 1787826216 00002000:00010000:1.0:1787826298.282792:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb2:0x0] updating lvb ctime from disk: 0 -> 1787826216 00002000:00010000:1.0:1787826298.282794:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb2:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826298.282819:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789591552:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 230us (1092us total) trans 4294968125 rc 0/0 00000100:00100000:1.0:1787826298.282828:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6089 00000100:00100000:2.0:1787826298.287116:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.288001:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.289046:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789592192 00000100:00100000:2.0:1787826298.289057:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789592192 00000100:00100000:2.0:1787826298.289261:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110832 00000100:00100000:2.0:1787826298.289274:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84139:x1874668789592192:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.289351:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.289369:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.289384:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.289618:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.289631:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3af expref: 39 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.289641:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 4/0,1 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.289674:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3af expref: 39 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.289688:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3af expref: 39 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.289705:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778592640:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.290172:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.291168:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.291287:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789592320 00000100:00100000:3.0:1787826298.291296:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789592320 00010000:00010000:3.0:1787826298.291403:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34995b2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x105:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb300 expref: 40 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.291575:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2874 00000100:00100000:3.0:1787826298.291586:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789592320:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.291603:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.291611:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34995b2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x105:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb300 expref: 40 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.291627:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34995b2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x105:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb300 expref: 40 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.291653:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34995b2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x105:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb300 expref: 40 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.291679:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:3.0:1787826298.291685:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34996e6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x105:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.291696:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34996e6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.291705:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f34996e6 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.291738:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826298.292483:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789592320:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 893us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.292494:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2874 00000100:00100000:1.0:1787826298.293419:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.293534:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778592640:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826298.293562:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.294383:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f34996ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.294391:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f34996ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.294443:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f34996ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.294450:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f34996ed lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.294457:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f34996ed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.294462:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.294466:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f34996ed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.294474:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f34996ed lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.294484:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:1.0:1787826298.294487:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826298.294490:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f34996ed lrc: 2/0,0 mode: --/PW res: [0x200000403:0x106:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.294496:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f34996ed lrc: 0/0,0 mode: --/PW res: [0x200000403:0x106:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.294539:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84138:x1874668789591936:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 7035us (7441us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826298.294547:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110831 00000100:00100000:2.0:1787826298.295492:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.295692:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789592576 00000100:00100000:3.0:1787826298.295701:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789592576 00010000:00010000:3.0:1787826298.295741:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3af expref: 36 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.295784:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2876 00000100:00100000:3.0:1787826298.295793:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789592576:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.295807:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.296052:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3af expref: 36 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.296067:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3af expref: 36 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.296092:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34996b5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3af expref: 36 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.296108:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:3.0:1787826298.296114:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.296125:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.296134:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.296169:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826298.296412:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.296422:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826298.296607:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016017 00000001:00080000:2.0:1787826298.296753:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016018 00000001:00080000:2.0:1787826298.296792:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016019 00000100:00100000:2.0:1787826298.297083:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778592768:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826298.297166:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.297203:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.297790:0:6516:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968121 gen 2 00000004:00080000:2.0:1787826298.297798:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968120 committed transno 4294968121 00000100:00100000:2.0:1787826298.297881:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778592768:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787826298.298387:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016020 00000100:00100000:2.0:1787826298.298474:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778592896:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826298.298525:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.298566:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778592896 00000100:00100000:2.0:1787826298.298572:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778592896 00000100:00100000:2.0:1787826298.298615:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3254 00000100:00100000:2.0:1787826298.298623:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6516:x1874668778592896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826298.298747:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6516:x1874668778592896:12345-0@lo:1000:mdt00_001.0 Request processed in 125us (222us total) trans 4294968126 rc 0/0 00000100:00100000:2.0:1787826298.298755:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3254 00000100:00100000:2.0:1787826298.298783:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.298804:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778592896:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787826298.299135:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016021 00010000:00010000:2.0:1787826298.299166:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299179:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299187:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299194:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.299201:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299210:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299229:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826298.299233:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.299238:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299245:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34996fb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299274:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62000/0x68019081f349905d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299281:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62000/0x68019081f349905d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299287:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62000/0x68019081f349905d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299292:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3fd62000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.299295:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62000/0x68019081f349905d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299300:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62000/0x68019081f349905d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299308:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd3:0x0].0x0 (ffff9bbf1127fe00) 00010000:00010000:2.0:1787826298.299311:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.299315:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62000/0x68019081f349905d lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299320:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62000/0x68019081f349905d lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299347:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299362:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299373:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299381:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299387:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299393:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299398:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.299401:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299408:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299415:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd3:0x0].0x0 (ffff9bbf1127fe00) 00010000:00010000:2.0:1787826298.299417:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.299421:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299427:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499702 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299450:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299457:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299463:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299469:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.299471:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299478:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299486:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd3:0x0].0x0 (ffff9bbf1127fe00) 00010000:00010000:2.0:1787826298.299489:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826298.299492:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.299498:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34996f4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.300153:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+40:84139:x1874668789592192:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 10876us (12145us total) trans 8590016022 rc 0/0 00000100:00100000:2.0:1787826298.300166:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110832 00000020:00080000:2.0:1787826298.300173:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826298.301195:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.301264:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789592576:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5468us (5773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.301278:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2876 00000100:00100000:1.0:1787826298.301459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.301574:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789592704 00000100:00100000:2.0:1787826298.301584:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789592704 00000100:00100000:2.0:1787826298.301644:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789592832 00000100:00100000:2.0:1787826298.301647:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789592832 00000100:00100000:2.0:1787826298.301677:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6090 00000100:00100000:2.0:1787826298.301686:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789592704:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.301737:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.301761:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb39a expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.301770:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.301775:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826298.301780:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.302065:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb39a expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.302084:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb39a expref: 10 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.302103:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16079a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778593024:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.302192:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d566c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.302218:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6091 00000100:00100000:2.0:1787826298.302227:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789592832:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.302254:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.302269:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a8 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.302277:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.302280:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826298.302285:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.302310:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a8 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.302320:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a8 expref: 13 pid: 8432 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.302331:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778593152:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.302358:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.307401:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789593088 00000100:00100000:3.0:1787826298.307407:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789593088 00010000:00010000:3.0:1787826298.307456:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f34996a7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3a8 expref: 14 pid: 8432 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.307577:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778593152:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.307610:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308369:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f3499699 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb39a expref: 10 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.308383:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16079a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778593024:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.308400:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308412:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308420:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308457:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308467:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308476:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308483:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826298.308488:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308499:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308512:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.308526:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f3499709 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.308582:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789592704:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 6897us (7392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.308590:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6090 00000100:00100000:2.0:1787826298.312048:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:2.0:1787826298.312953:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.312975:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.313016:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.313025:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.313035:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.313049:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826298.313054:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.313070:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.313095:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.313103:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f3499710 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.313229:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789592832:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 10998us (11765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.313242:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6091 00000100:00100000:3.0:1787826298.313743:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789593344 00000100:00100000:3.0:1787826298.313754:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789593344 00000100:00100000:3.0:1787826298.313910:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2545 00000100:00100000:3.0:1787826298.313922:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84139:x1874668789593344:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787826298.314290:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x104:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826298.315493:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016023 00010000:00010000:3.0:1787826298.315707:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.315729:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.315744:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.315755:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.315762:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.315769:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.315794:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826298.315942:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84139:x1874668789593344:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 2015us (3909us total) trans 8590016024 rc 0/0 00000100:00100000:3.0:1787826298.315954:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2545 00000020:00080000:3.0:1787826298.315962:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787826298.316535:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826298.316547:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.316558:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826298.316562:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.316572:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.316589:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826298.316593:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826298.316598:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.316609:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499717 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.316623:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826298.316625:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826298.316627:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826298.317785:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.319945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.333756:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789593856 00000100:00100000:1.0:1787826298.333780:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789593856 00000100:00100000:1.0:1787826298.333946:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110834 00000100:00100000:1.0:1787826298.333960:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84138:x1874668789593856:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.334085:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.334108:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.334134:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.334357:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.334372:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3bd expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.334383:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.334443:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3bd expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.334459:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3bd expref: 44 pid: 6517 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.334478:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41276940 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778593408:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.334604:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.335303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.335414:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7a580 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778593280:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.335454:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.335784:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f34996c3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3b6 expref: 45 pid: 12105 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.335804:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:0.0:1787826298.335809:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.335819:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.335828:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.335866:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826298.335917:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+44:2401:x1874668789593984:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 191us (618us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826298.336201:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.336209:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826298.336578:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016025 00000001:00080000:1.0:1787826298.336712:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016027 00000001:00080000:1.0:1787826298.336753:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016028 00000100:00100000:0.0:1787826298.337315:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2879 00000100:00100000:1.0:1787826298.337551:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778593536:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826298.337677:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826298.337803:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778593536 00000100:00100000:1.0:1787826298.337811:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778593536 00000100:00100000:0.0:1787826298.337823:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.337886:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3255 00000100:00100000:0.0:1787826298.337897:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778593536:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826298.338028:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778593536:12345-0@lo:1000:mdt00_005.0 Request processed in 133us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.338101:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3255 00000100:00100000:2.0:1787826298.338177:0:23845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968107 gen 2 00000004:00080000:2.0:1787826298.338266:0:23845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968105 committed transno 4294968107 00000004:00080000:2.0:1787826298.338291:0:23845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968106 committed transno 4294968107 00000100:00100000:2.0:1787826298.338313:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778593536:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1787826298.338573:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016029 00000100:00100000:2.0:1787826298.338656:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778593664:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826298.338690:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.338711:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.339811:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778593664 00000100:00100000:3.0:1787826298.339836:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778593664 00000100:00100000:3.0:1787826298.339926:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3256 00000100:00100000:3.0:1787826298.339937:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778593664:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787826298.340183:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:23845:x1874668778593664:12345-0@lo:1000:mdt00_005.0 Request processed in 237us (1479us total) trans 4294968110 rc 0/0 00000100:00100000:3.0:1787826298.340192:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3256 00000100:00100000:0.0:1787826298.340282:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778593664:0@lo:1000:mdt00_005.0 00000001:00080000:0.0:1787826298.340391:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016030 00010000:00010000:0.0:1787826298.340441:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340453:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340462:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340468:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.340473:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340482:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340503:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:0.0:1787826298.340507:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.340513:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340519:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499725 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340553:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62400/0x68019081f349904f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340559:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62400/0x68019081f349904f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340565:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62400/0x68019081f349904f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340569:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3fd62400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.340572:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62400/0x68019081f349904f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340581:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62400/0x68019081f349904f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340589:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd1:0x0].0x0 (ffff9bbf1127f200) 00010000:00010000:0.0:1787826298.340591:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.340594:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62400/0x68019081f349904f lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340600:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62400/0x68019081f349904f lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340628:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340641:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340668:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340676:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340682:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340688:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340701:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.340704:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340711:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340718:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd1:0x0].0x0 (ffff9bbf1127f200) 00010000:00010000:0.0:1787826298.340720:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.340730:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340736:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349973a lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340745:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349971e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340758:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349971e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340764:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349971e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340776:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.340779:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349971e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340785:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349971e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xd1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340792:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd1:0x0].0x0 (ffff9bbf1127f200) 00010000:00010000:0.0:1787826298.340795:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826298.340798:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349971e lrc: 2/0,0 mode: --/PW res: [0x200000403:0xd1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.340809:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349971e lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.340980:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84137:x1874668789593600:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 22312us (23201us total) trans 8590016031 rc 0/0 00000100:00100000:0.0:1787826298.340990:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110833 00000020:00080000:0.0:1787826298.340995:0:23845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826298.344585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.344711:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789594112 00000100:00100000:2.0:1787826298.344723:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789594112 00010000:00010000:2.0:1787826298.344777:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3bd expref: 48 pid: 6517 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.344817:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41276940 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778593408:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.344833:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2880 00000100:00100000:2.0:1787826298.344845:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2401:x1874668789594112:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.344887:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.344901:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.344911:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3bd expref: 48 pid: 6517 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.344925:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3bd expref: 48 pid: 6517 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.344954:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f34996d8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3bd expref: 48 pid: 6517 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.344973:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:2.0:1787826298.344979:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.344989:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.344998:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.345030:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.345105:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2401:x1874668789594112:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 261us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.345113:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2880 00010000:00010000:1.0:1787826298.345450:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.345460:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826298.345615:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016026 00000001:00080000:1.0:1787826298.345753:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016032 00000001:00080000:1.0:1787826298.345794:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016033 00000100:00100000:2.0:1787826298.346016:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778593792:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787826298.346102:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.346145:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.346327:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778593792 00000100:00100000:1.0:1787826298.346335:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778593792 00000100:00100000:1.0:1787826298.346390:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257 00000100:00100000:1.0:1787826298.346400:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778593792:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787826298.346642:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778593792:12345-0@lo:1000:mdt00_006.0 Request processed in 243us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.346650:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257 00000100:00100000:2.0:1787826298.346778:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778593792:0@lo:1000:mdt00_006.0 00000001:00080000:2.0:1787826298.346989:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016034 00000100:00100000:2.0:1787826298.347055:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778593920:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787826298.347106:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.347131:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.347186:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778593920 00000100:00100000:0.0:1787826298.347198:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778593920 00000100:00100000:0.0:1787826298.347242:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3258 00000100:00100000:0.0:1787826298.347250:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778593920:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1787826298.347388:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:25756:x1874668778593920:12345-0@lo:1000:mdt00_006.0 Request processed in 139us (282us total) trans 4294968127 rc 0/0 00000100:00100000:0.0:1787826298.347396:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3258 00000100:00100000:1.0:1787826298.347653:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778593920:0@lo:1000:mdt00_006.0 00000001:00080000:1.0:1787826298.347732:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016035 00010000:00010000:1.0:1787826298.347768:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347780:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347788:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347795:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.347800:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347809:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347829:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:1.0:1787826298.347833:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.347839:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347846:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499733 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347909:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62200/0x68019081f3499056 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347916:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62200/0x68019081f3499056 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347922:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62200/0x68019081f3499056 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347926:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3fd62200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.347929:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62200/0x68019081f3499056 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347936:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62200/0x68019081f3499056 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347945:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd2:0x0].0x0 (ffff9bbf1127fd00) 00010000:00010000:1.0:1787826298.347947:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.347950:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62200/0x68019081f3499056 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347957:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd62200/0x68019081f3499056 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.347986:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348005:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348015:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348023:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348029:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348035:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348040:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.348043:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348049:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348056:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd2:0x0].0x0 (ffff9bbf1127fd00) 00010000:00010000:1.0:1787826298.348059:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.348061:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348066:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499741 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348076:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348094:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348100:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348105:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.348108:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348114:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348121:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd2:0x0].0x0 (ffff9bbf1127fd00) 00010000:00010000:1.0:1787826298.348124:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826298.348127:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 2/0,0 mode: --/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.348133:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349972c lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.349619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.350112:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789594368 00000100:00100000:0.0:1787826298.350126:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789594368 00000100:00100000:0.0:1787826298.350202:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2546 00000100:00100000:0.0:1787826298.350213:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+52:84137:x1874668789594368:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1787826298.350466:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826298.350473:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000004:00080000:0.0:1787826298.350531:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x105:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826298.350578:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016037 00010000:00010000:0.0:1787826298.350625:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x105:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.350646:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826298.350657:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9661 count 103 00010000:00010000:0.0:1787826298.350661:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826298.350667:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1787826298.350675:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.350685:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.350693:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.350722:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826298.350808:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826298.350819:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.350829:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84137:x1874668789594368:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 615us (1218us total) trans 8590016038 rc 0/0 00010000:00010000:3.0:1787826298.350832:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826298.350839:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.350843:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2546 00010000:00010000:3.0:1787826298.350881:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826298.350898:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826298.350901:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:3.0:1787826298.350906:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826298.350912:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.350913:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778594048:192.168.203.9@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1787826298.350926:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499748 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x105:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.350942:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826298.350944:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826298.350946:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826298.350987:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.354842:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84138:x1874668789593856:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 17062us (31078us total) trans 8590016036 rc 0/0 00000100:00100000:1.0:1787826298.354890:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110834 00000020:00080000:1.0:1787826298.354901:0:25756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826298.355122:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.355245:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789594624 00000100:00100000:0.0:1787826298.355258:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789594624 00000100:00100000:1.0:1787826298.355400:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778594048:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826298.356155:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2547 00000100:00100000:0.0:1787826298.356173:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84138:x1874668789594624:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787826298.356498:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x106:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826298.356543:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016039 00010000:00010000:0.0:1787826298.356582:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.356604:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.356618:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.356633:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.356641:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.356647:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.356672:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826298.356710:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826298.356732:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.356741:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826298.356746:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.356757:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.356776:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:1.0:1787826298.356780:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826298.356787:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 1/0,0 mode: --/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.356793:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349974f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.356802:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84138:x1874668789594624:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 633us (1679us total) trans 8590016040 rc 0/0 00010000:00010000:1.0:1787826298.356807:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826298.356811:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826298.356814:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2547 00010000:00010000:1.0:1787826298.356815:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787826298.356823:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826298.360974:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.361033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.361143:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789594752 00000100:00100000:0.0:1787826298.361157:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789594752 00000100:00100000:0.0:1787826298.361235:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789594880 00000100:00100000:0.0:1787826298.361239:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789594880 00000100:00100000:0.0:1787826298.361273:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110835 00000100:00100000:3.0:1787826298.361283:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110836 00000100:00100000:0.0:1787826298.361287:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84145:x1874668789594752:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.361301:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84146:x1874668789594880:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826298.361337:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd5:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1787826298.361337:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd6:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826298.361532:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84146:x1874668789594880:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 238us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.361541:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110836 00000100:00100000:0.0:1787826298.365017:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84145:x1874668789594752:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 3716us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.365100:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110835 00000100:00100000:2.0:1787826298.365455:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.365572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.366487:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789595008 00000100:00100000:1.0:1787826298.366503:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789595008 00000100:00100000:1.0:1787826298.366559:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789595136 00000100:00100000:1.0:1787826298.366562:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789595136 00000100:00100000:1.0:1787826298.366593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110837 00000100:00100000:1.0:1787826298.366606:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84144:x1874668789595008:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826298.366649:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826298.366801:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84144:x1874668789595008:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 197us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.366808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110837 00000100:00100000:1.0:1787826298.366827:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110838 00000100:00100000:1.0:1787826298.366835:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84146:x1874668789595136:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.366928:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.366949:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.366963:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.366981:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.366989:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.366995:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367020:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367028:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367035:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826298.367071:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd6:0x0]: returning size 158 00000004:00200000:1.0:1787826298.367076:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826298.367093:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367107:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367114:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367121:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367128:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367136:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.367141:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367150:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367164:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826298.367168:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.367173:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367185:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499756 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367199:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367206:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367212:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367218:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.367221:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367228:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367235:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8a49a9b9 (ffff9bbe16e56100) 00010000:00010000:1.0:1787826298.367238:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.367241:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367247:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349975d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8a49a9b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367261:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367268:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367274:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367279:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.367282:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367288:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367295:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd6:0x0].0x0 (ffff9bbf1127f000) 00010000:00010000:1.0:1787826298.367298:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.367300:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.367306:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499764 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.371696:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84146:x1874668789595136:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 4843us (6106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.371716:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110838 00000100:00100000:0.0:1787826298.373754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.373839:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789595264 00000100:00100000:2.0:1787826298.373877:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789595264 00000100:00100000:2.0:1787826298.373943:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110839 00000100:00100000:2.0:1787826298.373952:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84145:x1874668789595264:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.374051:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374072:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374086:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374103:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374110:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374117:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374148:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374155:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374161:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.374217:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd5:0x0]: returning size 158 00000004:00200000:2.0:1787826298.374223:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826298.374237:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374249:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374256:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374263:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374269:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.374274:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374282:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374295:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826298.374298:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.374302:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374308:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349976b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374320:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374331:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374337:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374342:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.374344:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374350:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374356:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xde433e23 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826298.374358:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.374360:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374366:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499772 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xde433e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374380:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374385:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374390:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374395:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.374398:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374405:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374411:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd5:0x0].0x0 (ffff9bbf1127f800) 00010000:00010000:2.0:1787826298.374413:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.374415:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.374421:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499779 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.374508:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84145:x1874668789595264:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 556us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.374516:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110839 00000100:00100000:2.0:1787826298.375356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.375500:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789595648 00000100:00100000:0.0:1787826298.375509:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789595648 00000100:00100000:0.0:1787826298.375558:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110840 00000100:00100000:0.0:1787826298.375568:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84144:x1874668789595648:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.375639:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375657:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375669:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375687:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375695:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375701:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375730:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375739:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375746:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.375791:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd4:0x0]: returning size 158 00000004:00200000:0.0:1787826298.375796:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826298.375807:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375825:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375831:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375837:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375843:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.375848:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375884:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375898:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826298.375901:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.375906:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375913:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499780 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375927:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375933:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375938:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375944:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.375947:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375952:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375959:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x7d4bee2f (ffff9bbf0ee81700) 00010000:00010000:0.0:1787826298.375962:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.375964:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375970:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499787 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d4bee2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375985:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375991:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.375996:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.376000:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.376002:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.376007:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.376031:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd4:0x0].0x0 (ffff9bbf1127ff00) 00010000:00010000:0.0:1787826298.376034:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.376037:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.376042:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349978e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.376127:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84144:x1874668789595648:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 558us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.376134:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110840 00000100:00100000:2.0:1787826298.385000:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.385042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.385216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.391023:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789595520 00000100:00100000:0.0:1787826298.391043:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789595520 00000100:00100000:0.0:1787826298.391149:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789596032 00000100:00100000:0.0:1787826298.391154:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789596032 00000100:00100000:0.0:1787826298.391185:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789596160 00000100:00100000:0.0:1787826298.391188:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789596160 00000100:00100000:0.0:1787826298.391449:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110841 00000100:00100000:0.0:1787826298.391464:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84146:x1874668789595520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.391494:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.391523:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499795 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3c4 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391674:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391691:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391709:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.391722:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd6:0x0]: returning size 158 00010000:00010000:0.0:1787826298.391828:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391837:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391844:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391877:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.391883:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391892:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391906:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd6:0x0].0x0 (ffff9bbf1127f000) 00010000:00010000:0.0:1787826298.391909:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826298.391914:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391921:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349979c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391973:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499795 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3c4 expref: 59 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.391990:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826298.391992:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826298.391997:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499795 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3c4 expref: 59 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.392008:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc 0) 00000100:00100000:0.0:1787826298.392101:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84146:x1874668789595520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 640us (7114us total) trans 8590016041 rc 301/301 00000100:00100000:2.0:1787826298.396898:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110842 00000100:00100000:2.0:1787826298.396938:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84144:x1874668789596032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.396971:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.397004:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34997aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3d2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397162:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397187:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397203:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.397216:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd4:0x0]: returning size 158 00010000:00010000:2.0:1787826298.397338:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397346:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397353:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397358:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.397363:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397370:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397385:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd4:0x0].0x0 (ffff9bbf1127ff00) 00010000:00010000:2.0:1787826298.397388:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826298.397394:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397400:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f34997b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397468:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34997aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3d2 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397479:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826298.397481:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826298.397485:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f34997aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3d2 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.397494:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826298.397570:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84144:x1874668789596032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 656us (12527us total) trans 8590016042 rc 301/301 00000100:00100000:2.0:1787826298.397577:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110842 00000100:00100000:2.0:1787826298.397622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110843 00000100:00100000:2.0:1787826298.397631:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84145:x1874668789596160:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.397642:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.397652:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34997bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.397757:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110841 00010000:00010000:2.0:1787826298.398616:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398635:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398645:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.398659:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd5:0x0]: returning size 158 00010000:00010000:2.0:1787826298.398737:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398745:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398751:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398758:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.398762:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398770:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398780:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd5:0x0].0x0 (ffff9bbf1127f800) 00010000:00010000:2.0:1787826298.398783:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826298.398787:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398793:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34997c6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398837:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34997bf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3cb expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.398848:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826298.399422:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826298.399440:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f34997bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3cb expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.399566:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826298.399683:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84145:x1874668789596160:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2050us (14464us total) trans 8590016043 rc 301/301 00000100:00100000:2.0:1787826298.399693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110843 00000100:00100000:2.0:1787826298.402394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.403325:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789596288 00000100:00100000:3.0:1787826298.403340:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789596288 00000100:00100000:3.0:1787826298.403423:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110844 00000100:00100000:3.0:1787826298.403445:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84146:x1874668789596288:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826298.403502:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd6:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826298.403673:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84146:x1874668789596288:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 240us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.403682:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110844 00000100:00100000:3.0:1787826298.404785:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.404882:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.404912:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789596416 00000100:00100000:3.0:1787826298.404913:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789596544 00000100:00100000:3.0:1787826298.404921:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789596544 00000100:00100000:2.0:1787826298.404922:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789596416 00000100:00100000:2.0:1787826298.404980:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110845 00000100:00100000:2.0:1787826298.404993:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84145:x1874668789596416:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.405014:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110846 00000100:00100000:3.0:1787826298.405023:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84144:x1874668789596544:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826298.405028:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd5:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1787826298.405046:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826298.405146:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84144:x1874668789596544:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 122us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.405147:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84145:x1874668789596416:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 155us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.405164:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110846 00000100:00100000:2.0:1787826298.408167:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110845 00000100:00100000:3.0:1787826298.409721:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.409818:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789596800 00000100:00100000:0.0:1787826298.409830:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789596800 00000100:00100000:0.0:1787826298.409938:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110847 00000100:00100000:0.0:1787826298.409950:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84146:x1874668789596800:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.409980:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.410011:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34997d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3d9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.410783:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34997db lrc: 3/1,0 mode: --/PR res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.410803:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34997db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.410818:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34997db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.410832:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x107:0x0]: returning size 0 00010000:00010000:0.0:1787826298.410920:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34997d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3d9 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.410945:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34997db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3d9 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.410955:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81700) 00010000:00010000:0.0:1787826298.410959:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826298.410963:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc 0) 00000100:00100000:0.0:1787826298.411046:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84146:x1874668789596800:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1098us (1335us total) trans 8590016044 rc 0/0 00000100:00100000:0.0:1787826298.411055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110847 00000100:00100000:2.0:1787826298.414386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.415012:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789597056 00000100:00100000:0.0:1787826298.415026:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789597056 00000100:00100000:0.0:1787826298.415105:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110848 00000100:00100000:0.0:1787826298.415117:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84146:x1874668789597056:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.415215:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.415262:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34997db lrc: 0/0,0 mode: --/PR res: [0x200000403:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3d9 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415287:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81700) 00010000:00010000:0.0:1787826298.415300:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826298.415332:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415348:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415361:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415379:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415386:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415394:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415475:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415484:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415491:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415499:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.415504:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415513:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415523:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826298.415526:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.415531:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415537:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34997e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415547:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415553:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415559:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415565:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.415568:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415574:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415582:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x6b088831 (ffff9bbf0ee81c00) 00010000:00010000:0.0:1787826298.415584:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.415586:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.415592:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f34997f0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x6b088831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.415697:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84146:x1874668789597056:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 582us (1327us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826298.415705:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110848 00000100:00100000:3.0:1787826298.418777:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.418845:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.418927:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789597312 00000100:00100000:0.0:1787826298.418942:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789597312 00000100:00100000:2.0:1787826298.418973:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789597440 00000100:00100000:2.0:1787826298.418979:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789597440 00000100:00100000:0.0:1787826298.419032:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110849 00000100:00100000:0.0:1787826298.419046:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84145:x1874668789597312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.419075:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.419104:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f34997f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3e0 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.419721:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34997fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.419739:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34997fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.419753:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34997fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.419765:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x108:0x0]: returning size 0 00010000:00010000:0.0:1787826298.419827:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f34997f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e0 expref: 63 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.419877:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34997fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e0 expref: 62 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.419888:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81500) 00010000:00010000:0.0:1787826298.419891:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826298.419896:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3200, rc 0) 00000100:00100000:0.0:1787826298.419988:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84145:x1874668789597312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 944us (1221us total) trans 8590016045 rc 0/0 00000100:00100000:0.0:1787826298.419998:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110849 00000100:00100000:0.0:1787826298.420026:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110850 00000100:00100000:0.0:1787826298.420035:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84146:x1874668789597440:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.420061:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.420074:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349980c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3e7 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.420098:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.420109:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.420118:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.420215:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349980c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e7 expref: 63 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.420229:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e7 expref: 62 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.420235:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:0.0:1787826298.420237:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826298.420240:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:0.0:1787826298.420274:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84146:x1874668789597440:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 240us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.420281:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110850 00000100:00100000:1.0:1787826298.423951:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.423997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.428500:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789597696 00000100:00100000:3.0:1787826298.428502:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789597952 00000100:00100000:0.0:1787826298.428524:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789597696 00000100:00100000:3.0:1787826298.428524:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789597952 00000100:00100000:2.0:1787826298.429513:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110851 00000100:00100000:2.0:1787826298.429528:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84144:x1874668789597952:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.429565:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.429597:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349981a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3ee expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.430462:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499821 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.430487:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499821 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.430500:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499821 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.430513:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x109:0x0]: returning size 0 00010000:00010000:2.0:1787826298.430573:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349981a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3ee expref: 66 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.430594:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499821 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3ee expref: 65 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.430603:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826298.430606:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826298.430610:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:2.0:1787826298.430807:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84144:x1874668789597952:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1282us (6809us total) trans 8590016046 rc 0/0 00000100:00100000:2.0:1787826298.430818:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110851 00000100:00100000:2.0:1787826298.430958:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110852 00000100:00100000:2.0:1787826298.430968:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84146:x1874668789597696:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.431033:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.431045:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.431053:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826298.431167:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2149abe reply state 0000000070b78af1 transno 8590016047 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.431183:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.431501:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:2.0:1787826298.431504:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826298.431508:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826298.431571:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84146:x1874668789597696:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 605us (7630us total) trans 8590016047 rc 0/0 00000100:00100000:2.0:1787826298.431579:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110852 00000100:00100000:2.0:1787826298.435165:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.436927:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.437021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.437190:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789598464 00000100:00100000:3.0:1787826298.437205:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789598464 00000100:00100000:3.0:1787826298.437272:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3259 00000100:00100000:3.0:1787826298.437284:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2400:x1874668789598464:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826298.437357:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.437379:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499836 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3fc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437442:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437457:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437468:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437483:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437489:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437495:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437541:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437548:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437555:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437560:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.437564:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437572:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437582:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826298.437585:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.437590:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437596:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349983d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437609:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437615:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437621:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437626:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.437629:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437637:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437643:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x7607435f (ffff9bbe0a9bf400) 00010000:00010000:3.0:1787826298.437645:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.437648:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437654:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499844 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x7607435f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437680:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499836 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3fc expref: 67 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437689:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826298.437691:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826298.437694:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499836 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3fc expref: 67 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.437702:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc -2) 00000100:00100000:3.0:1787826298.437774:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2400:x1874668789598464:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 492us (753us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826298.437782:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3259 00000100:00100000:0.0:1787826298.441844:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789598080 00000100:00100000:0.0:1787826298.441877:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789598080 00000100:00100000:0.0:1787826298.441974:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789598336 00000100:00100000:0.0:1787826298.441979:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789598336 00000100:00100000:0.0:1787826298.442030:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110853 00000100:00100000:0.0:1787826298.442043:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84146:x1874668789598080:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.442071:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.442100:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb3f5 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.442176:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3f5 expref: 68 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.443007:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110854 00000100:00100000:2.0:1787826298.443026:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84144:x1874668789598336:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.443086:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.443115:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499821 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3ee expref: 68 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443137:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826298.443149:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826298.443173:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443184:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443214:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443229:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443236:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443242:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443306:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443313:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443319:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443324:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.443329:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443337:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443345:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826298.443348:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.443352:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443359:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499852 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443369:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443375:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443380:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443385:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.443388:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443394:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443401:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xc6e725b7 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.443404:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.443407:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.443413:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499859 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xc6e725b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.443546:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84144:x1874668789598336:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 528us (6631us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826298.443555:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110854 00010000:00010000:0.0:1787826298.443757:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3f5 expref: 66 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.443769:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:0.0:1787826298.443772:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.443775:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2400, rc 0) 00000100:00100000:0.0:1787826298.443802:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84146:x1874668789598080:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1762us (8651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.443809:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110853 00000100:00100000:1.0:1787826298.447572:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.447987:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789598592 00000100:00100000:0.0:1787826298.448001:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789598592 00000100:00100000:0.0:1787826298.448069:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110855 00000100:00100000:0.0:1787826298.448079:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84144:x1874668789598592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.448101:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.448125:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499860 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb434 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.448165:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.448178:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.448189:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.448301:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499860 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb434 expref: 68 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.448384:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb434 expref: 67 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.448393:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:0.0:1787826298.448396:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826298.448400:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:0.0:1787826298.449444:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84144:x1874668789598592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1353us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.449455:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110855 00000100:00100000:2.0:1787826298.452351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.452407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.452500:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789598848 00000100:00100000:3.0:1787826298.452511:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789598848 00000100:00100000:3.0:1787826298.452570:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110856 00000100:00100000:3.0:1787826298.452581:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84145:x1874668789598848:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.452640:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.452668:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34997fe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e0 expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452687:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81500) 00010000:00010000:3.0:1787826298.452699:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826298.452725:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452738:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452749:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452763:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452770:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452776:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452841:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452847:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452881:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452887:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.452891:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452899:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452907:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826298.452909:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.452913:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452918:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349986e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452927:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452933:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452938:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452943:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.452945:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452950:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452961:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x63fd2873 (ffff9bbe0a9bf400) 00010000:00010000:3.0:1787826298.452963:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.452965:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.452971:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499875 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x63fd2873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.453050:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84145:x1874668789598848:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 471us (709us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826298.453057:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110856 00000100:00100000:0.0:1787826298.453263:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789598976 00000100:00100000:0.0:1787826298.453269:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789598976 00000100:00100000:0.0:1787826298.453313:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3260 00000100:00100000:0.0:1787826298.453321:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe02259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2399:x1874668789598976:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826298.453361:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.453373:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349987c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb43b expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453413:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453423:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453441:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453454:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453460:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453466:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453486:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453492:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453498:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453502:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.453505:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453515:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453523:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826298.453525:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.453528:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453534:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499883 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453545:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453551:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453557:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453562:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.453564:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453569:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453576:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xef305e98 (ffff9bbf0ee81700) 00010000:00010000:0.0:1787826298.453578:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.453581:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453590:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349988a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xef305e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453612:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349987c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb43b expref: 67 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453621:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826298.453624:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826298.453628:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349987c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb43b expref: 67 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.453636:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc -2) 00000100:00100000:0.0:1787826298.453671:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe02259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2399:x1874668789598976:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 351us (1263us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826298.453678:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3260 00000100:00100000:3.0:1787826298.457500:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.457546:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.457611:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789599360 00000100:00100000:0.0:1787826298.457621:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789599360 00000100:00100000:0.0:1787826298.457680:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2548 00000100:00100000:0.0:1787826298.457690:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84146:x1874668789599360:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.457821:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84146:x1874668789599360:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 132us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.457829:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2548 00000100:00100000:2.0:1787826298.458048:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789599232 00000100:00100000:2.0:1787826298.458053:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789599232 00000100:00100000:2.0:1787826298.458123:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110857 00000100:00100000:2.0:1787826298.458131:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84144:x1874668789599232:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.458188:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.458204:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.458215:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826298.458355:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fa65b67 reply state 000000006b4397f7 transno 8590016048 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.458368:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.458376:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:2.0:1787826298.458379:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826298.458382:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826298.458454:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84144:x1874668789599232:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 323us (964us total) trans 8590016048 rc 0/0 00000100:00100000:2.0:1787826298.458460:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110857 00000100:00100000:3.0:1787826298.459133:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.460410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.460445:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789599744 00000100:00100000:3.0:1787826298.460453:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789599744 00000100:00100000:3.0:1787826298.460499:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2549 00000100:00100000:3.0:1787826298.460509:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84146:x1874668789599744:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.460714:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84146:x1874668789599744:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 205us (308us total) trans 8590016049 rc 0/0 00000100:00100000:3.0:1787826298.460722:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2549 00000100:00100000:3.0:1787826298.461366:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.461460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789599488 00000100:00100000:0.0:1787826298.461466:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789599488 00000100:00100000:0.0:1787826298.461512:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110858 00000100:00100000:0.0:1787826298.461520:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84145:x1874668789599488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.461533:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.461556:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499898 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb473 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.461590:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.461603:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.461614:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.461717:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499898 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb473 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.461734:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb473 expref: 70 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.461742:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:0.0:1787826298.461745:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826298.461748:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3c00, rc 0) 00000100:00100000:0.0:1787826298.461786:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84145:x1874668789599488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 267us (2654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.461793:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110858 00000100:00100000:3.0:1787826298.464921:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.465086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.465440:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789599872 00000100:00100000:0.0:1787826298.465449:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789599872 00000100:00100000:0.0:1787826298.465501:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789600128 00000100:00100000:0.0:1787826298.465504:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789600128 00000100:00100000:0.0:1787826298.465526:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110859 00000100:00100000:0.0:1787826298.465534:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84144:x1874668789599872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.465555:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.465573:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb47a expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.465625:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb47a expref: 72 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.465637:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb47a expref: 72 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.465647:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:0.0:1787826298.465649:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.465653:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826298.465724:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84144:x1874668789599872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 190us (4358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.465731:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110859 00000100:00100000:0.0:1787826298.465749:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110860 00000100:00100000:0.0:1787826298.465756:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84146:x1874668789600128:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.465809:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84146:x1874668789600128:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 52us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.465815:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110860 00000100:00100000:3.0:1787826298.465972:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789600384 00000100:00100000:3.0:1787826298.465977:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789600384 00000100:00100000:3.0:1787826298.466003:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110861 00000100:00100000:3.0:1787826298.466011:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84145:x1874668789600384:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.466063:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 3/0,1 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.466075:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.466083:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826298.466404:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f9036ea reply state 000000004219771b transno 8590016050 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.466418:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.466425:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:3.0:1787826298.466427:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826298.466440:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826298.466495:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84145:x1874668789600384:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 486us (1410us total) trans 8590016050 rc 0/0 00000100:00100000:3.0:1787826298.466500:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110861 00000100:00100000:0.0:1787826298.468905:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.468948:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.468958:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789600640 00000100:00100000:2.0:1787826298.468966:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789600640 00000100:00100000:0.0:1787826298.468978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.469019:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789600896 00000100:00100000:2.0:1787826298.469023:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789600896 00000100:00100000:2.0:1787826298.469046:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110862 00000100:00100000:2.0:1787826298.469055:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84146:x1874668789600640:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.469070:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110863 00010000:00010000:2.0:1787826298.469073:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787826298.469078:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84145:x1874668789600896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.469089:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.469094:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34998b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb481 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.469097:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb488 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.469162:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb488 expref: 76 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.469176:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb488 expref: 76 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.469194:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:2.0:1787826298.469202:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.469203:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.469214:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3f5 expref: 76 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.469222:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.469252:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3f5 expref: 76 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.469265:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3f5 expref: 76 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.469278:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778594176:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.469354:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56180 going to sleep for 11 seconds 00010000:00010000:0.0:1787826298.469420:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:0.0:1787826298.469465:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84145:x1874668789600896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 387us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.469472:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110863 00000100:00100000:3.0:1787826298.469640:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789600768 00000100:00100000:3.0:1787826298.469645:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789600768 00000100:00100000:3.0:1787826298.469686:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2550 00000100:00100000:3.0:1787826298.469703:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84144:x1874668789600768:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.469773:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84144:x1874668789600768:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 80us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.469781:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2550 00000100:00100000:2.0:1787826298.472630:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.472672:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.472740:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789601152 00000100:00100000:0.0:1787826298.472748:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789601152 00000100:00100000:0.0:1787826298.472801:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789601280 00000100:00100000:0.0:1787826298.472804:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789601280 00000100:00100000:0.0:1787826298.472820:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2551 00000100:00100000:0.0:1787826298.472829:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84145:x1874668789601152:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.472978:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84145:x1874668789601152:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 150us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.472986:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2551 00000100:00100000:0.0:1787826298.473002:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2552 00000100:00100000:0.0:1787826298.473009:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84144:x1874668789601280:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.473141:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84144:x1874668789601280:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 132us (468us total) trans 8590016051 rc 0/0 00000100:00100000:0.0:1787826298.473148:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2552 00000100:00100000:0.0:1787826298.475648:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778594176:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.475676:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.476318:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.476352:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.476415:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789601920 00000100:00100000:0.0:1787826298.476422:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789601920 00000100:00100000:2.0:1787826298.476445:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.476481:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110864 00000100:00100000:0.0:1787826298.476490:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84144:x1874668789601920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.476526:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789601536 00000100:00100000:3.0:1787826298.476530:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789601536 00000100:00100000:3.0:1787826298.476559:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2553 00000100:00100000:3.0:1787826298.476565:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84145:x1874668789601536:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.476589:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84144:x1874668789601920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.476596:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110864 00000100:00100000:3.0:1787826298.476707:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84145:x1874668789601536:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 141us (353us total) trans 8590016052 rc 0/0 00000100:00100000:3.0:1787826298.476713:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2553 00000100:00100000:1.0:1787826298.476990:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789601664 00000100:00100000:1.0:1787826298.476995:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789601664 00010000:00010000:1.0:1787826298.477018:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3f5 expref: 78 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.477049:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2881 00000100:00100000:1.0:1787826298.477056:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+78:2400:x1874668789601664:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.477067:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.477074:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3f5 expref: 78 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.477085:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3f5 expref: 78 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.477105:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349984b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3f5 expref: 78 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.477119:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:1.0:1787826298.477125:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.477134:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.477141:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.477170:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826298.477252:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477260:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.477277:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x107:0x0]: returning size 0 00000004:00080000:0.0:1787826298.477408:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb3:0x0], index 1: 0 00010000:00010000:0.0:1787826298.477499:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477506:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477513:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477519:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.477523:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477530:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477539:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:0.0:1787826298.477542:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.477545:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477551:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f34998c2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477588:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34998b4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb481 expref: 78 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477596:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826298.477599:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826298.477602:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f34998b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb481 expref: 78 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.477611:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:1.0:1787826298.477653:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+77:2400:x1874668789601664:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 597us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.477662:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2881 00000100:00100000:0.0:1787826298.480564:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84146:x1874668789600640:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 11497us (11655us total) trans 8590016053 rc 301/301 00000100:00100000:0.0:1787826298.480582:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110862 00000100:00100000:2.0:1787826298.481814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.482472:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.483580:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789602176 00000100:00100000:3.0:1787826298.483591:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789602176 00000100:00100000:2.0:1787826298.483630:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.483658:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789602688 00000100:00100000:2.0:1787826298.483662:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789602688 00000100:00100000:3.0:1787826298.483686:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789602432 00000100:00100000:3.0:1787826298.483689:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789602432 00000100:00100000:2.0:1787826298.483706:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2554 00000100:00100000:2.0:1787826298.483714:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84146:x1874668789602688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.483780:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110865 00000100:00100000:1.0:1787826298.483790:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84144:x1874668789602176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.483800:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.483820:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34998d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb48f expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.483912:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110866 00000100:00100000:3.0:1787826298.483921:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84145:x1874668789602432:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.483996:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84146:x1874668789602688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 282us (368us total) trans 8590016054 rc 0/0 00000100:00100000:2.0:1787826298.484003:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2554 00010000:00010000:1.0:1787826298.484073:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.484089:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb47a expref: 79 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.484099:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.485655:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84145:x1874668789602432:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 1725us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.485665:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110866 00010000:00010000:1.0:1787826298.485808:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb47a expref: 78 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.485823:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb47a expref: 78 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.485837:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778594304:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826298.485866:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.485897:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789602816 00000100:00100000:0.0:1787826298.485912:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789602816 00000100:00100000:0.0:1787826298.485955:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110867 00000100:00100000:0.0:1787826298.485963:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84146:x1874668789602816:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.485977:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.485992:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f34998de lrc: 2/0,0 mode: --/CR res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb496 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.486049:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37780 going to sleep for 11 seconds 00010000:00010000:0.0:1787826298.486050:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34998e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.486061:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34998e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.486072:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34998e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.486103:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x107:0x0]: returning size 0 00000004:00200000:0.0:1787826298.486106:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826298.486118:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34998e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.486145:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f34998de lrc: 0/0,0 mode: --/CR res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb496 expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.486158:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34998e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb496 expref: 80 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.486168:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:0.0:1787826298.486170:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826298.486172:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc 0) 00000100:00100000:0.0:1787826298.486203:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84146:x1874668789602816:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 235us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.486680:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110867 00000100:00100000:2.0:1787826298.488896:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.488953:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.488999:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778594304:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826298.489022:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.489027:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789603200 00000100:00100000:1.0:1787826298.489033:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789603200 00000100:00100000:1.0:1787826298.489118:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6092 00000100:00100000:1.0:1787826298.489128:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789603200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.489144:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.489164:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4a4 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826298.489189:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826298.489206:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=2936s v=(0 0) 00010000:00010000:1.0:1787826298.489210:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.489219:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4a4 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.489235:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4a4 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.489248:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6800, rc 0) 00000100:00100000:1.0:1787826298.489303:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789603200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 177us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.489310:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6092 00000100:00100000:1.0:1787826298.489382:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789603072 00000100:00100000:1.0:1787826298.489386:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789603072 00000100:00100000:1.0:1787826298.489460:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110868 00000100:00100000:1.0:1787826298.489467:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84145:x1874668789603072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.489478:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.489492:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34998f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb49d expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.489592:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.489612:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb488 expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.489621:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 4/0,1 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.489651:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb488 expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.489664:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb488 expref: 81 pid: 6515 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.489680:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778594432:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.489749:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.490120:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.491539:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789603328 00000100:00100000:2.0:1787826298.491549:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789603328 00010000:00010000:2.0:1787826298.491586:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb47a expref: 82 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.491689:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2882 00000100:00100000:2.0:1787826298.491699:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2401:x1874668789603328:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.491713:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.491719:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb47a expref: 82 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.491733:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb47a expref: 82 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.491758:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f34998a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb47a expref: 82 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.491774:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:2.0:1787826298.491779:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.491787:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.491807:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.491832:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.492491:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2401:x1874668789603328:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 790us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.492501:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2882 00010000:00010000:2.0:1787826298.492973:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.492983:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.493003:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x109:0x0]: returning size 0 00000004:00080000:2.0:1787826298.493165:0:25756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb3:0x0], index 0: 0 00010000:00010000:2.0:1787826298.493276:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.493285:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.493292:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.493299:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.493303:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.493310:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.493322:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:2.0:1787826298.493325:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.493329:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.493336:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34998d7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.493381:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34998d0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb48f expref: 81 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.493391:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826298.493393:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826298.493397:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34998d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb48f expref: 81 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.493406:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:2.0:1787826298.494112:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84144:x1874668789602176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 10321us (12311us total) trans 8590016055 rc 301/301 00000100:00100000:2.0:1787826298.494189:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110865 00000100:00100000:0.0:1787826298.495122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.495158:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.495417:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789603712 00000100:00100000:2.0:1787826298.495424:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789603712 00010000:00010000:2.0:1787826298.495469:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb488 expref: 80 pid: 6515 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.495507:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2883 00000100:00100000:2.0:1787826298.495517:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789603712:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.495530:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.495536:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb488 expref: 80 pid: 6515 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.495549:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb488 expref: 80 pid: 6515 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.495570:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:2.0:1787826298.495574:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.495582:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.495589:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.495679:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.495729:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789603712:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 213us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.495738:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2883 00000100:00100000:1.0:1787826298.495984:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789603584 00000100:00100000:1.0:1787826298.495989:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789603584 00000100:00100000:1.0:1787826298.496023:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110869 00000100:00100000:1.0:1787826298.496030:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84146:x1874668789603584:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.496096:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84146:x1874668789603584:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 66us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.496102:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110869 00010000:00010000:3.0:1787826298.499157:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f34998bb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb488 expref: 79 pid: 6515 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.499179:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778594432:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826298.499202:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499235:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499241:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826298.499262:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x108:0x0]: returning size 0 00000004:00080000:3.0:1787826298.499426:0:45683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb4:0x0], index 1: 0 00000100:00100000:0.0:1787826298.499513:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826298.499545:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499553:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499559:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499565:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00000100:00100000:0.0:1787826298.499570:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826298.499570:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499577:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499593:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:3.0:1787826298.499596:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826298.499600:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 2/0,0 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499610:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34998fa lrc: 0/0,0 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499657:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34998f3 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb49d expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499668:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826298.499671:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826298.499674:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f34998f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb49d expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.499683:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc 0) 00000100:00100000:2.0:1787826298.499718:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789604096 00000100:00100000:2.0:1787826298.499726:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789604096 00000100:00100000:1.0:1787826298.499794:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789603968 00000100:00100000:1.0:1787826298.499798:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789603968 00000100:00100000:2.0:1787826298.499807:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6093 00000100:00100000:2.0:1787826298.499816:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84146:x1874668789604096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.499829:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787826298.499836:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2555 00000100:00100000:1.0:1787826298.499842:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84144:x1874668789603968:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.499843:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4ab expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.499886:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4a4 expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.499894:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.499899:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.499904:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.499932:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4a4 expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.499946:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4a4 expref: 11 pid: 8433 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.499959:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a117840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778594560:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.500029:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.501543:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84144:x1874668789603968:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1693us (2023us total) trans 8590016057 rc 0/0 00000100:00100000:1.0:1787826298.501555:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2555 00000100:00100000:3.0:1787826298.502022:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84145:x1874668789603072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 12552us (13129us total) trans 8590016056 rc 301/301 00000100:00100000:3.0:1787826298.502031:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110868 00000100:00100000:1.0:1787826298.506805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.506837:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a117840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778594560:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.506900:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.506921:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826298.506983:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84146:x1874668789604096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 7167us (7411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.506993:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6093 00000100:00100000:0.0:1787826298.507075:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789604224 00000100:00100000:0.0:1787826298.507082:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789604224 00010000:00010000:0.0:1787826298.507113:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4a4 expref: 11 pid: 8433 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.507163:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2884 00000100:00100000:0.0:1787826298.507172:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40516850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789604224:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826298.507186:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.507213:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4a4 expref: 11 pid: 8433 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.507225:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4a4 expref: 11 pid: 8433 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.507254:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f34998ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4a4 expref: 11 pid: 8433 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.507268:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.507272:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.507280:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.507290:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.507326:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.507339:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db76d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778594688:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826298.507404:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.508915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.508949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.508982:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789604352 00000100:00100000:0.0:1787826298.508989:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789604352 00000100:00100000:3.0:1787826298.509011:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789604608 00000100:00100000:3.0:1787826298.509015:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789604608 00000100:00100000:0.0:1787826298.509040:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110870 00000100:00100000:0.0:1787826298.509048:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84144:x1874668789604352:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.509049:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2556 00000100:00100000:3.0:1787826298.509055:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84145:x1874668789604608:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.509068:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.509087:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499916 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.509292:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84145:x1874668789604608:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 236us (342us total) trans 8590016058 rc 0/0 00000100:00100000:3.0:1787826298.509301:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2556 00010000:00010000:0.0:1787826298.509683:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349991d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.509697:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349991d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.509708:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349991d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.509732:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x109:0x0]: returning size 0 00000004:00200000:0.0:1787826298.509737:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826298.509750:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349991d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.509779:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499916 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4b2 expref: 82 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.510084:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349991d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4b2 expref: 81 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.510094:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:0.0:1787826298.510098:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826298.510101:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc 0) 00000100:00100000:0.0:1787826298.510478:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84144:x1874668789604352:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1429us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.510484:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110870 00000100:00100000:3.0:1787826298.510487:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db76d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778594688:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826298.510506:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826298.510530:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40516850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789604224:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3359us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.510538:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2884 00000100:00100000:1.0:1787826298.512381:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.512506:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789604736 00000100:00100000:3.0:1787826298.512516:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789604736 00000100:00100000:3.0:1787826298.512574:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110871 00000100:00100000:3.0:1787826298.512583:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84145:x1874668789604736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.512601:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.512623:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499924 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4b9 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.512690:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349992b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.512705:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349992b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.512716:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349992b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826298.512759:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x108:0x0]: returning size 0 00000004:00200000:3.0:1787826298.512763:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826298.512778:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349992b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.512802:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499924 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4b9 expref: 83 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.512820:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349992b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4b9 expref: 82 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.512843:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:3.0:1787826298.512845:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826298.512848:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826298.514159:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.514214:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789604864 00000100:00100000:0.0:1787826298.514221:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789604864 00000100:00100000:0.0:1787826298.514270:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6094 00000100:00100000:0.0:1787826298.514281:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789604864:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.514294:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.514311:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4c0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826298.514334:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826298.514352:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=2936s v=(0 0) 00010000:00010000:0.0:1787826298.514357:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.514366:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c0 expref: 13 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.514382:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c0 expref: 13 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.514394:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3600, rc 0) 00000100:00100000:0.0:1787826298.514453:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789604864:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 175us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.514461:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6094 00000100:00100000:2.0:1787826298.515090:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84145:x1874668789604736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2505us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.515099:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110871 00000100:00100000:3.0:1787826298.516519:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.516609:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789604992 00000100:00100000:2.0:1787826298.516617:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789604992 00002000:00100000:2.0:1787826298.516660:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xb3:0x0] (0->157) req@ffff9bbe0a562580 x1874668789604992/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/0 e 0 to 0 dl 1787826309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826298.516671:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a562580 with x1874668789604992 ext(0->157) 00002000:00010000:2.0:1787826298.516676:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a562580 00000100:00100000:2.0:1787826298.516703:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1543 00000100:00100000:2.0:1787826298.516711:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789604992:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.517630:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789604992:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 916us (1112us total) trans 4294968111 rc 0/0 00000100:00100000:2.0:1787826298.517641:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1543 00002000:00100000:2.0:1787826298.517650:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xb3:0x0] (0->157) req@ffff9bbe0a562580 x1874668789604992/t4294968111(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/448 e 0 to 0 dl 1787826309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826298.517667:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a562580 with x1874668789604992 ext(0->157) 00002000:00010000:2.0:1787826298.517671:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a562580 00000100:00100000:3.0:1787826298.519521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.519568:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.519649:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789605120 00000100:00100000:2.0:1787826298.519657:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789605120 00000100:00100000:2.0:1787826298.519715:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6095 00000100:00100000:2.0:1787826298.519724:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789605120:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.519740:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.519762:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4c7 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826298.519787:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826298.519806:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=2936s v=(0 0) 00010000:00010000:2.0:1787826298.519810:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.519819:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c7 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.519835:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c7 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.519881:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2e00, rc 0) 00000100:00100000:2.0:1787826298.519935:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789605120:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 212us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.519943:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6095 00000100:00100000:3.0:1787826298.521030:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.522586:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789605376 00000100:00100000:0.0:1787826298.522598:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789605376 00000100:00100000:0.0:1787826298.522708:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789605504 00000100:00100000:0.0:1787826298.522711:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789605504 00000100:00100000:0.0:1787826298.522733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110872 00000100:00100000:0.0:1787826298.522741:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84144:x1874668789605376:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.522989:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84144:x1874668789605376:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 248us (3420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.522997:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110872 00000100:00100000:0.0:1787826298.523015:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110873 00000100:00100000:0.0:1787826298.523021:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84146:x1874668789605504:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.525090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.525214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789605760 00000100:00100000:1.0:1787826298.525223:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789605760 00000100:00100000:1.0:1787826298.525271:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110874 00000100:00100000:1.0:1787826298.525281:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84145:x1874668789605760:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.525382:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84145:x1874668789605760:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.525390:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110874 00000001:00080000:0.0:1787826298.526809:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016058 is committed 00000020:00080000:0.0:1787826298.526893:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17d56f00 refcount 2 committed 0 result 0 batchid 4294970858 00000020:00080000:0.0:1787826298.526898:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe022fbe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d56a80 00000020:00080000:0.0:1787826298.526902:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417ca100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a1a7000 00000020:00080000:0.0:1787826298.526916:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17d56000 refcount 2 committed 0 result 0 batchid 4294970857 00000020:00080000:0.0:1787826298.526920:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417caa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d566c0 00000020:00080000:0.0:1787826298.526923:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417cad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a1a7e00 00000020:00080000:0.0:1787826298.526937:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17d56c00 refcount 2 committed 0 result 0 batchid 4294970856 00000020:00080000:0.0:1787826298.526939:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417ca700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d56240 00000020:00080000:0.0:1787826298.526942:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417ca600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe15be9200 00000020:00080000:0.0:1787826298.526952:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970855 batchid updated 00000100:00100000:0.0:1787826298.527053:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84146:x1874668789605504:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 4030us (6029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.527062:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110873 00000020:00080000:2.0:1787826298.527452:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970858 committed batchid 4294970855 00000020:00080000:2.0:1787826298.527526:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970855 00010000:00010000:1.0:1787826298.528208:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528221:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528229:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528235:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.528240:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528247:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528267:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x104:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826298.528270:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.528275:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528282:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f34996ae lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528305:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528373:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528379:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528385:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.528387:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528393:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528402:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x105:0x0].0x0 (ffff9bbf0ee81300) 00010000:00010000:1.0:1787826298.528405:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.528408:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.528414:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f34996bc lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x105:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529605:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f34996d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529619:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f34996d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529626:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f34996d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529631:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.529634:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f34996d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529642:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f34996d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529655:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x106:0x0].0x0 (ffff9bbf14059000) 00010000:00010000:1.0:1787826298.529658:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.529662:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f34996d1 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529667:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f34996d1 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x106:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529686:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529698:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529704:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529710:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.529713:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529719:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529726:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:1.0:1787826298.529728:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826298.529732:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529738:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349982f lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529748:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529755:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529761:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529766:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.529769:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529775:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529786:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:1.0:1787826298.529789:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826298.529792:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529797:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499891 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529807:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529812:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529818:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529823:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.529825:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529831:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529838:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:1.0:1787826298.529840:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826298.529843:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.529848:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f34998ad lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.531535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.531599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.531797:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.532680:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789605888 00000100:00100000:2.0:1787826298.532680:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789606016 00000100:00100000:0.0:1787826298.532691:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789605888 00000100:00100000:2.0:1787826298.532691:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789606016 00000100:00100000:2.0:1787826298.532766:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789606144 00000100:00100000:2.0:1787826298.532770:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789606144 00000100:00100000:0.0:1787826298.532774:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6096 00000100:00100000:0.0:1787826298.532782:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84144:x1874668789606016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.532800:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.532819:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4ce expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.532833:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6097 00000100:00100000:2.0:1787826298.532842:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84145:x1874668789605888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.532862:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787826298.532866:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6098 00010000:00010000:2.0:1787826298.532872:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4d5 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.532875:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2400:x1874668789606144:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.532900:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c7 expref: 15 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.532908:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.532912:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.532917:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.532948:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c7 expref: 15 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.532962:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c7 expref: 15 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.532976:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a117480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778594816:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.533025:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c0 expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.533032:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.533034:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.533039:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.533057:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c0 expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.533059:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56e40 going to sleep for 11 seconds 00010000:00010000:0.0:1787826298.533066:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c0 expref: 14 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.533075:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778594944:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826298.533100:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.535070:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a117480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778594816:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.535108:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.535144:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:0.0:1787826298.535227:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778594944:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.535246:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.535257:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826298.535279:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84144:x1874668789606016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2497us (3753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.535283:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:84145:x1874668789605888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2357us (3599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.535291:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6096 00000100:00100000:0.0:1787826298.536261:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.536298:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.536378:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789606272 00000100:00100000:2.0:1787826298.536386:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789606272 00000100:00100000:3.0:1787826298.536445:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789606400 00000100:00100000:3.0:1787826298.536449:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789606400 00010000:00010000:2.0:1787826298.536454:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c7 expref: 16 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.536466:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c0 expref: 14 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.536485:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2885 00000100:00100000:2.0:1787826298.536494:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789606272:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.536509:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787826298.536522:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968111 is committed 00010000:00010000:2.0:1787826298.536527:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c7 expref: 15 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826298.536533:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968110 is committed 00010000:00010000:2.0:1787826298.536539:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c7 expref: 13 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.536562:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f3499939 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c7 expref: 13 pid: 8605 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.536576:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.536581:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.536589:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.536600:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789606144:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 3727us (4811us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826298.536600:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.536722:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.536736:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a115e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778595072:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826298.536784:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.536959:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6097 00000100:00100000:3.0:1787826298.537112:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2886 00000100:00100000:3.0:1787826298.537122:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789606400:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.537132:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.537145:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c0 expref: 14 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.537156:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c0 expref: 14 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.537175:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f3499932 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4c0 expref: 14 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.537186:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.537189:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.537195:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.537203:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.537228:0:45686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.537238:0:45686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a5621c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:45686:1874668778595200:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826298.537268:0:45686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c6649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.537411:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6098 00000100:00100000:2.0:1787826298.540571:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a115e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778595072:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826298.540597:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.540655:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789606272:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4160us (4396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.540666:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2885 00000100:00100000:0.0:1787826298.540978:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.541197:0:45686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a5621c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:45686:1874668778595200:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826298.541199:0:45404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789606528 00000100:00100000:1.0:1787826298.541206:0:45404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789606528 00002000:00100000:1.0:1787826298.541249:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xb4:0x0] (0->157) req@ffff9bbe1607a940 x1874668789606528/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/0 e 0 to 0 dl 1787826309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826298.541259:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1607a940 with x1874668789606528 ext(0->157) 00002000:00010000:1.0:1787826298.541263:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1607a940 00000100:00100000:1.0:1787826298.541296:0:45404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1544 00000100:00100000:1.0:1787826298.541305:0:45404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789606528:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.541345:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826298.541375:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789606400:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4255us (5076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.541382:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2886 00000100:00100000:1.0:1787826298.542170:0:45404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789606528:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 863us (1190us total) trans 4294968112 rc 0/0 00000100:00100000:1.0:1787826298.542180:0:45404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1544 00002000:00100000:1.0:1787826298.542188:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xb4:0x0] (0->157) req@ffff9bbe1607a940 x1874668789606528/t4294968112(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/448 e 0 to 0 dl 1787826309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826298.542204:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1607a940 with x1874668789606528 ext(0->157) 00002000:00010000:1.0:1787826298.542208:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1607a940 00000100:00100000:2.0:1787826298.543236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.543322:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789606784 00000100:00100000:1.0:1787826298.543329:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789606784 00000100:00100000:1.0:1787826298.543380:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110875 00000100:00100000:1.0:1787826298.543389:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84146:x1874668789606784:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.543446:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.543474:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34998e5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x107:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb496 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.543492:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:1.0:1787826298.543497:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826298.543524:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.543537:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.543547:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826298.543645:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b169b1c8 reply state 00000000c89bda90 transno 8590016059 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.543657:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.543664:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:1.0:1787826298.543667:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826298.543670:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826298.544024:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84146:x1874668789606784:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 633us (790us total) trans 8590016059 rc 0/0 00000100:00100000:1.0:1787826298.544031:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110875 00000100:00100000:2.0:1787826298.545952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.546143:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789606912 00000100:00100000:1.0:1787826298.546152:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789606912 00002000:00100000:1.0:1787826298.546199:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xb3:0x0] (0->157) req@ffff9bbe0a114000 x1874668789606912/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/0 e 0 to 0 dl 1787826309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826298.546211:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a114000 with x1874668789606912 ext(0->157) 00002000:00010000:1.0:1787826298.546216:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a114000 00000100:00100000:1.0:1787826298.546245:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1545 00000100:00100000:1.0:1787826298.546254:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789606912:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.547080:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789606912:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 824us (1133us total) trans 4294968128 rc 0/0 00000100:00100000:1.0:1787826298.547089:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1545 00002000:00100000:1.0:1787826298.547098:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xb3:0x0] (0->157) req@ffff9bbe0a114000 x1874668789606912/t4294968128(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/448 e 0 to 0 dl 1787826309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826298.547106:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a114000 with x1874668789606912 ext(0->157) 00002000:00010000:1.0:1787826298.547111:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a114000 00000100:00100000:0.0:1787826298.547809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.547892:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789607040 00000100:00100000:1.0:1787826298.547898:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789607040 00000100:00100000:1.0:1787826298.547940:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110876 00000100:00100000:1.0:1787826298.547949:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84146:x1874668789607040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.547969:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.547992:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4dc expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.548051:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4dc expref: 33 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.548065:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4dc expref: 33 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.548084:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:1.0:1787826298.548088:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.548092:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826298.548140:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84146:x1874668789607040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 192us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.548146:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110876 00000100:00100000:2.0:1787826298.548945:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.549020:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789607168 00000100:00100000:0.0:1787826298.549026:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789607168 00000100:00100000:0.0:1787826298.549068:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110877 00000100:00100000:0.0:1787826298.549076:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84145:x1874668789607168:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.549171:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84145:x1874668789607168:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.549178:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110877 00000100:00100000:3.0:1787826298.550587:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.550675:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789607296 00000100:00100000:0.0:1787826298.550682:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789607296 00000100:00100000:0.0:1787826298.550730:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6099 00000100:00100000:0.0:1787826298.550739:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789607296:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826298.550911:0:25038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb3:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826298.550915:0:25038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb3:0x0] updating lvb mtime from disk: 0 -> 1787826217 00002000:00010000:0.0:1787826298.550918:0:25038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb3:0x0] updating lvb atime from disk: 0 -> 1787826216 00002000:00010000:0.0:1787826298.550920:0:25038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb3:0x0] updating lvb ctime from disk: 0 -> 1787826217 00002000:00010000:0.0:1787826298.550923:0:25038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826298.550973:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789607296:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 235us (390us total) trans 4294968113 rc 0/0 00000100:00100000:0.0:1787826298.550981:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6099 00000100:00100000:3.0:1787826298.551270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.551349:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789607424 00000100:00100000:1.0:1787826298.551355:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789607424 00000100:00100000:1.0:1787826298.551391:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6100 00000100:00100000:1.0:1787826298.551399:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789607424:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787826298.552885:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968113 is committed 00000100:00100000:3.0:1787826298.553114:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.553298:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789607552 00000100:00100000:2.0:1787826298.553305:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789607552 00000100:00100000:2.0:1787826298.553350:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110878 00000100:00100000:2.0:1787826298.553358:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84144:x1874668789607552:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.553478:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84144:x1874668789607552:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 120us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.553485:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110878 00000100:00100000:1.0:1787826298.556040:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789607424:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 4631us (4759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.556052:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6100 00000100:00100000:3.0:1787826298.557080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.557264:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789607808 00000100:00100000:2.0:1787826298.557273:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789607808 00000100:00100000:2.0:1787826298.557383:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110879 00000100:00100000:2.0:1787826298.557394:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84146:x1874668789607808:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.557472:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.557490:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e7 expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.557499:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 4/0,1 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.557532:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e7 expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.557546:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e7 expref: 33 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.557562:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a116580 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778595328:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.557642:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.559704:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a116580 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778595328:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.559730:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.560277:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.560458:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789608064 00000100:00100000:0.0:1787826298.560465:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789608064 00000100:00100000:0.0:1787826298.560525:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110880 00000100:00100000:0.0:1787826298.560535:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84145:x1874668789608064:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.560587:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.560612:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349992b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x108:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4b9 expref: 34 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.560629:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:0.0:1787826298.560634:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826298.560661:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.560674:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.560683:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826298.560797:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067cc0937 reply state 00000000b1682fa3 transno 8590016060 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.560810:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.560816:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:0.0:1787826298.560820:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826298.560823:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826298.560955:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84145:x1874668789608064:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 421us (679us total) trans 8590016060 rc 0/0 00000100:00100000:0.0:1787826298.560963:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110880 00000100:00100000:3.0:1787826298.563072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.563704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.563834:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789608320 00000100:00100000:0.0:1787826298.563843:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789608320 00000100:00100000:0.0:1787826298.563926:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6101 00000100:00100000:0.0:1787826298.563936:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2400:x1874668789608320:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.564268:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789608192 00000100:00100000:1.0:1787826298.564273:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789608192 00010000:00010000:1.0:1787826298.564301:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e7 expref: 35 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.564501:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2887 00000100:00100000:1.0:1787826298.564511:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2402:x1874668789608192:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.564524:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.564531:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e7 expref: 35 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.564545:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e7 expref: 35 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.564567:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499813 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x107:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb3e7 expref: 35 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.564583:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:1.0:1787826298.564589:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.564598:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.564605:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.564633:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826298.564701:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+34:2402:x1874668789608192:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 182us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.564709:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2887 00010000:00010000:1.0:1787826298.565050:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.565059:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.565096:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.565104:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.565110:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.565116:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.565121:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.565128:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.565138:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:1.0:1787826298.565141:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826298.565144:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.565150:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349995c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.565262:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84146:x1874668789607808:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 7869us (8184us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826298.565271:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110879 00000001:00080000:0.0:1787826298.565601:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968128 is committed 00000001:00080000:0.0:1787826298.565611:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968127 is committed 00000100:00100000:1.0:1787826298.566020:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789608320:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2083us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.566033:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6101 00000100:00100000:2.0:1787826298.567341:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.567468:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789608448 00000100:00100000:1.0:1787826298.567476:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789608448 00000100:00100000:1.0:1787826298.567526:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110881 00000100:00100000:1.0:1787826298.567535:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84145:x1874668789608448:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.567554:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.567573:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4e3 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.567625:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4e3 expref: 34 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.567639:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4e3 expref: 34 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.567662:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:1.0:1787826298.567666:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.567670:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6800, rc 0) 00000100:00100000:1.0:1787826298.567715:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84145:x1874668789608448:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 181us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.567722:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110881 00000100:00100000:3.0:1787826298.567794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.568067:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789608576 00000100:00100000:0.0:1787826298.568072:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789608576 00000100:00100000:0.0:1787826298.568101:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6102 00000100:00100000:0.0:1787826298.568107:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789608576:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.568135:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.568152:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.568160:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.568164:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826298.568168:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.568199:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.568213:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 10 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.568228:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12838780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778595456:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826298.568287:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.571500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.571834:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12838780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778595456:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.571886:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.572232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.572300:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789608832 00000100:00100000:0.0:1787826298.572306:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789608832 00000100:00100000:0.0:1787826298.572369:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110882 00000100:00100000:0.0:1787826298.572378:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84144:x1874668789608832:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.572441:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.572466:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349991d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x109:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4b2 expref: 34 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.572483:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:0.0:1787826298.572487:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826298.572516:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.572530:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.572544:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826298.572655:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e00acbc reply state 000000002db524f8 transno 8590016061 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.572666:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.572672:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:0.0:1787826298.572675:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826298.572677:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826298.572789:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84144:x1874668789608832:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 411us (557us total) trans 8590016061 rc 0/0 00000100:00100000:0.0:1787826298.572797:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110882 00000100:00100000:2.0:1787826298.575964:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789608960 00000100:00100000:2.0:1787826298.575979:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789608960 00010000:00010000:2.0:1787826298.576033:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 11 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.576081:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2888 00000100:00100000:2.0:1787826298.576091:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789608960:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.576112:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.576135:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 11 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.576150:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 11 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.576173:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349990f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ab expref: 11 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.576191:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826298.576196:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826298.576201:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.576212:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.576236:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.576301:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789608960:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 211us (4810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.576318:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2888 00010000:00010000:0.0:1787826298.576527:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.576537:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.576558:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.576567:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.576576:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.576584:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826298.576588:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.576597:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.576609:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.576618:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acf44001/0x68019081f3499971 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.576678:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789608576:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 8570us (8884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.576686:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6102 00000100:00100000:3.0:1787826298.578487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.578576:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.579399:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789609216 00000100:00100000:1.0:1787826298.579408:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789609216 00000100:00100000:1.0:1787826298.579463:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6103 00000100:00100000:1.0:1787826298.579473:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789609216:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826298.579615:0:25038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb4:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826298.579619:0:25038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb4:0x0] updating lvb mtime from disk: 0 -> 1787826216 00002000:00010000:1.0:1787826298.579622:0:25038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb4:0x0] updating lvb atime from disk: 0 -> 1787826216 00002000:00010000:1.0:1787826298.579624:0:25038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb4:0x0] updating lvb ctime from disk: 0 -> 1787826216 00002000:00010000:1.0:1787826298.579626:0:25038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826298.579683:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789609216:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 211us (1106us total) trans 4294968114 rc 0/0 00000100:00100000:1.0:1787826298.579691:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6103 00000100:00100000:2.0:1787826298.580540:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789609088 00000100:00100000:2.0:1787826298.580547:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789609088 00000100:00100000:2.0:1787826298.580622:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110883 00000100:00100000:2.0:1787826298.580632:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84144:x1874668789609088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.580652:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.580675:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4ea expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.580744:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ea expref: 36 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.580758:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ea expref: 36 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.580775:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:2.0:1787826298.580778:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.580783:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3800, rc 0) 00000100:00100000:2.0:1787826298.580821:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84144:x1874668789609088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 191us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.580828:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110883 00000100:00100000:3.0:1787826298.582926:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.583037:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789609472 00000100:00100000:0.0:1787826298.583046:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789609472 00000100:00100000:0.0:1787826298.583100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110884 00000100:00100000:0.0:1787826298.583109:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84146:x1874668789609472:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.583180:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.583196:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.583211:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.583368:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.583380:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4dc expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.583387:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.583418:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4dc expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.583446:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4dc expref: 37 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.583460:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12838780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778595584:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826298.583541:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.584073:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.584154:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.584213:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789609856 00000100:00100000:2.0:1787826298.584218:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789609856 00000100:00100000:2.0:1787826298.584259:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6104 00000100:00100000:2.0:1787826298.584268:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789609856:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826298.584468:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb3:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826298.584473:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb3:0x0] updating lvb mtime from disk: 0 -> 1787826216 00002000:00010000:2.0:1787826298.584475:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb3:0x0] updating lvb atime from disk: 0 -> 1787826216 00002000:00010000:2.0:1787826298.584478:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb3:0x0] updating lvb ctime from disk: 0 -> 1787826216 00002000:00010000:2.0:1787826298.584480:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826298.584521:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789609856:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 254us (366us total) trans 4294968129 rc 0/0 00000100:00100000:2.0:1787826298.584530:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6104 00000100:00100000:1.0:1787826298.584963:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789609728 00000100:00100000:1.0:1787826298.584970:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789609728 00000100:00100000:1.0:1787826298.585013:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110885 00000100:00100000:1.0:1787826298.585021:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84145:x1874668789609728:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.585071:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.585085:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb473 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.585093:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.585124:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb473 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.585135:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb473 expref: 38 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.585147:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03f480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778595712:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.585194:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.587564:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12838780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778595584:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.587592:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.588140:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.588173:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.588255:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789609984 00000100:00100000:0.0:1787826298.588262:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789609984 00000100:00100000:3.0:1787826298.588283:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:0.0:1787826298.588297:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4dc expref: 39 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.588300:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789610368 00000100:00100000:3.0:1787826298.588303:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789610368 00000100:00100000:0.0:1787826298.588334:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789610112 00000100:00100000:0.0:1787826298.588337:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789610112 00000100:00100000:3.0:1787826298.588338:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110886 00000100:00100000:3.0:1787826298.588345:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84144:x1874668789610368:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.588348:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb473 expref: 41 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.588364:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2889 00000100:00100000:0.0:1787826298.588370:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+41:2401:x1874668789609984:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826298.588379:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.588384:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4dc expref: 41 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.588395:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4dc expref: 41 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588398:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588409:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb434 expref: 41 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.588414:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499955 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4dc expref: 41 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588418:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.588427:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:0.0:1787826298.588442:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.588449:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.588456:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588457:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb434 expref: 40 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588470:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb434 expref: 40 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.588478:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826298.588482:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778595840:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.588537:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c6649c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.588554:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2890 00000100:00100000:3.0:1787826298.588561:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789610112:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.588570:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.588575:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb473 expref: 40 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588585:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb473 expref: 40 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588596:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:3.0:1787826298.588601:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588608:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588614:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.588626:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826298.588947:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349989f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x108:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb473 expref: 40 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.588960:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03f480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778595712:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.588975:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.588983:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.588993:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.589047:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789609984:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 676us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.589055:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2889 00000100:00100000:3.0:1787826298.589060:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789610112:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 499us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.589067:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2890 00010000:00010000:0.0:1787826298.589079:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.589085:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826298.589174:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016062 00010000:00010000:1.0:1787826298.589322:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.589331:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.589339:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.589344:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.589349:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.589356:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.589367:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:1.0:1787826298.589370:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826298.589375:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.589381:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499994 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.589426:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84145:x1874668789609728:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 4406us (5354us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826298.589444:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110885 00000100:00100000:3.0:1787826298.591139:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.591232:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778595840:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.591261:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.591319:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789610496 00000100:00100000:1.0:1787826298.591326:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789610496 00010000:00010000:1.0:1787826298.591358:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb434 expref: 38 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.591396:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2891 00000100:00100000:1.0:1787826298.591405:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40515450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789610496:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.591419:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.591425:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb434 expref: 38 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.591450:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb434 expref: 38 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.591470:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f3499867 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x109:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb434 expref: 38 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.591483:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:1.0:1787826298.591488:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.591498:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.591506:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.591530:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826298.591578:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40515450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2402:x1874668789610496:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 174us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.591585:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2891 00000001:00080000:0.0:1787826298.591586:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016063 00000001:00080000:0.0:1787826298.591644:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016064 00010000:00010000:2.0:1787826298.591730:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.591738:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.591763:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.591771:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.591777:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.591783:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.591787:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.591794:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.591802:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:2.0:1787826298.591805:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826298.591808:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.591815:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349999b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.591875:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84144:x1874668789610368:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 3529us (3591us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826298.591883:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110886 00000100:00100000:0.0:1787826298.592526:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12838780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778595968:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787826298.593137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.593212:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789610624 00000100:00100000:1.0:1787826298.593218:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789610624 00000100:00100000:1.0:1787826298.593263:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6105 00000100:00100000:1.0:1787826298.593272:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789610624:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.593500:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.593521:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.593529:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.593533:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826298.593537:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.593563:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.593582:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 10 pid: 8433 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.593595:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778596096:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.593662:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.594372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.594440:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789610752 00000100:00100000:1.0:1787826298.594446:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789610752 00000100:00100000:1.0:1787826298.594483:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6106 00000100:00100000:1.0:1787826298.594490:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789610752:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.594520:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.594536:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.594543:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.594546:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826298.594550:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.594573:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.594595:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 13 pid: 45681 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.594609:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778596224:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826298.595078:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826298.595112:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778595968 00000100:00100000:0.0:1787826298.595116:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778595968 00000100:00100000:0.0:1787826298.595151:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3261 00000100:00100000:0.0:1787826298.595158:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778595968:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826298.595240:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778595968:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.595247:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3261 00000100:00100000:0.0:1787826298.595271:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.595291:0:6515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968110 gen 2 00000004:00080000:0.0:1787826298.595296:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968110 committed transno 4294968110 00000100:00100000:0.0:1787826298.595327:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12838780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778595968:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787826298.595483:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016065 00000100:00100000:0.0:1787826298.595544:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778596352:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826298.595570:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826298.595593:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.596299:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe10b37600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.596327:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778596352 00000100:00100000:1.0:1787826298.596332:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778596352 00000100:00100000:1.0:1787826298.596366:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3262 00000100:00100000:1.0:1787826298.596374:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778596352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787826298.596511:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778596352:12345-0@lo:1000:mdt00_000.0 Request processed in 137us (939us total) trans 4294968115 rc 0/0 00000100:00100000:1.0:1787826298.596519:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3262 00000100:00100000:1.0:1787826298.596559:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778596352:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787826298.596632:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016066 00010000:00010000:1.0:1787826298.596660:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596670:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596678:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596683:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.596688:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596696:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596716:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:1.0:1787826298.596719:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.596724:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596730:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349998d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596753:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63000/0x68019081f3499072 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596759:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63000/0x68019081f3499072 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596765:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63000/0x68019081f3499072 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596770:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3fd63000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.596773:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63000/0x68019081f3499072 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596779:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63000/0x68019081f3499072 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596787:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd6:0x0].0x0 (ffff9bbf1127f000) 00010000:00010000:1.0:1787826298.596789:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.596792:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63000/0x68019081f3499072 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596798:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63000/0x68019081f3499072 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596823:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596835:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596844:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596878:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596884:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596889:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596894:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.596897:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596903:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596910:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd6:0x0].0x0 (ffff9bbf1127f000) 00010000:00010000:1.0:1787826298.596912:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.596916:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596921:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f34999b0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596931:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596936:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596941:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596945:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.596947:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596952:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596958:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd6:0x0].0x0 (ffff9bbf1127f000) 00010000:00010000:1.0:1787826298.596960:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826298.596962:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.596967:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499986 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.598740:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.598767:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789610880 00000100:00100000:3.0:1787826298.598773:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789610880 00010000:00010000:3.0:1787826298.598807:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 11 pid: 8433 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.598840:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2892 00000100:00100000:3.0:1787826298.598848:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789610880:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.598888:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.598908:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 11 pid: 8433 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.598922:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 11 pid: 8433 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.598946:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826298.598950:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826298.598956:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.598966:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.598989:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826298.599027:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789610880:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 179us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.599034:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2892 00010000:00010000:2.0:1787826298.599518:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3f99623/0x68019081f3499947 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4d5 expref: 10 pid: 8433 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.599535:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778596096:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.599553:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.599563:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.599569:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.599588:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.599596:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.599608:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.599615:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826298.599619:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.599627:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.599638:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.599646:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f34999a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.599699:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789610624:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 6427us (6563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.599707:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6105 00000100:00100000:1.0:1787826298.599815:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84146:x1874668789609472:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 16704us (16893us total) trans 8590016067 rc 0/0 00000100:00100000:1.0:1787826298.599824:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110884 00000020:00080000:1.0:1787826298.599828:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826298.602087:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.602103:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778596224:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.602168:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789611008 00000100:00100000:2.0:1787826298.602175:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789611008 00010000:00010000:1.0:1787826298.602190:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.602209:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 14 pid: 45681 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.602246:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2893 00000100:00100000:2.0:1787826298.602255:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789611008:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.602270:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.602291:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 14 pid: 45681 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.602303:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 14 pid: 45681 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.602329:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f3499940 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ce expref: 14 pid: 45681 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.602344:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826298.602348:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826298.602353:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.602361:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.602391:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.602445:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789611008:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 190us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.602452:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2893 00010000:00010000:1.0:1787826298.602532:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.602542:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.602562:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.602571:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.602579:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.602586:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826298.602590:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.602600:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.602774:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.602786:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f937ea7/0x68019081f34999a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.602868:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789610752:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 8358us (8478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.602878:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6106 00000100:00100000:3.0:1787826298.602978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.603056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.603456:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789611520 00000100:00100000:1.0:1787826298.603462:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789611520 00000100:00100000:1.0:1787826298.603501:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2557 00000100:00100000:1.0:1787826298.603509:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84146:x1874668789611520:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787826298.603769:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x107:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826298.603804:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016068 00010000:00010000:1.0:1787826298.603836:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.603849:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.603892:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.603899:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.603905:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.603910:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.603928:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826298.603991:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84146:x1874668789611520:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 482us (934us total) trans 8590016069 rc 0/0 00000100:00100000:1.0:1787826298.603999:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2557 00000020:00080000:1.0:1787826298.604003:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787826298.604025:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789611264 00000100:00100000:1.0:1787826298.604029:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789611264 00000100:00100000:1.0:1787826298.604061:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110887 00000100:00100000:1.0:1787826298.604069:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84145:x1874668789611264:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.604114:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.604124:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.604131:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.604200:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.604211:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4e3 expref: 42 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.604219:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.604249:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4e3 expref: 42 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.604269:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4e3 expref: 42 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.604283:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778596480:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.604667:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826298.604674:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.604684:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826298.604687:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.604696:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.604706:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:2.0:1787826298.604709:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826298.604712:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.604718:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f34999b7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x107:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.604729:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826298.604731:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826298.604732:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826298.604787:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf404376c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.607335:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.607470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789611776 00000100:00100000:0.0:1787826298.607478:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789611776 00000100:00100000:0.0:1787826298.607543:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110888 00000100:00100000:0.0:1787826298.607553:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84144:x1874668789611776:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.607625:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.607647:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.607658:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.607808:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.607820:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ea expref: 44 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.607829:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.607902:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ea expref: 44 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.607913:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ea expref: 44 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.607932:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778596608:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826298.608009:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.609292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.609487:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778596480:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.609509:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.609761:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789611904 00000100:00100000:2.0:1787826298.609767:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789611904 00010000:00010000:2.0:1787826298.609800:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4e3 expref: 45 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.609842:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2894 00000100:00100000:2.0:1787826298.610003:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+45:2401:x1874668789611904:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.610019:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.610026:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4e3 expref: 45 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.610038:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4e3 expref: 45 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.610059:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349996a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4e3 expref: 45 pid: 23845 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.610073:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:2.0:1787826298.610077:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.610085:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.610092:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.610117:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.610170:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+44:2401:x1874668789611904:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 319us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.610178:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2894 00010000:00010000:1.0:1787826298.610226:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.610235:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826298.610339:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016070 00000001:00080000:1.0:1787826298.610459:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016072 00000001:00080000:1.0:1787826298.610498:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016073 00000100:00100000:1.0:1787826298.610572:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778596736:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826298.610623:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826298.610656:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe13482840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.610813:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778596736 00000100:00100000:0.0:1787826298.610818:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778596736 00000100:00100000:0.0:1787826298.610887:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3263 00000100:00100000:0.0:1787826298.610895:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7736:x1874668778596736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826298.610968:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7736:x1874668778596736:12345-0@lo:1000:mdt00_003.0 Request processed in 75us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.610975:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3263 00000100:00100000:1.0:1787826298.611104:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778596736:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787826298.611202:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016074 00000100:00100000:1.0:1787826298.611241:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778596864:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826298.611268:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826298.611342:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf404379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.612690:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778596608:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826298.612713:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.613109:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778596864 00000100:00100000:0.0:1787826298.613116:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778596864 00000100:00100000:1.0:1787826298.613220:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3264 00000100:00100000:1.0:1787826298.613230:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7736:x1874668778596864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826298.613402:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7736:x1874668778596864:12345-0@lo:1000:mdt00_003.0 Request processed in 173us (2132us total) trans 4294968116 rc 0/0 00000100:00100000:1.0:1787826298.613410:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3264 00000100:00100000:1.0:1787826298.613474:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778596864:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787826298.613548:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016075 00010000:00010000:1.0:1787826298.613583:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613591:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613599:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613604:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.613609:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613617:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613632:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:1.0:1787826298.613635:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.613640:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613646:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999c5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613674:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63400/0x68019081f349906b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613680:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63400/0x68019081f349906b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613686:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63400/0x68019081f349906b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613691:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3fd63400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.613694:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63400/0x68019081f349906b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613699:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63400/0x68019081f349906b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613706:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd5:0x0].0x0 (ffff9bbf1127f800) 00010000:00010000:1.0:1787826298.613708:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.613710:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63400/0x68019081f349906b lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613715:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63400/0x68019081f349906b lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613735:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613747:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613755:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613762:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613768:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613776:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613781:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.613784:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613789:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613796:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd5:0x0].0x0 (ffff9bbf1127f800) 00010000:00010000:1.0:1787826298.613799:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.613802:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613807:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f34999da lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613816:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613833:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613839:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613845:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.613848:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613873:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613881:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd5:0x0].0x0 (ffff9bbf1127f800) 00010000:00010000:1.0:1787826298.613883:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826298.613886:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 2/0,0 mode: --/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.613891:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f34999be lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.613986:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84145:x1874668789611264:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 9916us (11007us total) trans 8590016076 rc 0/0 00000100:00100000:1.0:1787826298.613996:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110887 00000020:00080000:1.0:1787826298.614000:0:7736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826298.620463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.620546:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789612032 00000100:00100000:3.0:1787826298.620555:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789612032 00010000:00010000:3.0:1787826298.620597:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ea expref: 48 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.620639:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2895 00000100:00100000:3.0:1787826298.620648:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2401:x1874668789612032:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.620663:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.620669:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ea expref: 48 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.620681:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ea expref: 48 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.620719:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349997f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ea expref: 48 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.620735:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:3.0:1787826298.620740:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.620749:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.620757:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.620789:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826298.620879:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2401:x1874668789612032:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 231us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.620886:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2895 00010000:00010000:0.0:1787826298.621044:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.621052:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826298.621159:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016071 00000001:00080000:0.0:1787826298.621267:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016077 00000001:00080000:0.0:1787826298.621304:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016078 00000100:00100000:0.0:1787826298.621377:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778596992:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826298.621440:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826298.621470:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.622249:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778596992 00000100:00100000:3.0:1787826298.622255:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778596992 00000100:00100000:3.0:1787826298.622323:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1787826298.622333:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6516:x1874668778596992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826298.622475:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6516:x1874668778596992:12345-0@lo:1000:mdt00_001.0 Request processed in 144us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.622482:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1787826298.623349:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.623473:0:6516:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968127 gen 2 00000004:00080000:2.0:1787826298.623480:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968126 committed transno 4294968127 00000004:00080000:2.0:1787826298.623498:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968127 committed transno 4294968127 00000100:00100000:2.0:1787826298.623511:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778596992:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787826298.623628:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016079 00000100:00100000:2.0:1787826298.623685:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a1161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778597120:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826298.623892:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.623916:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.624222:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789612288 00000100:00100000:0.0:1787826298.625161:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789612288 00000100:00100000:0.0:1787826298.625240:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2558 00000100:00100000:0.0:1787826298.625251:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84145:x1874668789612288:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787826298.625475:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x108:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826298.625508:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016081 00010000:00010000:0.0:1787826298.625543:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.625559:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.625572:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.625580:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.625586:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.625593:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.625745:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778597120 00000100:00100000:1.0:1787826298.625750:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778597120 00000100:00100000:1.0:1787826298.625783:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266 00000100:00100000:1.0:1787826298.625790:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6516:x1874668778597120:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826298.625954:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6516:x1874668778597120:12345-0@lo:1000:mdt00_001.0 Request processed in 163us (2103us total) trans 4294968130 rc 0/0 00000100:00100000:1.0:1787826298.625962:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266 00000100:00100000:2.0:1787826298.626015:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a1161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778597120:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787826298.626074:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016080 00010000:00010000:2.0:1787826298.626098:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626105:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626112:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626117:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.626121:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626129:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626142:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:2.0:1787826298.626144:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.626148:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626154:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f34999d3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626176:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63c00/0x68019081f3499064 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626181:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63c00/0x68019081f3499064 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626191:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63c00/0x68019081f3499064 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626195:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3fd63c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.626198:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63c00/0x68019081f3499064 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626204:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63c00/0x68019081f3499064 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626212:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd4:0x0].0x0 (ffff9bbf1127ff00) 00010000:00010000:2.0:1787826298.626214:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.626218:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63c00/0x68019081f3499064 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626223:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63c00/0x68019081f3499064 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626241:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626250:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.626258:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826298.626258:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626265:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626271:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626276:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626281:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.626283:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626288:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626295:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd4:0x0].0x0 (ffff9bbf1127ff00) 00010000:00010000:2.0:1787826298.626297:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.626299:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626304:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f34999e8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.626336:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84145:x1874668789612288:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1086us (2988us total) trans 8590016082 rc 0/0 00000100:00100000:0.0:1787826298.626344:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2558 00000020:00080000:0.0:1787826298.626348:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787826298.626463:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626470:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626476:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626482:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.626485:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626495:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626503:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd4:0x0].0x0 (ffff9bbf1127ff00) 00010000:00010000:2.0:1787826298.626506:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826298.626508:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 2/0,0 mode: --/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.626514:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f34999cc lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.626608:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84144:x1874668789611776:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 19056us (19280us total) trans 8590016083 rc 0/0 00000100:00100000:2.0:1787826298.626616:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110888 00000020:00080000:2.0:1787826298.626619:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1787826298.626937:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826298.626943:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826298.627066:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9664 count 103 00000040:00080000:0.0:1787826298.627073:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787826298.627180:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778597248:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826298.627413:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2240 going to sleep for 11 seconds 00010000:00010000:3.0:1787826298.627845:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826298.627876:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.627885:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826298.627888:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.627895:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.627907:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:3.0:1787826298.627909:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826298.627912:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.627918:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f34999e1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.627928:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826298.627930:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826298.627932:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826298.630566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.630714:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778597248:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826298.631355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.631398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.631420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.631492:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789612672 00000100:00100000:2.0:1787826298.631499:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789612672 00000100:00100000:2.0:1787826298.631553:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789612800 00000100:00100000:2.0:1787826298.631556:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789612800 00000100:00100000:2.0:1787826298.631574:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789612928 00000100:00100000:2.0:1787826298.631577:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789612928 00000100:00100000:2.0:1787826298.631598:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110889 00000100:00100000:2.0:1787826298.631607:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84152:x1874668789612672:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826298.631643:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd8:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826298.631748:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84152:x1874668789612672:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 142us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.631756:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110889 00000100:00100000:2.0:1787826298.631774:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110890 00000100:00100000:2.0:1787826298.631781:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84151:x1874668789612800:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826298.631794:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826298.631830:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84151:x1874668789612800:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.631836:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110890 00000100:00100000:2.0:1787826298.631848:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110891 00000100:00100000:2.0:1787826298.631873:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84153:x1874668789612928:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826298.631885:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd9:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826298.631924:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84153:x1874668789612928:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 52us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.631930:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110891 00000100:00100000:1.0:1787826298.634311:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789612544 00000100:00100000:1.0:1787826298.634324:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789612544 00000100:00100000:1.0:1787826298.634474:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2559 00000100:00100000:1.0:1787826298.634486:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84144:x1874668789612544:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787826298.634733:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x109:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826298.634767:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016084 00010000:00010000:1.0:1787826298.634802:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 3/0,1 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.634818:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.634830:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.634839:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.634846:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.634884:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.634902:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826298.634998:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84144:x1874668789612544:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 514us (4439us total) trans 8590016085 rc 0/0 00000100:00100000:1.0:1787826298.635006:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2559 00000020:00080000:1.0:1787826298.635011:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826298.635068:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826298.635076:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.635083:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826298.635086:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.635094:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.635108:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:0.0:1787826298.635112:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826298.635117:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 1/0,0 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.635123:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f34999ef lrc: 0/0,0 mode: --/PW res: [0x200000403:0x109:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.635136:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826298.635138:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826298.635140:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826298.635514:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.635593:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.635937:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789613056 00000100:00100000:3.0:1787826298.635943:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789613056 00000100:00100000:3.0:1787826298.635982:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789613184 00000100:00100000:3.0:1787826298.635985:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789613184 00000100:00100000:3.0:1787826298.636006:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110892 00000100:00100000:3.0:1787826298.636014:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84151:x1874668789613056:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.636042:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110893 00000100:00100000:0.0:1787826298.636050:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84152:x1874668789613184:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.636065:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636076:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636082:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636090:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636091:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636099:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636104:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636109:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636111:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636116:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636117:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636123:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636140:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636140:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636148:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636148:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636155:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636155:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.636187:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd8:0x0]: returning size 158 00000004:00200000:3.0:1787826298.636187:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd7:0x0]: returning size 158 00000004:00200000:3.0:1787826298.636191:0:45682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:0.0:1787826298.636192:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826298.636201:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826298.636201:0:45682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636212:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636223:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636223:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636230:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636230:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636236:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636245:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636363:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.636368:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636376:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636387:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826298.636389:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.636393:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636399:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f34999f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636409:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636414:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636420:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636425:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.636440:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636446:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636453:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdd82f546 (ffff9bbe0a9bf000) 00010000:00010000:3.0:1787826298.636455:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.636458:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636464:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499a04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdd82f546 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636478:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636484:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636490:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636494:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.636497:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636502:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636509:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd7:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:3.0:1787826298.636511:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.636514:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.636519:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a19 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.636576:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84151:x1874668789613056:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 562us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.636583:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110892 00010000:00010000:0.0:1787826298.636833:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.636837:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636843:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636871:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826298.636874:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.636877:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636884:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f34999fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636894:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636900:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636905:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636911:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.636913:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636919:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636927:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2a2dace3 (ffff9bbf0f565700) 00010000:00010000:0.0:1787826298.636929:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.636932:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636938:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499a0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2a2dace3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636949:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636955:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636961:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636966:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.636969:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636974:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636984:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd8:0x0].0x0 (ffff9bbf41389e00) 00010000:00010000:0.0:1787826298.636985:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.636988:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.636992:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499a12 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.637033:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84152:x1874668789613184:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 983us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.637040:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110893 00000100:00100000:0.0:1787826298.639585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.639682:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789613312 00000100:00100000:2.0:1787826298.639692:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789613312 00000100:00100000:2.0:1787826298.639763:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110894 00000100:00100000:2.0:1787826298.639774:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84153:x1874668789613312:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.639844:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.639893:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.639904:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.639918:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.639931:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.639937:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.639964:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.639973:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.639979:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.640020:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd9:0x0]: returning size 158 00000004:00200000:2.0:1787826298.640024:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826298.640036:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640048:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640054:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640060:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640066:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640077:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.640082:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640089:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640100:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826298.640102:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.640106:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640111:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499a20 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640123:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640128:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640133:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640137:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.640140:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640145:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640156:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4150faad (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.640159:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.640161:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640167:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499a27 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4150faad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640180:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640186:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640192:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640196:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.640199:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640205:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640211:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd9:0x0].0x0 (ffff9bbf41389a00) 00010000:00010000:2.0:1787826298.640232:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.640236:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.640242:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499a2e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.640322:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84153:x1874668789613312:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 549us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.640329:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110894 00000100:00100000:3.0:1787826298.642127:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.642163:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.642224:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789613568 00000100:00100000:0.0:1787826298.642233:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789613568 00000100:00100000:0.0:1787826298.642288:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789613824 00000100:00100000:0.0:1787826298.642291:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789613824 00000100:00100000:0.0:1787826298.642326:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110895 00000100:00100000:0.0:1787826298.642335:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84152:x1874668789613568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.642354:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.642374:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499a35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4f1 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642484:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642499:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642511:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.642521:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd8:0x0]: returning size 158 00010000:00010000:0.0:1787826298.642597:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642605:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642612:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642619:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.642623:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642630:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642641:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd8:0x0].0x0 (ffff9bbf41389e00) 00010000:00010000:0.0:1787826298.642644:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826298.642648:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642654:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499a3c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642694:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499a35 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4f1 expref: 58 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642705:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826298.642707:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826298.642711:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499a35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4f1 expref: 58 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642721:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:0.0:1787826298.642775:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84152:x1874668789613568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 441us (657us total) trans 8590016086 rc 301/301 00000100:00100000:0.0:1787826298.642782:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110895 00000100:00100000:0.0:1787826298.642801:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110896 00000100:00100000:0.0:1787826298.642808:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84151:x1874668789613824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.642815:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.642824:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499a4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4f8 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642890:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642899:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642906:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.642913:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd7:0x0]: returning size 158 00010000:00010000:0.0:1787826298.642942:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642950:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642956:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642962:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.642965:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642971:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642985:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd7:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:0.0:1787826298.642987:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826298.642990:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.642995:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f3499a51 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.643017:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499a4a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4f8 expref: 58 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.643026:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826298.643028:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826298.643031:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499a4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4f8 expref: 58 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.643039:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc 0) 00000100:00100000:0.0:1787826298.643060:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84151:x1874668789613824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 253us (897us total) trans 8590016087 rc 301/301 00000100:00100000:0.0:1787826298.643067:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110896 00000100:00100000:0.0:1787826298.646753:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.646791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.646828:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.646844:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789614080 00000100:00100000:2.0:1787826298.646870:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789614080 00000100:00100000:2.0:1787826298.646929:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789614208 00000100:00100000:2.0:1787826298.646932:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789614208 00000100:00100000:2.0:1787826298.646949:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789614336 00000100:00100000:2.0:1787826298.646952:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789614336 00000100:00100000:2.0:1787826298.646978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110897 00000100:00100000:2.0:1787826298.646988:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84153:x1874668789614080:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.647008:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787826298.647020:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110898 00010000:00010000:2.0:1787826298.647027:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499a5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb4ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.647029:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84151:x1874668789614208:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826298.647048:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd7:0x0] from 18446744073709551615 #0 00010000:00010000:2.0:1787826298.647112:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.647125:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.647135:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.647144:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd9:0x0]: returning size 158 00000100:00100000:3.0:1787826298.647152:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84151:x1874668789614208:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 124us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.647159:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110898 00000100:00100000:3.0:1787826298.647178:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110899 00000100:00100000:3.0:1787826298.647184:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84152:x1874668789614336:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826298.647198:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd8:0x0] from 18446744073709551615 #0 00010000:00010000:2.0:1787826298.647231:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.647238:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.647245:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.647251:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.647255:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.647263:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.647275:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd9:0x0].0x0 (ffff9bbf41389a00) 00010000:00010000:2.0:1787826298.647277:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826298.647281:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.647288:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499a66 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.647322:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84152:x1874668789614336:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 128us (484us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826298.647325:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499a5f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ff expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.647329:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110899 00010000:00010000:2.0:1787826298.647336:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826298.647338:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826298.647342:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499a5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb4ff expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.647350:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826298.647375:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84153:x1874668789614080:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 390us (632us total) trans 8590016088 rc 301/301 00000100:00100000:2.0:1787826298.647385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110897 00000100:00100000:0.0:1787826298.651001:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.651041:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.651095:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789614592 00000100:00100000:2.0:1787826298.651104:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789614592 00000100:00100000:1.0:1787826298.651127:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789614720 00000100:00100000:1.0:1787826298.651131:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789614720 00000100:00100000:2.0:1787826298.651199:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110900 00000100:00100000:2.0:1787826298.651394:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84152:x1874668789614592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.651419:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.651453:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499a74 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb506 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.651522:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110901 00000100:00100000:1.0:1787826298.651531:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84153:x1874668789614720:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826298.651551:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xd9:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826298.651649:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84153:x1874668789614720:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 119us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.651656:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110901 00010000:00010000:2.0:1787826298.652269:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499a7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.652286:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499a7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.652296:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499a7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.652307:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10a:0x0]: returning size 0 00010000:00010000:2.0:1787826298.652353:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499a74 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb506 expref: 61 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.652378:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499a7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb506 expref: 60 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.652386:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826298.652517:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826298.652521:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826298.652592:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84152:x1874668789614592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1385us (1603us total) trans 8590016089 rc 0/0 00000100:00100000:2.0:1787826298.652600:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110900 00000100:00100000:0.0:1787826298.655561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.655644:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789614976 00000100:00100000:3.0:1787826298.655654:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789614976 00000100:00100000:3.0:1787826298.655723:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110902 00000100:00100000:3.0:1787826298.655732:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84153:x1874668789614976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.655755:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.655778:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499a89 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb50d expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.656249:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.656264:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.656274:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826298.656284:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10b:0x0]: returning size 0 00010000:00010000:3.0:1787826298.656328:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499a89 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb50d expref: 63 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.656345:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb50d expref: 62 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.656353:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0a9bf000) 00010000:00010000:3.0:1787826298.656356:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826298.656360:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826298.656558:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84153:x1874668789614976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 826us (1006us total) trans 8590016090 rc 0/0 00000100:00100000:3.0:1787826298.656565:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110902 00000100:00100000:3.0:1787826298.663818:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.664009:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.664243:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789615360 00000100:00100000:1.0:1787826298.664253:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789615360 00000100:00100000:1.0:1787826298.664312:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3267 00000100:00100000:1.0:1787826298.664322:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+62:2401:x1874668789615360:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826298.664376:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.664407:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499a9e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb514 expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664470:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664484:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664495:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664508:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664514:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664521:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664563:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664571:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664578:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664584:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.664588:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664595:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664607:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826298.664610:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.664614:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664619:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499aa5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664632:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664637:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664642:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664647:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.664650:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664655:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664662:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x9a71611a (ffff9bbe16e56d00) 00010000:00010000:1.0:1787826298.664664:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.664667:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664672:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499aac lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x9a71611a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664699:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499a9e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb514 expref: 63 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664709:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826298.664711:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826298.664714:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499a9e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb514 expref: 63 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.664723:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc -2) 00000100:00100000:1.0:1787826298.664780:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+62:2401:x1874668789615360:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 460us (771us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826298.664788:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3267 00000100:00100000:2.0:1787826298.666515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789615232 00000100:00100000:2.0:1787826298.666532:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789615232 00000100:00100000:2.0:1787826298.666591:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110903 00000100:00100000:2.0:1787826298.666601:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84153:x1874668789615232:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.666651:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.666677:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499a90 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb50d expref: 62 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666693:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0a9bf000) 00010000:00010000:2.0:1787826298.666702:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826298.666722:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666734:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666744:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666758:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666765:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666771:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666818:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666825:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666831:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666837:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666842:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.666846:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666878:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666886:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826298.666889:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.666892:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666899:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ab3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666909:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666915:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666921:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666926:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.666928:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666934:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666942:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x698f90fb (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.666944:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.666947:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.666952:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499aba lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x698f90fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.667032:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84153:x1874668789615232:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 433us (3224us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826298.667039:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110903 00000100:00100000:0.0:1787826298.670281:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.670357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.670583:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789615488 00000100:00100000:1.0:1787826298.670592:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789615488 00000100:00100000:2.0:1787826298.670700:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789615744 00000100:00100000:2.0:1787826298.670705:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789615744 00000100:00100000:2.0:1787826298.670780:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110904 00000100:00100000:2.0:1787826298.670791:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84153:x1874668789615488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.670810:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.670832:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499ac1 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb54c expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.670902:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.670915:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.670926:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.671038:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499ac1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb54c expref: 64 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.671057:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb54c expref: 63 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.671064:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826298.671068:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826298.671071:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:2.0:1787826298.671122:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84153:x1874668789615488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 333us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.671129:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110904 00000100:00100000:2.0:1787826298.671147:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110905 00000100:00100000:2.0:1787826298.671154:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84151:x1874668789615744:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.671161:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.671170:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499acf lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb553 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.671772:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499ad6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.671784:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.671793:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.671802:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10c:0x0]: returning size 0 00010000:00010000:2.0:1787826298.671843:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499acf lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb553 expref: 65 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.671894:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb553 expref: 64 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.671902:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826298.671904:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826298.671907:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826298.671942:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84151:x1874668789615744:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 789us (1585us total) trans 8590016091 rc 0/0 00000100:00100000:2.0:1787826298.671949:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110905 00000100:00100000:0.0:1787826298.674288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.674358:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.674642:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789616000 00000100:00100000:2.0:1787826298.674642:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789616256 00000100:00100000:1.0:1787826298.674651:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789616000 00000100:00100000:2.0:1787826298.674651:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789616256 00000100:00100000:2.0:1787826298.674778:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110906 00000100:00100000:2.0:1787826298.674788:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84152:x1874668789616256:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.674844:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.674892:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499a7b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb506 expref: 65 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.674909:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826298.674919:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826298.674939:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.674952:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.674961:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.674974:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.674977:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110907 00010000:00010000:2.0:1787826298.674981:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.674985:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84153:x1874668789616000:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.674988:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.675024:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675028:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.675033:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675034:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.675041:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675042:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675048:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.675052:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675059:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675066:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826298.675068:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.675072:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675077:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499ae4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675085:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675090:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675095:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675099:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.675101:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675106:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675112:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x527e8480 (ffff9bbe0fe8c200) 00010000:00010000:2.0:1787826298.675114:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.675117:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.675122:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499aeb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x527e8480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826298.675159:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c126bd1 reply state 00000000a8b5d118 transno 8590016092 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.675171:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.675176:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:1.0:1787826298.675179:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826298.675181:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826298.675187:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84152:x1874668789616256:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 402us (830us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826298.675194:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110906 00000100:00100000:1.0:1787826298.679595:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84153:x1874668789616000:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 4601us (5387us total) trans 8590016092 rc 0/0 00000100:00100000:1.0:1787826298.679607:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110907 00000100:00100000:0.0:1787826298.681280:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.681407:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789616384 00000100:00100000:2.0:1787826298.681416:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789616384 00000100:00100000:2.0:1787826298.681478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110908 00000100:00100000:2.0:1787826298.681487:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf4054d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84152:x1874668789616384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.681507:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.681529:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499af9 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb55a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.681563:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.681576:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.681588:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.681697:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499af9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb55a expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.681715:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb55a expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.681723:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.681726:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826298.681729:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2e00, rc 0) 00000100:00100000:2.0:1787826298.681795:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf4054d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84152:x1874668789616384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 310us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.681803:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110908 00000100:00100000:3.0:1787826298.683688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.683781:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789616512 00000100:00100000:3.0:1787826298.683789:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789616512 00000100:00100000:3.0:1787826298.683842:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110909 00000100:00100000:3.0:1787826298.683872:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84153:x1874668789616512:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.683891:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.683910:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb561 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.683964:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb561 expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.683978:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb561 expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.683988:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:3.0:1787826298.683990:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826298.683994:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc 0) 00000100:00100000:3.0:1787826298.684040:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84153:x1874668789616512:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 190us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.684046:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110909 00000100:00100000:3.0:1787826298.684775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.684844:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789616768 00000100:00100000:0.0:1787826298.684877:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789616768 00000100:00100000:0.0:1787826298.684910:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110910 00000100:00100000:0.0:1787826298.684918:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84151:x1874668789616768:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.684958:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.684978:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499ad6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb553 expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.684995:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826298.685004:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826298.685023:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685034:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685049:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685067:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685074:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685080:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685125:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685132:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685138:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685145:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685150:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.685153:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685159:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685166:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826298.685169:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.685173:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685180:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b0e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685189:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685195:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685201:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685206:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.685209:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685215:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685226:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xa6eea55d (ffff9bbf0f565700) 00010000:00010000:0.0:1787826298.685229:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.685231:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.685236:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b15 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa6eea55d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.685289:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84151:x1874668789616768:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 372us (515us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826298.685296:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110910 00000100:00100000:3.0:1787826298.685925:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.686653:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789616896 00000100:00100000:1.0:1787826298.686662:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789616896 00000100:00100000:1.0:1787826298.686716:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3268 00000100:00100000:1.0:1787826298.686726:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2400:x1874668789616896:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826298.686776:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.686794:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b1c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb568 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686874:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686889:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686899:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686912:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686919:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686926:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686956:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686963:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686971:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686976:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.686981:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686989:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.686999:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826298.687002:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.687006:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687012:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499b23 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687023:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687029:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687034:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687039:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.687042:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687047:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687053:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x1ac624e6 (ffff9bbe16e56d00) 00010000:00010000:1.0:1787826298.687055:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.687058:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687063:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499b2a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x1ac624e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687089:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b1c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb568 expref: 67 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687097:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826298.687099:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826298.687102:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b1c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb568 expref: 67 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.687110:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc -2) 00000100:00100000:1.0:1787826298.687160:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2400:x1874668789616896:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 437us (1238us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826298.687168:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3268 00000100:00100000:1.0:1787826298.688916:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.688949:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.689471:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.689716:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789617280 00000100:00100000:0.0:1787826298.689724:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789617280 00000100:00100000:0.0:1787826298.689768:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2560 00000100:00100000:0.0:1787826298.689777:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84153:x1874668789617280:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.689916:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84153:x1874668789617280:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 139us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.689923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2560 00000100:00100000:0.0:1787826298.689987:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778597376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826298.690026:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826298.690245:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789617152 00000100:00100000:1.0:1787826298.690251:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789617152 00000100:00100000:1.0:1787826298.690285:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789617408 00000100:00100000:1.0:1787826298.690289:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789617408 00000100:00100000:1.0:1787826298.690310:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110911 00000100:00100000:0.0:1787826298.690896:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0884ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778597504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826298.690933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826298.690989:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84152:x1874668789617152:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.691061:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778597376 00000100:00100000:3.0:1787826298.691066:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778597376 00000100:00100000:3.0:1787826298.691092:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778597504 00000100:00100000:3.0:1787826298.691094:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778597504 00000100:00100000:3.0:1787826298.691109:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269 00000100:00100000:3.0:1787826298.691115:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778597376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826298.691134:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:3.0:1787826298.691180:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778597376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.691187:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269 00000100:00100000:3.0:1787826298.691200:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270 00010000:00010000:1.0:1787826298.691252:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.691270:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.691283:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.691366:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778597504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826298.691380:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000004:00010000:1.0:1787826298.691482:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031b8a58f reply state 00000000f0f62552 transno 8590016093 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.691494:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.691501:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:1.0:1787826298.691504:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826298.691508:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826298.691568:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778597504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 204us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.691574:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270 00000100:00100000:3.0:1787826298.691612:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0884ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778597504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826298.691638:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778597376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826298.691733:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84152:x1874668789617152:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 747us (2823us total) trans 8590016093 rc 0/0 00000100:00100000:2.0:1787826298.693042:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110912 00000100:00100000:1.0:1787826298.693082:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110911 00000100:00100000:2.0:1787826298.693090:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84151:x1874668789617408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.693107:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.693126:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499b38 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5a0 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.693382:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.693395:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.693404:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.693514:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499b38 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a0 expref: 70 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.693532:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a0 expref: 69 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.693551:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826298.693554:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826298.693558:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826298.693613:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84151:x1874668789617408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 531us (4143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.693620:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110912 00000100:00100000:3.0:1787826298.694237:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.695010:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.695046:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789617792 00000100:00100000:2.0:1787826298.695053:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789617792 00000100:00100000:2.0:1787826298.695104:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110913 00000100:00100000:2.0:1787826298.695113:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84152:x1874668789617792:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.695190:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.695329:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5a7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.695382:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a7 expref: 70 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.695396:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a7 expref: 70 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.695404:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.695406:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.695409:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826298.695467:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84152:x1874668789617792:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 355us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.695477:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110913 00000100:00100000:1.0:1787826298.695790:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789617664 00000100:00100000:1.0:1787826298.695795:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789617664 00000100:00100000:1.0:1787826298.695883:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2561 00000100:00100000:1.0:1787826298.695892:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84153:x1874668789617664:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.696061:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84153:x1874668789617664:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 169us (1831us total) trans 8590016094 rc 0/0 00000100:00100000:1.0:1787826298.696068:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2561 00000100:00100000:3.0:1787826298.696542:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.696615:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789618048 00000100:00100000:0.0:1787826298.696620:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789618048 00000100:00100000:0.0:1787826298.696685:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110914 00000100:00100000:0.0:1787826298.696707:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84151:x1874668789618048:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.696763:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.696777:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.696787:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826298.696921:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a4680ac reply state 00000000853b2ed4 transno 8590016095 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.696935:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.696943:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826298.696946:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787826298.696949:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826298.697006:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84151:x1874668789618048:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 314us (466us total) trans 8590016095 rc 0/0 00000100:00100000:0.0:1787826298.697013:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110914 00000100:00100000:3.0:1787826298.698533:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.698869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.698903:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789618432 00000100:00100000:2.0:1787826298.698910:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789618432 00000100:00100000:2.0:1787826298.698964:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2562 00000100:00100000:2.0:1787826298.698973:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84152:x1874668789618432:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.699073:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84152:x1874668789618432:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 101us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.699081:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2562 00000100:00100000:0.0:1787826298.699813:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789618304 00000100:00100000:0.0:1787826298.699820:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789618304 00000100:00100000:1.0:1787826298.699926:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110915 00000100:00100000:1.0:1787826298.699938:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84153:x1874668789618304:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.700012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.700077:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789618560 00000100:00100000:0.0:1787826298.700081:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789618560 00000100:00100000:1.0:1787826298.700123:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84153:x1874668789618304:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 187us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.700134:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110915 00000100:00100000:1.0:1787826298.700152:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110916 00000100:00100000:1.0:1787826298.700159:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84151:x1874668789618560:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.700171:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.700189:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5ae expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.700232:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ae expref: 74 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.700247:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ae expref: 74 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.700257:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826298.700260:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826298.700263:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826298.700296:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84151:x1874668789618560:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 136us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.700302:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110916 00000100:00100000:3.0:1787826298.700663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.700692:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789618816 00000100:00100000:2.0:1787826298.700697:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789618816 00000100:00100000:2.0:1787826298.700734:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2563 00000100:00100000:2.0:1787826298.700742:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84152:x1874668789618816:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.700916:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84152:x1874668789618816:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 174us (254us total) trans 8590016096 rc 0/0 00000100:00100000:2.0:1787826298.700923:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2563 00000100:00100000:3.0:1787826298.704359:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.704411:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.704454:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.704484:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789619200 00000100:00100000:0.0:1787826298.704494:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789619200 00000100:00100000:0.0:1787826298.704592:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789619456 00000100:00100000:0.0:1787826298.704596:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789619456 00000100:00100000:1.0:1787826298.704609:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789618944 00000100:00100000:1.0:1787826298.704614:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789618944 00000100:00100000:1.0:1787826298.704653:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2564 00000100:00100000:1.0:1787826298.704662:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84151:x1874668789618944:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.704790:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84151:x1874668789618944:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 129us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.704800:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2564 00000100:00100000:2.0:1787826298.706665:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110917 00000100:00100000:2.0:1787826298.706687:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84152:x1874668789619200:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.707061:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84152:x1874668789619200:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 383us (2648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.707069:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110917 00000100:00100000:2.0:1787826298.707095:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110918 00000100:00100000:2.0:1787826298.707102:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84153:x1874668789619456:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.707115:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.707136:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499b5b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5b5 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.707227:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.707245:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb561 expref: 76 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.707253:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.707288:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb561 expref: 76 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.707302:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb561 expref: 76 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.707328:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778597632:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.707401:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.711354:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.711436:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.711467:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.711537:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789619712 00000100:00100000:0.0:1787826298.711547:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789619712 00000100:00100000:2.0:1787826298.711570:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778597632:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.711600:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.711624:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789620096 00000100:00100000:2.0:1787826298.711628:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789620096 00000100:00100000:2.0:1787826298.711660:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110919 00000100:00100000:2.0:1787826298.711668:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84152:x1874668789620096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.711689:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.711718:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499b69 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.711815:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.711842:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a7 expref: 79 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.711871:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.711901:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a7 expref: 79 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.711913:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a7 expref: 79 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.711926:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778597760:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.711988:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.712126:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2565 00000100:00100000:0.0:1787826298.712135:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84151:x1874668789619712:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.712453:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789619840 00000100:00100000:3.0:1787826298.712459:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789619840 00010000:00010000:3.0:1787826298.712482:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb561 expref: 81 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.712515:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2896 00000100:00100000:3.0:1787826298.712523:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2402:x1874668789619840:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.712532:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.712539:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb561 expref: 81 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.712551:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb561 expref: 81 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.712569:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b07 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb561 expref: 81 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.712583:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:3.0:1787826298.712588:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.712597:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.712604:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.712621:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826298.712673:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.712681:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.712704:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10b:0x0]: returning size 0 00000004:00080000:2.0:1787826298.712836:0:45683:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb4:0x0], index 0: 0 00010000:00010000:2.0:1787826298.712928:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.712937:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.712944:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.712950:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.712954:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.712962:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.712972:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826298.712975:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.712979:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.712985:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499b62 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.713019:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499b5b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5b5 expref: 81 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.713029:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826298.713031:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826298.713034:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499b5b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5b5 expref: 81 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.713048:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:0.0:1787826298.715607:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84151:x1874668789619712:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 3464us (4252us total) trans 8590016097 rc 0/0 00000100:00100000:0.0:1787826298.715622:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2565 00000100:00100000:3.0:1787826298.715636:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2402:x1874668789619840:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3111us (4205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.715648:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2896 00000100:00100000:3.0:1787826298.715764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.715785:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789620224 00000100:00100000:3.0:1787826298.715793:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789620224 00010000:00010000:3.0:1787826298.716038:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a7 expref: 79 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.716070:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2897 00000100:00100000:3.0:1787826298.716079:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2401:x1874668789620224:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826298.716093:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.716100:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a7 expref: 79 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.716112:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a7 expref: 79 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.716133:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:3.0:1787826298.716139:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.716149:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.716156:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.716175:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826298.716204:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2401:x1874668789620224:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 126us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.716210:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2897 00000100:00100000:2.0:1787826298.716287:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84153:x1874668789619456:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9183us (11830us total) trans 8590016098 rc 301/301 00000100:00100000:2.0:1787826298.716296:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110918 00010000:00010000:0.0:1787826298.716521:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499b46 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a7 expref: 77 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.716538:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778597760:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.716559:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.716573:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.716580:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.716608:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10a:0x0]: returning size 0 00000004:00080000:0.0:1787826298.716756:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb5:0x0], index 1: 0 00010000:00010000:0.0:1787826298.716887:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.716896:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.716903:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.716909:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.716913:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.716920:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.716931:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:0.0:1787826298.716933:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.716937:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.716943:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499b70 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.716993:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499b69 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5bc expref: 77 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.717003:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826298.717005:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826298.717009:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499b69 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5bc expref: 77 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.717019:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:0.0:1787826298.717061:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84152:x1874668789620096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5392us (5592us total) trans 8590016099 rc 301/301 00000100:00100000:0.0:1787826298.717073:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110919 00000100:00100000:3.0:1787826298.718709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.718765:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789620480 00000100:00100000:2.0:1787826298.718772:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789620480 00000100:00100000:2.0:1787826298.718836:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110920 00000100:00100000:2.0:1787826298.718846:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84151:x1874668789620480:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.718974:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84151:x1874668789620480:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 129us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.718981:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110920 00000100:00100000:1.0:1787826298.721159:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.721205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.721240:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789620736 00000100:00100000:3.0:1787826298.721248:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789620736 00000100:00100000:0.0:1787826298.721269:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789620992 00000100:00100000:0.0:1787826298.721276:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789620992 00000100:00100000:3.0:1787826298.721302:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2566 00000100:00100000:3.0:1787826298.721325:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84152:x1874668789620736:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.721592:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84152:x1874668789620736:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 280us (440us total) trans 8590016100 rc 0/0 00000100:00100000:0.0:1787826298.722584:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2567 00000100:00100000:0.0:1787826298.722600:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84153:x1874668789620992:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.722792:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84153:x1874668789620992:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 197us (1585us total) trans 8590016101 rc 0/0 00000100:00100000:0.0:1787826298.722800:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2567 00000100:00100000:3.0:1787826298.723583:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2566 00000100:00100000:1.0:1787826298.723773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.724196:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789621248 00000100:00100000:0.0:1787826298.724205:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789621248 00000100:00100000:0.0:1787826298.724255:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110921 00000100:00100000:0.0:1787826298.724263:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84151:x1874668789621248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.724279:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.724299:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b85 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5c3 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.724401:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.724416:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ae expref: 79 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.724424:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.724468:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ae expref: 79 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.724482:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ae expref: 79 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.724496:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778597888:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826298.724568:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.724963:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.725030:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789621376 00000100:00100000:3.0:1787826298.725034:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789621376 00000100:00100000:3.0:1787826298.725075:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110922 00000100:00100000:3.0:1787826298.725083:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84152:x1874668789621376:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.725095:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.725108:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b93 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5ca expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.725151:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499b9a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.725162:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499b9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.725174:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499b9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826298.725200:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10a:0x0]: returning size 0 00000004:00200000:3.0:1787826298.725204:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826298.725222:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499b9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.725250:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499b93 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ca expref: 82 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.725265:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499b9a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ca expref: 81 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.725274:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:3.0:1787826298.725277:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826298.725280:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:3.0:1787826298.725326:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84152:x1874668789621376:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 244us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.725333:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110922 00000100:00100000:0.0:1787826298.727061:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778597888:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.727091:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.728681:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.728730:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.728779:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789621632 00000100:00100000:1.0:1787826298.728782:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.728788:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789621632 00000100:00100000:3.0:1787826298.728842:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110923 00000100:00100000:3.0:1787826298.728887:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84153:x1874668789621632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.729033:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.729061:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ba1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.729065:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789621760 00000100:00100000:2.0:1787826298.729072:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789621760 00010000:00010000:2.0:1787826298.729098:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ae expref: 83 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.729128:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2898 00010000:00010000:1.0:1787826298.729136:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499ba8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.729137:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40517050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+83:2401:x1874668789621760:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.729150:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.729158:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ae expref: 83 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.729159:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.729182:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.729183:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ae expref: 83 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.729216:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f3499b54 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ae expref: 83 pid: 7736 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.729232:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00000004:00200000:1.0:1787826298.729234:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10b:0x0]: returning size 0 00010000:00010000:2.0:1787826298.729237:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826298.729239:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787826298.729250:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.729256:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826298.729260:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.729282:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826298.729289:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ba1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d8 expref: 83 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.729304:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d8 expref: 82 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.729311:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:1.0:1787826298.729314:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826298.729317:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:2.0:1787826298.729332:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40517050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2401:x1874668789621760:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 196us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.729339:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2898 00000100:00100000:1.0:1787826298.729347:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84153:x1874668789621632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 495us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.729356:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110923 00010000:00010000:2.0:1787826298.729484:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.729492:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.729506:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10c:0x0]: returning size 0 00000004:00080000:2.0:1787826298.729635:0:23845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb5:0x0], index 0: 0 00000100:00100000:0.0:1787826298.729780:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789621504 00000100:00100000:0.0:1787826298.729784:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789621504 00000100:00100000:0.0:1787826298.729813:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6107 00000100:00100000:0.0:1787826298.729821:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2399:x1874668789621504:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.729831:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.729846:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5d1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826298.729962:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826298.729980:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=2936s v=(0 0) 00010000:00010000:0.0:1787826298.729985:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.729995:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d1 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.730003:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.730010:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d1 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.730014:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.730030:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3800, rc 0) 00010000:00010000:2.0:1787826298.730031:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.730040:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.730044:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.730052:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.730063:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826298.730065:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.730069:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.730075:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499b8c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.730111:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b85 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5c3 expref: 81 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.730120:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826298.730123:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826298.730127:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499b85 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5c3 expref: 81 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.730137:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2200, rc 0) 00000100:00100000:2.0:1787826298.730162:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84151:x1874668789621248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5899us (6389us total) trans 8590016102 rc 301/301 00000100:00100000:2.0:1787826298.730173:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110921 00000100:00100000:0.0:1787826298.730379:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789621504:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 317us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.730388:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6107 00000100:00100000:1.0:1787826298.733231:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.733317:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789621888 00000100:00100000:2.0:1787826298.733326:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789621888 00000100:00100000:2.0:1787826298.733372:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6108 00000100:00100000:2.0:1787826298.733380:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789621888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.733394:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.733414:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5df expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826298.733450:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826298.733468:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=2936s v=(0 0) 00010000:00010000:2.0:1787826298.733473:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.733482:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5df expref: 13 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.733499:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5df expref: 13 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.733512:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:2.0:1787826298.733569:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789621888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 189us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.733575:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6108 00000100:00100000:1.0:1787826298.734752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.734819:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789622144 00000100:00100000:0.0:1787826298.734826:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789622144 00000100:00100000:0.0:1787826298.735076:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2568 00000100:00100000:0.0:1787826298.735086:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84151:x1874668789622144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.735510:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84151:x1874668789622144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 424us (761us total) trans 8590016103 rc 0/0 00000100:00100000:0.0:1787826298.735518:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2568 00000100:00100000:2.0:1787826298.738464:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.738726:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789622400 00000100:00100000:2.0:1787826298.738795:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.738848:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789622400 00000100:00100000:0.0:1787826298.738948:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789622656 00000100:00100000:0.0:1787826298.738953:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789622656 00000100:00100000:0.0:1787826298.738996:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110924 00000100:00100000:0.0:1787826298.739006:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84152:x1874668789622656:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826298.739098:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84152:x1874668789622656:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 93us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.739107:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110924 00000100:00100000:3.0:1787826298.739283:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110925 00000100:00100000:3.0:1787826298.739294:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84153:x1874668789622400:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.739337:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84153:x1874668789622400:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 46us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.743483:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110925 00000100:00100000:1.0:1787826298.743519:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.743564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.743996:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789622912 00000100:00100000:0.0:1787826298.744005:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789622912 00000100:00100000:0.0:1787826298.744048:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6109 00000100:00100000:0.0:1787826298.744057:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84153:x1874668789622912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.744073:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.744090:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5ed expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.744119:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5df expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.744139:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.744143:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.744149:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.744188:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5df expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.744202:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5df expref: 14 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.744216:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778598016:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.744364:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789622784 00000100:00100000:3.0:1787826298.744368:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789622784 00000100:00100000:3.0:1787826298.744400:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110926 00000100:00100000:3.0:1787826298.744409:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84151:x1874668789622784:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.744421:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.744445:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499bcb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5e6 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.744466:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f26c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787826298.744501:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499bd2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.744514:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.744525:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826298.744562:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10c:0x0]: returning size 0 00000004:00200000:3.0:1787826298.744566:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826298.744581:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.744602:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499bcb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5e6 expref: 83 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.744615:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5e6 expref: 82 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.744622:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826298.744625:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826298.744628:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826298.744653:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84151:x1874668789622784:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 246us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.744660:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110926 00010000:00010000:3.0:1787826298.752547:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826298.756758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.756832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.758189:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789623040 00000100:00100000:0.0:1787826298.758199:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789623040 00000100:00100000:0.0:1787826298.758245:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789623168 00000100:00100000:0.0:1787826298.758248:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789623168 00000100:00100000:0.0:1787826298.758275:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6110 00000100:00100000:0.0:1787826298.758284:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84152:x1874668789623040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.758301:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.758320:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5f4 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758351:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d1 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758360:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.758365:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.758370:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758402:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d1 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758414:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d1 expref: 11 pid: 8430 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.758439:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778598144:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826298.758525:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.758547:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6111 00000100:00100000:0.0:1787826298.758555:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789623168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.758563:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.758576:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb5fb expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826298.758596:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826298.758607:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=2936s v=(0 0) 00010000:00010000:0.0:1787826298.758611:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.758619:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5fb expref: 16 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758635:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5fb expref: 16 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758646:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:0.0:1787826298.758673:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789623168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 120us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.758680:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6111 00000100:00100000:0.0:1787826298.758751:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.758775:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789623296 00000100:00100000:0.0:1787826298.758779:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789623296 00010000:00010000:0.0:1787826298.758798:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5df expref: 16 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.758840:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2899 00000100:00100000:0.0:1787826298.758847:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789623296:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826298.758883:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.758900:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5df expref: 16 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758913:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5df expref: 16 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758930:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.758934:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826298.758941:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758951:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.758974:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.758984:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778598272:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826298.759008:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787826298.760516:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f3499bbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5df expref: 16 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.760535:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778598016:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826298.760561:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.760574:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3a00, rc 0) 00000100:00100000:3.0:1787826298.760618:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:84153:x1874668789622912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 16562us (17053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.760626:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6109 00000100:00100000:0.0:1787826298.763094:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778598144:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.763128:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.763146:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:0.0:1787826298.763190:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84152:x1874668789623040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4906us (6442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.763198:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6110 00000100:00100000:0.0:1787826298.766100:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.766135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.766141:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778598272:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826298.766161:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.766207:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789623296:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 7359us (7456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.766217:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2899 00000100:00100000:2.0:1787826298.766246:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789623424 00000100:00100000:2.0:1787826298.766251:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789623424 00010000:00010000:2.0:1787826298.766281:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d1 expref: 11 pid: 8430 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.766316:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2900 00000100:00100000:2.0:1787826298.766325:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789623424:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.766337:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.766358:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d1 expref: 11 pid: 8430 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.766371:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d1 expref: 11 pid: 8430 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.766395:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499baf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d1 expref: 11 pid: 8430 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.766410:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.766414:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.766422:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.766450:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.766491:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.766506:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778598400:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826298.766572:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d566c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.766698:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789623680 00000100:00100000:1.0:1787826298.766703:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789623680 00000100:00100000:1.0:1787826298.766742:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110927 00000100:00100000:1.0:1787826298.766750:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84151:x1874668789623680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.766815:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84151:x1874668789623680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 66us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.766828:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110927 00000100:00100000:0.0:1787826298.768373:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.768468:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789623808 00000100:00100000:2.0:1787826298.768474:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789623808 00002000:00100000:2.0:1787826298.768515:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xb4:0x0] (0->157) req@ffff9bbe0a31d680 x1874668789623808/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/0 e 0 to 0 dl 1787826309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826298.768528:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a31d680 with x1874668789623808 ext(0->157) 00002000:00010000:2.0:1787826298.768533:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a31d680 00000100:00100000:2.0:1787826298.768591:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1546 00000100:00100000:2.0:1787826298.768600:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789623808:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.771334:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789623808:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2710us (2943us total) trans 4294968131 rc 0/0 00000100:00100000:2.0:1787826298.771347:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1546 00002000:00100000:2.0:1787826298.771359:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xb4:0x0] (0->157) req@ffff9bbe0a31d680 x1874668789623808/t4294968131(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/448 e 0 to 0 dl 1787826309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826298.771369:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a31d680 with x1874668789623808 ext(0->157) 00002000:00010000:2.0:1787826298.771375:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a31d680 00000100:00100000:0.0:1787826298.773494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.773573:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789623936 00000100:00100000:1.0:1787826298.773581:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789623936 00002000:00100000:1.0:1787826298.773623:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xb5:0x0] (0->157) req@ffff9bbe0a31c000 x1874668789623936/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/0 e 0 to 0 dl 1787826309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826298.773634:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a31c000 with x1874668789623936 ext(0->157) 00002000:00010000:1.0:1787826298.773639:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a31c000 00000100:00100000:1.0:1787826298.773671:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1547 00000100:00100000:1.0:1787826298.773680:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789623936:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.774597:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789623936:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 914us (1106us total) trans 4294968117 rc 0/0 00000100:00100000:1.0:1787826298.774606:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1547 00002000:00100000:1.0:1787826298.774614:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xb5:0x0] (0->157) req@ffff9bbe0a31c000 x1874668789623936/t4294968117(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/448 e 0 to 0 dl 1787826309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826298.774622:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a31c000 with x1874668789623936 ext(0->157) 00002000:00010000:1.0:1787826298.774626:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a31c000 00000100:00100000:3.0:1787826298.774976:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.775182:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789624064 00000100:00100000:1.0:1787826298.775188:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789624064 00000100:00100000:1.0:1787826298.775230:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6112 00000100:00100000:1.0:1787826298.775238:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+16:84151:x1874668789624064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.775249:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.775267:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb602 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.775294:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5fb expref: 17 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.775304:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.775308:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826298.775313:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 17 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.775345:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5fb expref: 17 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.775358:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5fb expref: 17 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.775372:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b83c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778598528:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.775448:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.776153:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778598400:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826298.776172:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.776215:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789623424:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 9891us (10125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.776225:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2900 00000100:00100000:0.0:1787826298.778759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.778994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789624192 00000100:00100000:1.0:1787826298.779003:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789624192 00000100:00100000:1.0:1787826298.779055:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110928 00000100:00100000:1.0:1787826298.779064:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84153:x1874668789624192:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.779372:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b83c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778598528:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.779397:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 17 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.779415:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7200, rc 0) 00000100:00100000:2.0:1787826298.779475:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+17:84151:x1874668789624064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4238us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.779483:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6112 00010000:00010000:2.0:1787826298.781040:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781054:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781062:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781068:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.781073:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781081:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781096:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x107:0x0].0x0 (ffff9bbf0ee81900) 00010000:00010000:2.0:1787826298.781099:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.781103:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781109:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349994e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781137:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781143:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781148:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781154:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.781157:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781168:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781176:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x108:0x0].0x0 (ffff9bbf0ee81100) 00010000:00010000:2.0:1787826298.781178:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.781181:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781187:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499963 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x108:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781207:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781213:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781219:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781224:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.781227:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781233:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781240:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x109:0x0].0x0 (ffff9bbf0ee81c00) 00010000:00010000:2.0:1787826298.781242:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826298.781245:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781250:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499978 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x109:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781263:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781268:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781272:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781277:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.781279:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781285:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781292:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826298.781294:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826298.781297:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781303:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499af2 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781320:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781325:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781331:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781335:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.781338:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781343:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781354:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.781357:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826298.781359:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781365:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f3499b31 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781373:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781379:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781384:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781388:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.781391:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781396:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781403:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826298.781405:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826298.781408:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.781413:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499b4d lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826298.781589:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016103 is committed 00000020:00080000:3.0:1787826298.781635:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17d56b40 refcount 2 committed 0 result 0 batchid 4294970861 00000020:00080000:3.0:1787826298.781640:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d56a80 00000020:00080000:3.0:1787826298.781644:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0bd9de00 00000020:00080000:3.0:1787826298.781666:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe13482f00 refcount 2 committed 0 result 0 batchid 4294970860 00000020:00080000:3.0:1787826298.781670:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bdb4100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe13482840 00000020:00080000:3.0:1787826298.781673:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bdb4500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a1a6e00 00000020:00080000:3.0:1787826298.781686:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0d0f2780 refcount 2 committed 0 result 0 batchid 4294970859 00000020:00080000:3.0:1787826298.781689:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d0f2d80 00000020:00080000:3.0:1787826298.781693:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0bd9d600 00000020:00080000:3.0:1787826298.781703:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970858 batchid updated 00000020:00080000:2.0:1787826298.781773:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970861 committed batchid 4294970858 00000020:00080000:2.0:1787826298.781839:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970858 00000100:00100000:0.0:1787826298.782128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.782425:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789624320 00000100:00100000:2.0:1787826298.782443:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789624320 00010000:00010000:2.0:1787826298.782476:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5fb expref: 17 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.782515:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2901 00000100:00100000:2.0:1787826298.782525:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2401:x1874668789624320:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.782539:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.782558:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5fb expref: 17 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.782571:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5fb expref: 17 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.782590:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499be0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5fb expref: 17 pid: 8432 timeout: 3036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.782603:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.782606:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.782614:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 16 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.782623:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 16 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.782655:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 16 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.782669:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778598656:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826298.782735:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.784263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.784340:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789624448 00000100:00100000:2.0:1787826298.784347:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789624448 00000100:00100000:2.0:1787826298.784398:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110929 00000100:00100000:2.0:1787826298.784407:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84152:x1874668789624448:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.784525:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84152:x1874668789624448:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 118us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.784532:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110929 00000100:00100000:3.0:1787826298.785357:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778598656:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826298.785377:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826298.785418:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789624320:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2895us (3293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.785435:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2901 00000100:00100000:0.0:1787826298.787012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.787041:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.787132:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789624576 00000100:00100000:2.0:1787826298.787139:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789624576 00002000:00100000:2.0:1787826298.787181:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xb5:0x0] (0->157) req@ffff9bbe12805e00 x1874668789624576/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/0 e 0 to 0 dl 1787826309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826298.787192:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12805e00 with x1874668789624576 ext(0->157) 00002000:00010000:2.0:1787826298.787197:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe12805e00 00000100:00100000:2.0:1787826298.787227:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1548 00000100:00100000:2.0:1787826298.787236:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12805e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789624576:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.788190:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12805e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2401:x1874668789624576:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 952us (1179us total) trans 4294968132 rc 0/0 00000100:00100000:2.0:1787826298.788200:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1548 00002000:00100000:2.0:1787826298.788209:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xb5:0x0] (0->157) req@ffff9bbe12805e00 x1874668789624576/t4294968132(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:654/0 lens 648/448 e 0 to 0 dl 1787826309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826298.788217:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12805e00 with x1874668789624576 ext(0->157) 00002000:00010000:2.0:1787826298.788222:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe12805e00 00000100:00100000:3.0:1787826298.788349:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789624704 00000100:00100000:3.0:1787826298.788355:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789624704 00000100:00100000:3.0:1787826298.788397:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6113 00000100:00100000:3.0:1787826298.788406:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789624704:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.790632:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84153:x1874668789624192:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 11561us (11873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.790642:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110928 00000001:00080000:2.0:1787826298.790899:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968117 is committed 00000001:00080000:2.0:1787826298.790910:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968116 is committed 00000100:00100000:1.0:1787826298.791053:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789624704:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2648us (4010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.791061:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6113 00000100:00100000:0.0:1787826298.793301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.793388:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.793418:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.793576:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789625088 00000100:00100000:2.0:1787826298.793584:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789625088 00000100:00100000:2.0:1787826298.793637:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789625216 00000100:00100000:2.0:1787826298.793640:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789625216 00000100:00100000:2.0:1787826298.793662:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110930 00000100:00100000:2.0:1787826298.793670:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84151:x1874668789625088:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.793779:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84151:x1874668789625088:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 109us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.793786:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110930 00000100:00100000:2.0:1787826298.793804:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110931 00000100:00100000:2.0:1787826298.793810:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84152:x1874668789625216:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.793879:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.793906:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f3499b9a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ca expref: 31 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.793923:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.793928:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826298.793951:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.793964:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.793973:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826298.794074:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006313583e reply state 0000000047598671 transno 8590016104 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.794085:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.794091:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.794094:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826298.794097:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826298.794136:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84152:x1874668789625216:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 325us (716us total) trans 8590016104 rc 0/0 00000100:00100000:2.0:1787826298.794159:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110931 00000100:00100000:1.0:1787826298.795413:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789624832 00000100:00100000:1.0:1787826298.795421:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789624832 00000100:00100000:1.0:1787826298.795512:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6114 00000100:00100000:1.0:1787826298.795521:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2401:x1874668789624832:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787826298.798108:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968132 is committed 00000001:00080000:0.0:1787826298.798128:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968130 is committed 00000100:00100000:1.0:1787826298.798282:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789624832:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2756us (4983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.798292:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6114 00000100:00100000:0.0:1787826298.799290:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.799334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.799447:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789625344 00000100:00100000:2.0:1787826298.799455:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789625344 00000100:00100000:2.0:1787826298.799505:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110932 00000100:00100000:2.0:1787826298.799514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84152:x1874668789625344:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.799535:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.799554:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb609 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.799610:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb609 expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.799623:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb609 expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.799646:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.799649:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826298.799653:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826298.799689:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84152:x1874668789625344:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 176us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.799708:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110932 00000100:00100000:3.0:1787826298.800166:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789625472 00000100:00100000:3.0:1787826298.800171:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789625472 00000100:00100000:3.0:1787826298.800209:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6115 00000100:00100000:3.0:1787826298.800217:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789625472:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787826298.800272:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789625472:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 56us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.800278:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6115 00000100:00100000:0.0:1787826298.802291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.802409:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789625728 00000100:00100000:2.0:1787826298.802417:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789625728 00000100:00100000:2.0:1787826298.802474:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110933 00000100:00100000:2.0:1787826298.802484:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84153:x1874668789625728:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.802529:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.802555:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499ba8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5d8 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.802573:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826298.802577:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826298.802605:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.802617:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.802626:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826298.802796:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002244ea57 reply state 00000000816bb392 transno 8590016105 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.802814:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.802820:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826298.802823:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826298.802836:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826298.804089:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84153:x1874668789625728:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1602us (1801us total) trans 8590016105 rc 0/0 00000100:00100000:2.0:1787826298.804100:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110933 00000100:00100000:0.0:1787826298.806398:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.807547:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789625856 00000100:00100000:2.0:1787826298.807557:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789625856 00000100:00100000:2.0:1787826298.807652:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6116 00000100:00100000:2.0:1787826298.807662:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789625856:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826298.807815:0:8605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb5:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826298.807819:0:8605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb5:0x0] updating lvb mtime from disk: 0 -> 1787826217 00002000:00010000:2.0:1787826298.807821:0:8605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb5:0x0] updating lvb atime from disk: 0 -> 1787826217 00002000:00010000:2.0:1787826298.807823:0:8605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb5:0x0] updating lvb ctime from disk: 0 -> 1787826217 00002000:00010000:2.0:1787826298.807836:0:8605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826298.808002:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789625856:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 341us (1610us total) trans 4294968118 rc 0/0 00000100:00100000:2.0:1787826298.808010:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6116 00000100:00100000:0.0:1787826298.813234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.814031:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789625984 00000100:00100000:3.0:1787826298.814042:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789625984 00000100:00100000:0.0:1787826298.814220:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110934 00000100:00100000:0.0:1787826298.814230:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84153:x1874668789625984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.814253:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.814274:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb610 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.814389:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb610 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.814405:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb610 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.814422:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:0.0:1787826298.814435:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.814440:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:0.0:1787826298.814555:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84153:x1874668789625984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 325us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.814562:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110934 00000100:00100000:3.0:1787826298.821497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.821539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.823057:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789626240 00000100:00100000:2.0:1787826298.823070:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789626240 00000100:00100000:2.0:1787826298.823198:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789626496 00000100:00100000:2.0:1787826298.823202:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789626496 00000100:00100000:3.0:1787826298.825671:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110935 00000100:00100000:3.0:1787826298.825699:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84152:x1874668789626240:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.825766:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.825785:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb55a expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.825794:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 4/0,1 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.825927:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb55a expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.825941:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb55a expref: 36 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.825955:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe160783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778598784:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.826051:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff71d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.826744:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.826986:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110936 00000100:00100000:0.0:1787826298.827002:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84151:x1874668789626496:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000100:00100000:1.0:1787826298.827013:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789626624 00000100:00100000:1.0:1787826298.827021:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789626624 00010000:00010000:0.0:1787826298.827048:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826298.827067:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6117 00010000:00010000:0.0:1787826298.827077:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499bd2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5e6 expref: 36 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.827078:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789626624:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.827103:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826298.827109:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826298.827136:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826298.827221:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb4:0x0] updating lvb size from disk: 0 -> 158 00010000:00010000:0.0:1787826298.827225:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826298.827225:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb4:0x0] updating lvb mtime from disk: 0 -> 1787826217 00002000:00010000:1.0:1787826298.827228:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb4:0x0] updating lvb atime from disk: 0 -> 1787826217 00002000:00010000:1.0:1787826298.827234:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb4:0x0] updating lvb ctime from disk: 0 -> 1787826217 00002000:00010000:1.0:1787826298.827240:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787826298.827247:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.827288:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789626624:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 212us (558us total) trans 4294968133 rc 0/0 00000100:00100000:1.0:1787826298.827296:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6117 00000004:00010000:0.0:1787826298.827401:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ff4cec0 reply state 000000005d6a42dd transno 8590016106 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.827415:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.827422:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826298.827424:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826298.827437:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826298.827488:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84151:x1874668789626496:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 494us (5948us total) trans 8590016106 rc 0/0 00000100:00100000:0.0:1787826298.827495:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110936 00000100:00100000:1.0:1787826298.837393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.837489:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.837727:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789626752 00000100:00100000:0.0:1787826298.837738:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789626752 00000100:00100000:0.0:1787826298.837793:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789627008 00000100:00100000:0.0:1787826298.837797:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789627008 00000100:00100000:0.0:1787826298.837829:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110937 00000100:00100000:0.0:1787826298.837839:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84151:x1874668789626752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.837885:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.837908:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb617 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.837967:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb617 expref: 39 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.837985:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb617 expref: 39 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.837993:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110938 00000100:00100000:3.0:1787826298.838007:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84153:x1874668789627008:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.838049:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.838062:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb54c expref: 39 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.838071:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 4/0,1 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.838105:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb54c expref: 39 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.838119:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb54c expref: 39 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.838139:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778598912:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.838235:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff71900 going to sleep for 11 seconds 00010000:00010000:0.0:1787826298.839257:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826298.839263:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.839270:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3c00, rc 0) 00000100:00100000:0.0:1787826298.839332:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84151:x1874668789626752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1491us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.839340:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110937 00000100:00100000:3.0:1787826298.845040:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe160783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778598784:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826298.845068:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.845298:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778598912:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826298.845314:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.847542:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.847660:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.853834:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.853925:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789627392 00000100:00100000:1.0:1787826298.853935:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789627392 00000100:00100000:1.0:1787826298.853991:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6118 00000100:00100000:1.0:1787826298.854000:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789627392:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826298.854167:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb5:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826298.854170:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb5:0x0] updating lvb mtime from disk: 0 -> 1787826217 00002000:00010000:1.0:1787826298.854173:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb5:0x0] updating lvb atime from disk: 0 -> 1787826217 00002000:00010000:1.0:1787826298.854174:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb5:0x0] updating lvb ctime from disk: 0 -> 1787826217 00002000:00010000:1.0:1787826298.854177:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826298.854237:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789627392:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 238us (413us total) trans 4294968134 rc 0/0 00000100:00100000:1.0:1787826298.854245:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6118 00000100:00100000:1.0:1787826298.856734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.856823:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789627648 00000100:00100000:2.0:1787826298.856833:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789627648 00000100:00100000:2.0:1787826298.856928:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110939 00000100:00100000:2.0:1787826298.856939:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84151:x1874668789627648:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.857001:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.857020:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a0 expref: 39 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.857030:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.857064:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a0 expref: 39 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.857076:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a0 expref: 39 pid: 45683 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.857091:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778599040:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.857331:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.858474:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789627136 00000100:00100000:0.0:1787826298.858485:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789627136 00010000:00010000:1.0:1787826298.858619:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb55a expref: 40 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.858688:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789627264 00000100:00100000:1.0:1787826298.858691:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789627264 00010000:00010000:1.0:1787826298.858702:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb54c expref: 41 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.858727:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2902 00000100:00100000:2.0:1787826298.858746:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+41:2400:x1874668789627136:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.858764:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.858771:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb55a expref: 41 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.858783:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb55a expref: 41 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.858805:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499b00 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb55a expref: 41 pid: 6516 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.858838:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2903 00000100:00100000:1.0:1787826298.858846:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2401:x1874668789627264:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.858876:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.858881:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb54c expref: 40 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.858891:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb54c expref: 40 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.858905:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499ac8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb54c expref: 40 pid: 25756 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.858919:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:1.0:1787826298.858924:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.858934:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.858942:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.858977:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826298.859036:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.859045:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.859083:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.859090:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.859097:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.859103:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.859107:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.859119:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.859137:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00000100:00100000:1.0:1787826298.859139:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789627264:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 293us (11478us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826298.859140:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826298.859144:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.859150:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499c1f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.859191:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84153:x1874668789627008:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 21189us (21702us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826298.859199:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110938 00000100:00100000:1.0:1787826298.859495:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2903 00010000:00010000:2.0:1787826298.860935:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826298.860945:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.860956:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.860963:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.861006:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.861060:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2400:x1874668789627136:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2314us (13523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.861071:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2902 00010000:00010000:0.0:1787826298.861078:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.861088:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.861131:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.861139:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.861145:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.861151:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.861156:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.861163:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.861173:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:0.0:1787826298.861176:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826298.861179:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.861185:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499c0a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.861223:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84152:x1874668789626240:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 35539us (39735us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826298.861231:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110935 00000100:00100000:1.0:1787826298.862005:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778599040:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.862026:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.865050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.865301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.865631:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789627904 00000100:00100000:3.0:1787826298.865642:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789627904 00000100:00100000:3.0:1787826298.865708:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6119 00000100:00100000:3.0:1787826298.865718:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2399:x1874668789627904:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.865766:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.865785:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.865794:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.865798:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826298.865803:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 4/1,0 mode: --/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.865842:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.865877:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 15 pid: 25038 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.865901:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe160783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778599168:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.865979:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff71d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826298.867425:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789627776 00000100:00100000:1.0:1787826298.867443:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789627776 00010000:00010000:1.0:1787826298.867476:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a0 expref: 36 pid: 45683 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.867556:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2904 00000100:00100000:1.0:1787826298.867566:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789627776:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.867580:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.867587:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a0 expref: 36 pid: 45683 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.867599:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a0 expref: 36 pid: 45683 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.867625:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499b3f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5a0 expref: 36 pid: 45683 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.867639:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826298.867644:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.867653:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.867660:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.867699:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826298.867746:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2401:x1874668789627776:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 182us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.867754:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2904 00010000:00010000:0.0:1787826298.867798:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.867807:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.867869:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.867877:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.867883:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.867898:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.867903:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.867911:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.867921:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826298.867923:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826298.867927:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.867933:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499c26 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.867972:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84151:x1874668789627648:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 11035us (11250us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826298.867980:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110939 00000100:00100000:0.0:1787826298.868041:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.868777:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789628032 00000100:00100000:2.0:1787826298.868786:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789628032 00000100:00100000:2.0:1787826298.868841:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6120 00000100:00100000:2.0:1787826298.868867:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789628032:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.868907:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.868926:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.868935:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826298.868939:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826298.868944:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.868977:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.868989:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 10 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.869004:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778599296:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826298.869072:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.870274:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.870382:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789628160 00000100:00100000:3.0:1787826298.870389:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789628160 00000100:00100000:3.0:1787826298.870446:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6121 00000100:00100000:3.0:1787826298.870455:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2400:x1874668789628160:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.870490:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.870510:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 16 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.870518:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826298.870522:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826298.870526:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 4/1,0 mode: --/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.870553:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 16 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.870565:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 16 pid: 8605 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.870579:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1607b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778599424:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.870642:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.871548:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.871604:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789628288 00000100:00100000:0.0:1787826298.871609:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789628288 00010000:00010000:0.0:1787826298.871637:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 17 pid: 25038 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.871676:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2905 00000100:00100000:0.0:1787826298.871684:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40515850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2399:x1874668789628288:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826298.871696:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.871716:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 17 pid: 25038 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.871730:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 17 pid: 25038 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.871753:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826298.871758:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826298.871764:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.871773:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.871790:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826298.871977:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40515850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2399:x1874668789628288:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 293us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.871985:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2905 00010000:00010000:3.0:1787826298.872120:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f3499bc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5ed expref: 16 pid: 25038 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.872215:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe160783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778599168:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826298.872236:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.872246:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.872253:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.872275:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.872284:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.872293:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.872305:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826298.872713:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.872725:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.872739:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.872747:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000329ea543/0x68019081f3499c2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.872814:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2399:x1874668789627904:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 7097us (7512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.873093:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6119 00000100:00100000:2.0:1787826298.885112:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.885151:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789628416 00000100:00100000:2.0:1787826298.885158:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789628416 00000100:00100000:1.0:1787826298.885160:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1607b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778599424:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.885188:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.885197:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 11 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.885253:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2906 00000100:00100000:2.0:1787826298.885263:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789628416:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826298.885278:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826298.885299:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 11 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.885312:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 11 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.885337:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826298.885341:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826298.885347:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.885356:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.885373:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826298.885418:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789628416:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 156us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.885436:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2906 00000100:00100000:2.0:1787826298.885474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.885555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.886125:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789628544 00000100:00100000:1.0:1787826298.886132:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789628544 00010000:00010000:1.0:1787826298.886159:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 15 pid: 8605 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.886184:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2907 00000100:00100000:1.0:1787826298.886193:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789628544:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826298.886205:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.886219:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 15 pid: 8605 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886233:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 15 pid: 8605 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886250:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f538e01/0x68019081f3499be7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb602 expref: 15 pid: 8605 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.886257:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6a9860f/0x68019081f3499bd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb5f4 expref: 10 pid: 19335 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886264:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826298.886271:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=0s v=(1 0) 00000100:00100000:3.0:1787826298.886275:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778599296:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826298.886277:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886288:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.886292:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.886304:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886309:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826298.886312:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.886335:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.886342:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789628544:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 149us (867us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826298.886346:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.886353:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2907 00010000:00010000:3.0:1787826298.886362:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.886370:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826298.886374:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886378:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.886383:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886394:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.886402:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886414:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.886414:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be128b1b/0x68019081f3499c34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886442:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886465:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886472:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826298.886475:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886483:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886495:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886503:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f3499c3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.886508:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2399:x1874668789628032:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 17657us (18464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.886526:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6120 00000100:00100000:1.0:1787826298.886550:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789628160:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 16096us (16281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.886561:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6121 00000100:00100000:1.0:1787826298.886585:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789628800 00000100:00100000:1.0:1787826298.886588:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789628800 00000100:00100000:1.0:1787826298.886676:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110940 00000100:00100000:1.0:1787826298.886685:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84153:x1874668789628800:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.886765:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886787:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.886801:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.890779:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.890804:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb610 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.890813:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.890849:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb610 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.890882:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb610 expref: 35 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.890902:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778599552:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.890996:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826298.892186:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.895538:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789629056 00000100:00100000:3.0:1787826298.895554:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789629056 00000100:00100000:3.0:1787826298.895616:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110941 00000100:00100000:3.0:1787826298.895626:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84152:x1874668789629056:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.895704:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.895721:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.895734:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.895899:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.895911:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb609 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.895919:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.895952:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb609 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.895969:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb609 expref: 37 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.895984:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe160783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778599680:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826298.896082:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff71c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.909952:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.910045:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789629312 00000100:00100000:1.0:1787826298.910056:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789629312 00000100:00100000:1.0:1787826298.910121:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110942 00000100:00100000:1.0:1787826298.910130:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84151:x1874668789629312:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.910214:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.910231:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.910242:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.910401:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.910414:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb617 expref: 39 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.910422:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.910467:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb617 expref: 39 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.910479:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb617 expref: 39 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.910495:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778599808:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826298.910571:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.922835:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.922901:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.923004:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.923035:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789629440 00000100:00100000:0.0:1787826298.923046:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789629440 00010000:00010000:0.0:1787826298.923101:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb610 expref: 40 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.923137:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789629568 00000100:00100000:0.0:1787826298.923141:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789629568 00010000:00010000:0.0:1787826298.923154:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb609 expref: 41 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.923177:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789629696 00000100:00100000:0.0:1787826298.923180:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789629696 00010000:00010000:0.0:1787826298.923192:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb617 expref: 42 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.923211:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2908 00000100:00100000:0.0:1787826298.923221:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+42:2402:x1874668789629440:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826298.923237:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.923243:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb610 expref: 42 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923256:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb610 expref: 42 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923281:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:0.0:1787826298.923288:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923299:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923307:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923328:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826298.923377:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+42:2402:x1874668789629440:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 157us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.923385:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2908 00000100:00100000:0.0:1787826298.923404:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2909 00000100:00100000:0.0:1787826298.923410:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+41:2401:x1874668789629568:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826298.923420:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.923435:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb609 expref: 41 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923445:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb609 expref: 41 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923456:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:0.0:1787826298.923461:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923467:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923482:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923493:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826298.923513:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+41:2401:x1874668789629568:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 103us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.923518:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2909 00000100:00100000:0.0:1787826298.923530:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2910 00000100:00100000:0.0:1787826298.923535:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2401:x1874668789629696:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826298.923542:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826298.923559:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb617 expref: 40 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923568:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb617 expref: 40 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923578:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826298.923582:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923588:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923594:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923603:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826298.923620:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2401:x1874668789629696:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 85us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.923626:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2910 00010000:00010000:0.0:1787826298.923685:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c03 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb610 expref: 39 pid: 45682 timeout: 3036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.923700:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778599552:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.923718:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923726:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.923731:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826298.923835:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016107 00000001:00080000:0.0:1787826298.923990:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016110 00000001:00080000:0.0:1787826298.924026:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016111 00000100:00100000:0.0:1787826298.924095:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe128061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778599936:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826298.924142:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826298.924173:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.924191:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778599936 00000100:00100000:0.0:1787826298.924195:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778599936 00000100:00100000:0.0:1787826298.924226:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271 00000100:00100000:0.0:1787826298.924233:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778599936:12345-0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826298.924304:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778599936:12345-0@lo:1000:mdt00_007.0 Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.924311:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271 00000100:00100000:0.0:1787826298.924340:0:25759:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968130 gen 2 00000004:00080000:0.0:1787826298.924345:0:25759:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968130 committed transno 4294968130 00000100:00100000:0.0:1787826298.924359:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe128061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778599936:0@lo:1000:mdt00_007.0 00000001:00080000:0.0:1787826298.924484:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016112 00000100:00100000:0.0:1787826298.924523:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778600064:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826298.924548:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826298.924565:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.924578:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778600064 00000100:00100000:0.0:1787826298.924581:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778600064 00000100:00100000:0.0:1787826298.924603:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3272 00000100:00100000:0.0:1787826298.924609:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778600064:12345-0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826298.924694:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25759:x1874668778600064:12345-0@lo:1000:mdt00_007.0 Request processed in 84us (145us total) trans 4294968135 rc 0/0 00000100:00100000:0.0:1787826298.924701:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3272 00000100:00100000:0.0:1787826298.924730:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778600064:0@lo:1000:mdt00_007.0 00000001:00080000:0.0:1787826298.924774:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016113 00010000:00010000:0.0:1787826298.924795:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924803:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924809:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924814:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.924817:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924824:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924837:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:0.0:1787826298.924839:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.924843:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924848:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499c49 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924898:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddccc00/0x68019081f3499087 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924904:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddccc00/0x68019081f3499087 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924909:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddccc00/0x68019081f3499087 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924915:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0ddccc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.924917:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddccc00/0x68019081f3499087 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924922:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddccc00/0x68019081f3499087 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924930:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd9:0x0].0x0 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826298.924932:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.924935:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddccc00/0x68019081f3499087 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924940:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddccc00/0x68019081f3499087 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924961:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924972:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924981:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924989:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.924994:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925000:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925005:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.925008:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925013:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925020:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd9:0x0].0x0 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826298.925022:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.925025:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925030:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499c6c lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925040:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925046:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925051:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925056:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.925059:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925064:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925074:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd9:0x0].0x0 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826298.925077:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826298.925080:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925085:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499c42 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.925172:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84153:x1874668789628800:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 38487us (39614us total) trans 8590016114 rc 0/0 00000100:00100000:0.0:1787826298.925181:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110940 00000020:00080000:0.0:1787826298.925185:0:25759:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00010000:00010000:0.0:1787826298.925239:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499c18 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb617 expref: 42 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.925250:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778599808:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.925262:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925268:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.925273:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826298.925319:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016109 00000001:00080000:0.0:1787826298.925401:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016115 00000001:00080000:0.0:1787826298.925450:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016116 00000100:00100000:0.0:1787826298.925505:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe128061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778600192:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826298.925542:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826298.925570:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778600192 00000100:00100000:0.0:1787826298.925575:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778600192 00000100:00100000:0.0:1787826298.925605:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3273 00000100:00100000:0.0:1787826298.925612:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778600192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826298.925661:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778600192:12345-0@lo:1000:mdt00_000.0 Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.925667:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3273 00000100:00100000:0.0:1787826298.925684:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe13482780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.925696:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe128061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778600192:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787826298.925787:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016117 00000100:00100000:0.0:1787826298.925823:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778600320:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826298.925847:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826298.925898:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778600320 00000100:00100000:0.0:1787826298.925902:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778600320 00000100:00100000:0.0:1787826298.925931:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3274 00000100:00100000:0.0:1787826298.925938:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778600320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826298.926016:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6515:x1874668778600320:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (168us total) trans 4294968136 rc 0/0 00000100:00100000:0.0:1787826298.926023:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3274 00000100:00100000:0.0:1787826298.926039:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.926053:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778600320:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787826298.926092:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016118 00010000:00010000:0.0:1787826298.926112:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926119:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926126:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926131:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.926135:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926142:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926154:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826298.926157:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.926162:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926167:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499c65 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926186:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63e00/0x68019081f3499079 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926191:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63e00/0x68019081f3499079 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926196:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63e00/0x68019081f3499079 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926201:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3fd63e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.926204:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63e00/0x68019081f3499079 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926214:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63e00/0x68019081f3499079 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926221:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd7:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:0.0:1787826298.926224:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826298.926227:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63e00/0x68019081f3499079 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926232:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63e00/0x68019081f3499079 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926254:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926264:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.926271:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499bf5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb609 expref: 46 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926275:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926290:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826298.926296:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe160783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778599680:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826298.926300:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926307:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926312:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.926315:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926321:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.926327:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926329:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd7:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:0.0:1787826298.926335:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.926340:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.926343:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926354:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499c73 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.926357:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926371:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926380:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926386:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926391:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.926393:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926398:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.926407:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd7:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:0.0:1787826298.926409:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826298.926412:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 2/0,0 mode: --/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826298.926417:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016108 00010000:00010000:0.0:1787826298.926424:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499c5e lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826298.926518:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016120 00000001:00080000:2.0:1787826298.926548:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016121 00000100:00100000:2.0:1787826298.926601:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778600448:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1787826298.926638:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.926662:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826298.926833:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778600448 00000100:00100000:3.0:1787826298.926838:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778600448 00000100:00100000:3.0:1787826298.926903:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275 00000100:00100000:3.0:1787826298.926911:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45683:x1874668778600448:12345-0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1787826298.926985:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45683:x1874668778600448:12345-0@lo:1000:mdt00_009.0 Request processed in 74us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.926992:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275 00000100:00100000:2.0:1787826298.927507:0:45683:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968116 gen 2 00000004:00080000:2.0:1787826298.927514:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968115 committed transno 4294968116 00000004:00080000:2.0:1787826298.927551:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968116 committed transno 4294968116 00000100:00100000:2.0:1787826298.927563:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778600448:0@lo:1000:mdt00_009.0 00000001:00080000:2.0:1787826298.927667:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016122 00000100:00100000:2.0:1787826298.927720:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778600576:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1787826298.927753:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.927780:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826298.928105:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84151:x1874668789629312:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 17916us (18104us total) trans 8590016119 rc 0/0 00000100:00100000:0.0:1787826298.928115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110942 00000020:00080000:0.0:1787826298.928120:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826298.928948:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778600576 00000100:00100000:3.0:1787826298.928958:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778600576 00000100:00100000:3.0:1787826298.928998:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:3.0:1787826298.929007:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45683:x1874668778600576:12345-0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1787826298.929132:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45683:x1874668778600576:12345-0@lo:1000:mdt00_009.0 Request processed in 126us (1379us total) trans 4294968119 rc 0/0 00000100:00100000:3.0:1787826298.929139:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:3.0:1787826298.929178:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778600576:0@lo:1000:mdt00_009.0 00000001:00080000:3.0:1787826298.929240:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016123 00010000:00010000:3.0:1787826298.929269:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.929280:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.929287:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.929294:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.929298:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930343:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930369:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:3.0:1787826298.930372:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826298.930378:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930385:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499c57 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930412:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63800/0x68019081f3499080 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930418:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63800/0x68019081f3499080 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930434:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63800/0x68019081f3499080 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930445:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf3fd63800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.930448:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63800/0x68019081f3499080 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930454:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63800/0x68019081f3499080 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930461:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd8:0x0].0x0 (ffff9bbf41389e00) 00010000:00010000:3.0:1787826298.930463:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826298.930466:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63800/0x68019081f3499080 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930472:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf3fd63800/0x68019081f3499080 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930493:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930504:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930513:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930519:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930525:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930531:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930537:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.930541:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930546:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930552:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd8:0x0].0x0 (ffff9bbf41389e00) 00010000:00010000:3.0:1787826298.930554:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.930557:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930562:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499c7a lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930569:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930575:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930581:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930585:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.930588:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930594:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930604:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd8:0x0].0x0 (ffff9bbf41389e00) 00010000:00010000:3.0:1787826298.930606:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826298.930608:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.930614:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499c50 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.930754:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84152:x1874668789629056:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 35126us (38568us total) trans 8590016124 rc 0/0 00000100:00100000:3.0:1787826298.930762:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110941 00000020:00080000:3.0:1787826298.930767:0:45683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826298.930833:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.930945:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789629952 00000100:00100000:2.0:1787826298.930952:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789629952 00000100:00100000:2.0:1787826298.930990:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2569 00000100:00100000:2.0:1787826298.931000:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84153:x1874668789629952:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826298.931181:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x10b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826298.931210:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016125 00010000:00010000:2.0:1787826298.931235:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.931245:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.931253:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.931260:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.931266:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.931273:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.931290:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826298.931339:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84153:x1874668789629952:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 340us (506us total) trans 8590016126 rc 0/0 00000100:00100000:2.0:1787826298.931345:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2569 00000020:00080000:2.0:1787826298.931349:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787826298.933138:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826298.933146:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826298.933268:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9667 count 103 00000040:00080000:0.0:1787826298.933282:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787826298.933440:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778600704:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826298.933506:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09540 going to sleep for 11 seconds 00010000:00010000:0.0:1787826298.933536:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826298.933544:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.933552:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826298.933556:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.933565:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.933580:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:0.0:1787826298.933583:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826298.933587:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.933597:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f3499c81 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.933610:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826298.933611:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826298.933613:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826298.934046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.934346:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789630208 00000100:00100000:3.0:1787826298.934353:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789630208 00000100:00100000:3.0:1787826298.934406:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2570 00000100:00100000:3.0:1787826298.934416:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+52:84151:x1874668789630208:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787826298.934623:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x10c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826298.934652:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016127 00010000:00010000:3.0:1787826298.934683:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.934699:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.934711:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.934719:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.934727:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.934733:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.934755:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826298.934835:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84151:x1874668789630208:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 420us (791us total) trans 8590016128 rc 0/0 00000100:00100000:3.0:1787826298.934843:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2570 00000020:00080000:3.0:1787826298.934847:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826298.937582:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826298.937594:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.937605:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826298.937608:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.937618:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.937634:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826298.937637:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826298.937642:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.937648:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499c88 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.937659:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826298.937660:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826298.937662:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826298.938567:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.939363:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789630464 00000100:00100000:0.0:1787826298.939375:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789630464 00000100:00100000:0.0:1787826298.939445:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2571 00000100:00100000:0.0:1787826298.939456:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84152:x1874668789630464:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787826298.939717:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x10a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826298.939751:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016129 00010000:00010000:0.0:1787826298.939786:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.939802:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.939812:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.939820:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.939827:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.939833:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.939867:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826298.939956:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84152:x1874668789630464:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 501us (1394us total) trans 8590016130 rc 0/0 00000100:00100000:0.0:1787826298.939964:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2571 00000020:00080000:0.0:1787826298.939970:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826298.940981:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826298.940990:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.941000:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826298.941004:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.941013:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.941028:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:3.0:1787826298.941031:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826298.941036:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 1/0,0 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.941041:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499c8f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.941060:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826298.941062:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826298.941064:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826298.941299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.941324:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.941344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.941371:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789630592 00000100:00100000:2.0:1787826298.941377:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789630592 00000100:00100000:0.0:1787826298.941391:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789630720 00000100:00100000:0.0:1787826298.941397:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789630720 00000100:00100000:2.0:1787826298.941420:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789630848 00000100:00100000:2.0:1787826298.941436:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789630848 00000100:00100000:0.0:1787826298.941443:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110943 00000100:00100000:0.0:1787826298.941455:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84166:x1874668789630592:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000100:00100000:2.0:1787826298.941466:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110944 00000004:00000080:0.0:1787826298.941489:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xda:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826298.941586:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84166:x1874668789630592:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 134us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.941592:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110943 00000100:00100000:0.0:1787826298.941610:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110945 00000100:00100000:0.0:1787826298.941616:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84167:x1874668789630848:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826298.941627:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xdb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826298.941670:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84167:x1874668789630848:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 54us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.941677:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110945 00000100:00100000:3.0:1787826298.941823:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778600704:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787826298.941918:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84168:x1874668789630720:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826298.941937:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xdc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826298.941996:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84168:x1874668789630720:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 522us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.942005:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110944 00000100:00100000:2.0:1787826298.945502:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.945572:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789630976 00000100:00100000:3.0:1787826298.945582:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789630976 00000100:00100000:3.0:1787826298.945640:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110946 00000100:00100000:3.0:1787826298.945651:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84166:x1874668789630976:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.945734:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945751:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945762:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945777:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945785:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945791:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945815:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xda:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945822:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945829:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826298.945903:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xda:0x0]: returning size 158 00000004:00200000:3.0:1787826298.945907:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826298.945919:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945932:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945939:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945945:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945952:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945958:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.945962:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945969:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945980:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826298.945983:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.945987:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.945996:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499c96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946008:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946014:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946019:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946023:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.946025:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946030:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946036:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x5f0aeb6f (ffff9bbe08124600) 00010000:00010000:3.0:1787826298.946038:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.946041:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946046:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499c9d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x5f0aeb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946058:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946063:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946068:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946073:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.946075:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946081:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946087:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xda:0x0].0x0 (ffff9bbf41389100) 00010000:00010000:3.0:1787826298.946089:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.946092:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.946097:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499ca4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.946156:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84166:x1874668789630976:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 507us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.946163:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110946 00000100:00100000:2.0:1787826298.946791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.946848:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789631104 00000100:00100000:0.0:1787826298.946884:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789631104 00000100:00100000:0.0:1787826298.946918:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110947 00000100:00100000:0.0:1787826298.946925:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84168:x1874668789631104:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.946967:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.946978:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.946987:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947000:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947006:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947013:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947032:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947039:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947046:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.947072:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xdc:0x0]: returning size 158 00000004:00200000:0.0:1787826298.947076:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826298.947084:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947095:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947100:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947106:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947111:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947115:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.947118:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947124:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947133:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826298.947135:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.947138:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947144:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f3499cab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947154:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947159:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947164:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947169:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.947171:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947176:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947182:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c0de1fd (ffff9bbf0f565e00) 00010000:00010000:0.0:1787826298.947184:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.947187:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947196:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499cb2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c0de1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947207:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947213:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947218:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947223:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.947226:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947231:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947237:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdc:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:0.0:1787826298.947239:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.947242:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.947248:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499cb9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.947291:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84168:x1874668789631104:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 366us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.947298:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110947 00000100:00100000:0.0:1787826298.948883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.948912:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789631232 00000100:00100000:0.0:1787826298.948919:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789631232 00000100:00100000:0.0:1787826298.948959:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110948 00000100:00100000:0.0:1787826298.948969:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84167:x1874668789631232:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.949025:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949039:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949051:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949065:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949072:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949078:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949102:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 3/1,0 mode: --/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949110:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949116:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.949165:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xdb:0x0]: returning size 158 00000004:00200000:0.0:1787826298.949170:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826298.949180:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949191:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949197:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949203:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949208:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.949211:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949218:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949230:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826298.949232:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.949236:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949242:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499cc0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949255:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949266:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949272:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949277:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.949279:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949284:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949291:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x30e375c4 (ffff9bbf0f565600) 00010000:00010000:0.0:1787826298.949293:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.949296:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949301:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499cc7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x30e375c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949314:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949319:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949325:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949329:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.949333:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949339:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949345:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdb:0x0].0x0 (ffff9bbf41389200) 00010000:00010000:0.0:1787826298.949348:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826298.949350:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 2/0,0 mode: --/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.949355:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499cce lrc: 0/0,0 mode: --/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826298.949417:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84167:x1874668789631232:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 448us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.949425:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110948 00000100:00100000:2.0:1787826298.950088:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.950162:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.950182:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789631488 00000100:00100000:2.0:1787826298.950187:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789631488 00000100:00100000:2.0:1787826298.950218:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789631744 00000100:00100000:2.0:1787826298.950221:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789631744 00000100:00100000:2.0:1787826298.950241:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110949 00000100:00100000:2.0:1787826298.950249:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84166:x1874668789631488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.950262:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.950278:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499cd5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb61e expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950362:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0xda:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950373:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950383:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.950392:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xda:0x0]: returning size 158 00010000:00010000:2.0:1787826298.950476:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950482:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950488:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950493:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.950497:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950504:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950514:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xda:0x0].0x0 (ffff9bbf41389100) 00010000:00010000:2.0:1787826298.950516:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826298.950519:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 2/0,0 mode: --/PR res: [0x200000403:0xda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950524:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f3499cdc lrc: 0/0,0 mode: --/PR res: [0x200000403:0xda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950553:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499cd5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb61e expref: 58 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950566:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826298.950568:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826298.950572:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499cd5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb61e expref: 58 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950580:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826298.950621:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84166:x1874668789631488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 373us (536us total) trans 8590016131 rc 301/301 00000100:00100000:2.0:1787826298.950628:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110949 00000100:00100000:2.0:1787826298.950644:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110950 00000100:00100000:2.0:1787826298.950651:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84168:x1874668789631744:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.950659:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.950666:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499cea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb625 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950705:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950714:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950721:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826298.950727:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xdc:0x0]: returning size 158 00010000:00010000:2.0:1787826298.950753:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950760:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950767:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950772:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826298.950775:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950781:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950788:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdc:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:2.0:1787826298.950790:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826298.950793:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950799:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499cf1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xdc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950836:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499cea lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb625 expref: 58 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950844:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826298.950847:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826298.950866:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f3499cea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb625 expref: 58 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.950876:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:2.0:1787826298.950896:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84168:x1874668789631744:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 246us (734us total) trans 8590016132 rc 301/301 00000100:00100000:2.0:1787826298.950902:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110950 00000100:00100000:2.0:1787826298.954607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.954646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.954724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.954989:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789632000 00000100:00100000:0.0:1787826298.954999:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789632000 00000100:00100000:0.0:1787826298.955050:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789632128 00000100:00100000:0.0:1787826298.955053:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789632128 00000100:00100000:0.0:1787826298.955072:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789632256 00000100:00100000:0.0:1787826298.955076:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789632256 00000100:00100000:0.0:1787826298.955104:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110951 00000100:00100000:0.0:1787826298.955113:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84167:x1874668789632000:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826298.955136:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826298.955158:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499cff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb62c expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955259:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955275:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955286:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826298.955297:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xdb:0x0]: returning size 158 00000100:00100000:3.0:1787826298.955420:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110952 00000100:00100000:3.0:1787826298.955442:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84166:x1874668789632128:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826298.955464:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xda:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826298.955563:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84166:x1874668789632128:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 135us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.955571:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110952 00000100:00100000:3.0:1787826298.955590:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110953 00000100:00100000:3.0:1787826298.955597:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84168:x1874668789632256:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826298.955609:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xdc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826298.955652:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84168:x1874668789632256:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 55us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.955658:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110953 00010000:00010000:0.0:1787826298.955890:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955899:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955907:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955913:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826298.955917:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955923:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955937:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdb:0x0].0x0 (ffff9bbf41389200) 00010000:00010000:0.0:1787826298.955940:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826298.955945:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955952:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499d06 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xdb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.955996:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499cff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb62c expref: 59 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.956006:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826298.956009:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826298.956013:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f3499cff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb62c expref: 59 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826298.956022:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2400, rc 0) 00000100:00100000:0.0:1787826298.956052:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84167:x1874668789632000:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 940us (1451us total) trans 8590016133 rc 301/301 00000100:00100000:0.0:1787826298.956058:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110951 00000100:00100000:3.0:1787826298.967645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826298.967922:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789632384 00000100:00100000:0.0:1787826298.967932:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789632384 00000100:00100000:0.0:1787826298.967990:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110954 00000100:00100000:0.0:1787826298.968001:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84167:x1874668789632384:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826298.968035:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xdb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826298.968146:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84167:x1874668789632384:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 147us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826298.968155:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110954 00000100:00100000:3.0:1787826298.968636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.969186:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789632640 00000100:00100000:1.0:1787826298.969193:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789632640 00000100:00100000:1.0:1787826298.969240:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110955 00000100:00100000:1.0:1787826298.969250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84166:x1874668789632640:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.969264:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.969285:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499d14 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb633 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.970186:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d1b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.970201:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.970277:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826298.970288:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10d:0x0]: returning size 0 00010000:00010000:1.0:1787826298.970332:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499d14 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb633 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.970349:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb633 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.970358:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe16e56d00) 00010000:00010000:1.0:1787826298.970361:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826298.970365:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7200, rc 0) 00000100:00100000:1.0:1787826298.970435:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84166:x1874668789632640:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1177us (1790us total) trans 8590016134 rc 0/0 00000100:00100000:1.0:1787826298.970444:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110955 00000100:00100000:3.0:1787826298.976587:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.978876:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789632896 00000100:00100000:1.0:1787826298.978890:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789632896 00000100:00100000:1.0:1787826298.979052:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110956 00000100:00100000:1.0:1787826298.979064:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84166:x1874668789632896:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.979122:0:12105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826298.979148:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d1b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb633 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979167:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe16e56d00) 00010000:00010000:1.0:1787826298.979178:0:12105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826298.979199:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979283:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979296:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979312:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979320:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979332:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979378:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979386:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979392:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979398:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979404:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.979409:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979416:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979438:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826298.979442:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.979447:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979453:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d29 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979463:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979470:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979475:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979480:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.979483:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979489:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979496:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xe1972d4 (ffff9bbe16e56900) 00010000:00010000:1.0:1787826298.979498:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.979501:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.979507:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d30 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xe1972d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.979595:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84166:x1874668789632896:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 534us (3017us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826298.979603:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110956 00000100:00100000:1.0:1787826298.988365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.988476:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789633024 00000100:00100000:2.0:1787826298.988485:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789633024 00000100:00100000:2.0:1787826298.988560:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110957 00000100:00100000:3.0:1787826298.988564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826298.988576:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84166:x1874668789633024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826298.988598:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826298.988620:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499d37 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb63a expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.988653:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.988668:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789633280 00010000:00010000:2.0:1787826298.988668:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.988675:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789633280 00010000:00010000:2.0:1787826298.988682:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826298.988781:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110958 00000100:00100000:1.0:1787826298.988790:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84168:x1874668789633280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826298.988800:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.988811:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499d45 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb641 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.988987:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499d37 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb63a expref: 63 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.989004:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb63a expref: 62 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826298.989018:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826298.989021:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826298.989024:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826298.989080:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84166:x1874668789633024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 508us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.989086:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110957 00010000:00010000:1.0:1787826298.989574:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d4c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.989586:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.989595:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826298.989607:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10e:0x0]: returning size 0 00010000:00010000:1.0:1787826298.989652:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499d45 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb641 expref: 63 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.989667:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d4c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb641 expref: 62 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.989673:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe16e56900) 00010000:00010000:1.0:1787826298.989675:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826298.989677:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:3.0:1787826298.991589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.991626:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789633536 00000100:00100000:3.0:1787826298.991634:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789633536 00000100:00100000:3.0:1787826298.991682:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110959 00000100:00100000:3.0:1787826298.991693:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84166:x1874668789633536:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.991771:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.991962:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.991978:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826298.992119:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000831fffaf reply state 000000009d029e68 transno 8590016136 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.992132:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.992145:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826298.992148:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826298.992152:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826298.992241:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84166:x1874668789633536:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 550us (656us total) trans 8590016136 rc 0/0 00000100:00100000:3.0:1787826298.992248:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110959 00000100:00100000:2.0:1787826298.992286:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84168:x1874668789633280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 3494us (3722us total) trans 8590016135 rc 0/0 00000100:00100000:2.0:1787826298.992295:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110958 00000100:00100000:3.0:1787826298.997021:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.997089:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826298.997121:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789633664 00000100:00100000:3.0:1787826298.997128:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789633664 00000100:00100000:3.0:1787826298.997170:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789633920 00000100:00100000:3.0:1787826298.997173:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789633920 00000100:00100000:3.0:1787826298.997192:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110960 00000100:00100000:3.0:1787826298.997201:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84166:x1874668789633664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.997224:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826298.997241:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb648 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997298:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb648 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997313:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb648 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997322:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826298.997325:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826298.997329:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606800, rc 0) 00000100:00100000:3.0:1787826298.997380:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84166:x1874668789633664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 180us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826298.997388:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110960 00000100:00100000:3.0:1787826298.997403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110961 00000100:00100000:3.0:1787826298.997409:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84168:x1874668789633920:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826298.997453:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826298.997471:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499d4c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb641 expref: 65 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997483:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe16e56900) 00010000:00010000:3.0:1787826298.997491:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826298.997504:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997513:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997520:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997532:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997539:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997545:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997584:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997591:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997598:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997604:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997620:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.997624:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997631:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997638:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826298.997641:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.997644:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997651:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499d68 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997659:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997665:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997671:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997676:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826298.997679:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997685:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997690:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x7b85d80d (ffff9bbe08124600) 00010000:00010000:3.0:1787826298.997693:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826298.997695:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826298.997700:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499d6f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x7b85d80d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826298.997741:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84168:x1874668789633920:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 331us (651us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826298.997746:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110961 00000100:00100000:0.0:1787826298.998510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826298.998691:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789634048 00000100:00100000:1.0:1787826298.998771:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789634048 00000100:00100000:1.0:1787826298.998849:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3277 00000100:00100000:1.0:1787826298.998893:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+64:2399:x1874668789634048:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826298.998931:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826298.998947:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499d76 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb64f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.998995:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999006:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999017:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999031:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999039:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999046:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999073:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999080:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999087:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999093:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.999096:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999107:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999118:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826298.999121:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.999125:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999131:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499d7d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999142:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999149:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999155:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999159:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826298.999163:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999169:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999175:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x6d4393e4 (ffff9bbe16e56d00) 00010000:00010000:1.0:1787826298.999178:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826298.999181:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999192:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499d84 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x6d4393e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999337:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499d76 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb64f expref: 65 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999348:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826298.999350:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826298.999353:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499d76 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb64f expref: 65 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826298.999362:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc -2) 00000100:00100000:2.0:1787826298.999620:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+64:2399:x1874668789634048:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 728us (1110us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826298.999630:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3277 00000100:00100000:3.0:1787826299.003086:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.003131:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.003168:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.003206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789634176 00000100:00100000:3.0:1787826299.003214:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789634176 00000100:00100000:3.0:1787826299.003277:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789634432 00000100:00100000:3.0:1787826299.003281:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789634432 00000100:00100000:3.0:1787826299.003317:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110962 00000100:00100000:3.0:1787826299.003330:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84168:x1874668789634176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.003341:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110963 00010000:00010000:3.0:1787826299.003348:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787826299.003357:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84167:x1874668789634432:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.003372:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499d8b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb687 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.003373:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.003389:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499d92 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb68e expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.003409:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.003436:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.003450:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.003872:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499d8b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb687 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.003906:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb687 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.004070:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499da0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.004077:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:2.0:1787826299.004083:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499da0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.004084:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826299.004090:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606600, rc 0) 00010000:00010000:2.0:1787826299.004097:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499da0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.004158:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84168:x1874668789634176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 831us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.004167:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110962 00000100:00100000:3.0:1787826299.004206:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789634560 00000100:00100000:3.0:1787826299.004210:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789634560 00000100:00100000:3.0:1787826299.004245:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2572 00000100:00100000:3.0:1787826299.004254:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84166:x1874668789634560:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000004:00200000:2.0:1787826299.004355:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10f:0x0]: returning size 0 00010000:00010000:2.0:1787826299.004404:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f3499d92 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb68e expref: 69 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.004423:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499da0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb68e expref: 68 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.004446:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826299.004449:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826299.004452:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:3.0:1787826299.004474:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84166:x1874668789634560:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 220us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.004485:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84167:x1874668789634432:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1132us (1353us total) trans 8590016137 rc 0/0 00000100:00100000:3.0:1787826299.004486:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2572 00000100:00100000:2.0:1787826299.004499:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110963 00000100:00100000:3.0:1787826299.009907:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.010554:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789634816 00000100:00100000:1.0:1787826299.010565:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789634816 00000100:00100000:1.0:1787826299.010624:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110964 00000100:00100000:1.0:1787826299.010635:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84168:x1874668789634816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.010786:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.010805:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.010825:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826299.011602:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4944359 reply state 00000000a6684f0f transno 8590016138 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.011625:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.011632:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:1.0:1787826299.011635:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826299.011639:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826299.012592:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84168:x1874668789634816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1953us (2696us total) trans 8590016138 rc 0/0 00000100:00100000:1.0:1787826299.012603:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110964 00000100:00100000:3.0:1787826299.012773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.012985:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789635072 00000100:00100000:0.0:1787826299.012994:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789635072 00000100:00100000:0.0:1787826299.013038:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2573 00000100:00100000:0.0:1787826299.013055:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84166:x1874668789635072:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.013663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.013712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.013728:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789635328 00000100:00100000:1.0:1787826299.013735:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789635328 00000100:00100000:1.0:1787826299.013777:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110965 00000100:00100000:1.0:1787826299.013787:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84167:x1874668789635328:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.013821:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.013848:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499da0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb68e expref: 71 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.013891:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:1.0:1787826299.013909:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826299.013931:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.013949:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.013960:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.013978:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.013985:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.013991:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014025:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014031:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014037:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014043:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014059:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.014064:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014070:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014079:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826299.014082:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.014086:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014093:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499db5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014101:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014106:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014111:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014116:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.014119:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014123:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014129:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x3e2b9add (ffff9bbe16e56d00) 00010000:00010000:1.0:1787826299.014132:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.014135:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.014139:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499dbc lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x3e2b9add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.014218:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84166:x1874668789635072:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1169us (1443us total) trans 8590016139 rc 0/0 00000100:00100000:0.0:1787826299.014227:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2573 00000100:00100000:3.0:1787826299.015102:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789635456 00000100:00100000:3.0:1787826299.015111:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789635456 00000100:00100000:3.0:1787826299.015156:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3278 00000100:00100000:3.0:1787826299.015165:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+70:2402:x1874668789635456:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826299.015203:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.015217:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499dc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb695 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.015281:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.015295:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.015304:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.015989:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016000:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016008:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016191:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016199:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016204:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016209:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.016212:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016219:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016231:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826299.016234:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.016238:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016244:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499dca lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016257:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016263:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016268:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016274:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.016277:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016285:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016292:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x14bfa01d (ffff9bbe08124600) 00010000:00010000:3.0:1787826299.016294:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.016297:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016302:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f3499dd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x14bfa01d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016619:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499dc3 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb695 expref: 71 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016628:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826299.016631:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826299.016635:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499dc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb695 expref: 71 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.016644:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc -2) 00000100:00100000:3.0:1787826299.016723:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+70:2402:x1874668789635456:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 1559us (3010us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826299.016733:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3278 00000100:00100000:1.0:1787826299.017346:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84167:x1874668789635328:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 3559us (3682us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826299.017357:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110965 00000100:00100000:3.0:1787826299.033917:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.033955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.033980:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.034021:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789635584 00000100:00100000:3.0:1787826299.034029:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789635584 00000100:00100000:3.0:1787826299.034076:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789635840 00000100:00100000:3.0:1787826299.034080:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789635840 00000100:00100000:3.0:1787826299.034098:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789635968 00000100:00100000:3.0:1787826299.034101:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789635968 00000100:00100000:3.0:1787826299.034124:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110966 00000100:00100000:3.0:1787826299.034133:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84168:x1874668789635584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.034157:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.034179:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb6cd expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.034237:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6cd expref: 72 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.034254:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6cd expref: 72 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.034264:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826299.034267:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.034271:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607a00, rc 0) 00000100:00100000:3.0:1787826299.034334:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84168:x1874668789635584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 202us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.034341:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110966 00000100:00100000:3.0:1787826299.034362:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110967 00000100:00100000:3.0:1787826299.034369:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84166:x1874668789635840:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.034438:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84166:x1874668789635840:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 58us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.034446:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110967 00000100:00100000:3.0:1787826299.034462:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110968 00000100:00100000:3.0:1787826299.034471:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84167:x1874668789635968:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.034478:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.034490:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3499ddf lrc: 2/0,0 mode: --/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb6d4 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.034514:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.034522:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.034531:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.034624:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3499ddf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6d4 expref: 72 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.034638:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6d4 expref: 71 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.034646:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826299.034648:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826299.034650:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:3.0:1787826299.034687:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84167:x1874668789635968:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 218us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.034694:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110968 00000100:00100000:3.0:1787826299.043180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.043220:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.043242:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.043378:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789636224 00000100:00100000:2.0:1787826299.043382:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789636480 00000100:00100000:1.0:1787826299.043389:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789636224 00000100:00100000:2.0:1787826299.043390:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789636480 00000100:00100000:2.0:1787826299.043457:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110969 00000100:00100000:2.0:1787826299.043467:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84166:x1874668789636480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.043482:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110970 00010000:00010000:2.0:1787826299.043488:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787826299.043493:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84167:x1874668789636224:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.043510:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ded lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb6db expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.043562:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.043579:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.043591:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826299.043716:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067cc0937 reply state 00000000c89bda90 transno 8590016140 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.043729:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.043737:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:1.0:1787826299.043739:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826299.043744:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826299.043799:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.043813:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb648 expref: 75 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.043827:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84167:x1874668789636224:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 335us (654us total) trans 8590016140 rc 0/0 00010000:00010000:2.0:1787826299.043830:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.043841:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110970 00000100:00100000:1.0:1787826299.043903:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789636608 00000100:00100000:1.0:1787826299.043908:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789636608 00000100:00100000:1.0:1787826299.043933:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2574 00000100:00100000:1.0:1787826299.043940:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84168:x1874668789636608:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.043991:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84168:x1874668789636608:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 51us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.043998:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2574 00010000:00010000:2.0:1787826299.045045:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb648 expref: 74 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.045068:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb648 expref: 74 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.045084:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778600832:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826299.045155:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.048108:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778600832:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826299.048136:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.048691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.048771:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.049177:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789636736 00000100:00100000:0.0:1787826299.049423:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789636736 00010000:00010000:0.0:1787826299.049476:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb648 expref: 75 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.049517:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2911 00000100:00100000:0.0:1787826299.049528:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+75:2400:x1874668789636736:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.049542:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.049548:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb648 expref: 75 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.049561:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb648 expref: 75 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.049589:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f3499d61 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb648 expref: 75 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.049604:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:0.0:1787826299.049610:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.049619:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.050139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.050160:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789637120 00000100:00100000:3.0:1787826299.050165:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789637120 00000100:00100000:3.0:1787826299.050191:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2575 00000100:00100000:3.0:1787826299.050198:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84168:x1874668789637120:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.050384:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84168:x1874668789637120:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 185us (247us total) trans 8590016141 rc 0/0 00000100:00100000:3.0:1787826299.050392:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2575 00010000:00010000:0.0:1787826299.050797:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.050834:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.050880:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+75:2400:x1874668789636736:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1352us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.050887:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2911 00010000:00010000:3.0:1787826299.051001:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.051071:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.051088:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10d:0x0]: returning size 0 00000004:00080000:3.0:1787826299.051200:0:23845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb6:0x0], index 1: 0 00010000:00010000:3.0:1787826299.051270:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.051279:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.051287:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789636864 00010000:00010000:3.0:1787826299.051292:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.051295:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789636864 00010000:00010000:3.0:1787826299.051301:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.051306:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.051313:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.051325:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826299.051328:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.051332:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.051338:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499dfb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.051371:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110971 00010000:00010000:3.0:1787826299.051375:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ded lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6db expref: 76 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.051386:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84167:x1874668789636864:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.051389:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826299.051393:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826299.051397:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499ded lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6db expref: 76 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.051399:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.051409:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2e00, rc 0) 00010000:00010000:2.0:1787826299.051417:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb6e2 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.051451:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84166:x1874668789636480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 7986us (8206us total) trans 8590016142 rc 301/301 00000100:00100000:3.0:1787826299.051463:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110969 00010000:00010000:2.0:1787826299.051471:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e2 expref: 76 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.051494:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e2 expref: 75 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.051504:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826299.051507:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.051510:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826299.051535:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84167:x1874668789636864:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 154us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.051541:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110971 00000100:00100000:3.0:1787826299.055660:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.055697:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.055767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.055795:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789637632 00000100:00100000:1.0:1787826299.055867:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789637376 00000100:00100000:1.0:1787826299.055877:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789637376 00000100:00100000:1.0:1787826299.055944:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110972 00000100:00100000:1.0:1787826299.055954:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84168:x1874668789637376:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.056208:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84168:x1874668789637376:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 255us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.056216:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110972 00000100:00100000:2.0:1787826299.056447:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789637760 00000100:00100000:2.0:1787826299.056452:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789637760 00000100:00100000:2.0:1787826299.056483:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2576 00000100:00100000:2.0:1787826299.056490:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84167:x1874668789637760:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.056570:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84167:x1874668789637760:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 79us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.056577:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2576 00000100:00100000:3.0:1787826299.057118:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789637632 00000100:00100000:3.0:1787826299.057154:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2577 00000100:00100000:3.0:1787826299.057162:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84166:x1874668789637632:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.057359:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84166:x1874668789637632:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 198us (1660us total) trans 8590016143 rc 0/0 00000100:00100000:3.0:1787826299.057367:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2577 00000100:00100000:3.0:1787826299.064357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.064435:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789637888 00000100:00100000:0.0:1787826299.064445:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789637888 00000100:00100000:3.0:1787826299.064459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.064493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.064503:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789638400 00000100:00100000:0.0:1787826299.064508:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789638400 00000100:00100000:1.0:1787826299.064521:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110973 00000100:00100000:1.0:1787826299.064536:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84166:x1874668789637888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.064552:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110974 00010000:00010000:1.0:1787826299.064562:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787826299.064563:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84168:x1874668789638400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.064574:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.064585:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499e10 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb6e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.064588:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499e17 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb6f0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.064662:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499e1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.064675:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499e1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.064686:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499e1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.064728:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10d:0x0]: returning size 0 00000004:00200000:1.0:1787826299.064733:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826299.064752:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499e1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.064780:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499e10 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e9 expref: 80 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.064793:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.064798:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499e1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e9 expref: 79 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.064813:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:0.0:1787826299.064817:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6cd expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.064818:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826299.064822:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00010000:00010000:0.0:1787826299.064831:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.064895:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6cd expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.064911:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84166:x1874668789637888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 377us (558us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826299.064919:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6cd expref: 79 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.064920:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110973 00000100:00100000:0.0:1787826299.064939:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778600960:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826299.064949:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789638144 00000100:00100000:1.0:1787826299.064953:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789638144 00000100:00100000:1.0:1787826299.064981:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2578 00000100:00100000:1.0:1787826299.064990:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84167:x1874668789638144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.065000:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.065122:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84167:x1874668789638144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 133us (664us total) trans 8590016144 rc 0/0 00000100:00100000:1.0:1787826299.065130:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2578 00000100:00100000:3.0:1787826299.069698:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.070182:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778600960:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.070198:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:0.0:1787826299.070207:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.070246:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.070331:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789638528 00000100:00100000:1.0:1787826299.070341:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789638528 00000100:00100000:0.0:1787826299.070349:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789638912 00000100:00100000:0.0:1787826299.070353:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789638912 00010000:00010000:1.0:1787826299.070386:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6cd expref: 80 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.070398:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6122 00000100:00100000:0.0:1787826299.070407:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789638912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.070409:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2912 00000100:00100000:1.0:1787826299.070415:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40514850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2402:x1874668789638528:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.070423:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.070443:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.070450:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6cd expref: 80 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.070454:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb6f7 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.070462:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6cd expref: 80 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826299.070478:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826299.070484:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f3499dd8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6cd expref: 80 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.070492:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:0.0:1787826299.070496:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.070499:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:1.0:1787826299.070503:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.070505:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f7 expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.070514:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.070521:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.070522:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f7 expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.070539:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3800, rc 0) 00010000:00010000:1.0:1787826299.070541:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1787826299.070665:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826299.070746:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40514850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2402:x1874668789638528:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 328us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.070754:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2912 00000100:00100000:2.0:1787826299.071478:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789638784 00000100:00100000:2.0:1787826299.071487:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789638784 00000100:00100000:2.0:1787826299.071527:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110975 00000100:00100000:2.0:1787826299.071534:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84167:x1874668789638784:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.072942:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.072956:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.072983:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10e:0x0]: returning size 0 00000004:00080000:1.0:1787826299.073128:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb6:0x0], index 0: 0 00010000:00010000:1.0:1787826299.073219:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.073227:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.073235:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.073241:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.073245:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.073251:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.073265:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:1.0:1787826299.073268:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826299.073272:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.073279:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f3499e25 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.073324:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499e17 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f0 expref: 80 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.073334:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826299.073336:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826299.073340:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499e17 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f0 expref: 80 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.073349:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:0.0:1787826299.074269:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789638912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 3856us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.074281:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6122 00000100:00100000:3.0:1787826299.082180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.082270:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789639168 00000100:00100000:0.0:1787826299.082279:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789639168 00000100:00100000:0.0:1787826299.082341:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110976 00000100:00100000:0.0:1787826299.082356:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84166:x1874668789639168:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.082476:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84166:x1874668789639168:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 120us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.082484:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110976 00000100:00100000:2.0:1787826299.083529:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84167:x1874668789638784:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 11990us (13326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.083532:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84168:x1874668789638400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 18967us (19033us total) trans 8590016145 rc 301/301 00000100:00100000:2.0:1787826299.083546:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110975 00000100:00100000:1.0:1787826299.083554:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110974 00000100:00100000:3.0:1787826299.086366:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.086667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.086849:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789639680 00000100:00100000:1.0:1787826299.086878:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789639680 00000100:00100000:1.0:1787826299.086949:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110977 00000100:00100000:1.0:1787826299.086959:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84167:x1874668789639680:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.086983:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.087002:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499e3a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb6fe expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.087415:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.087441:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e2 expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.087510:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.087542:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e2 expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.087556:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e2 expref: 79 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.087571:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778601088:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826299.087652:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.088570:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789639424 00000100:00100000:2.0:1787826299.088579:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789639424 00000100:00100000:2.0:1787826299.088635:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2579 00000100:00100000:2.0:1787826299.088644:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84168:x1874668789639424:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.088786:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.088912:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84168:x1874668789639424:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 268us (2553us total) trans 8590016146 rc 0/0 00000100:00100000:2.0:1787826299.088921:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2579 00000100:00100000:0.0:1787826299.089191:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789639808 00000100:00100000:0.0:1787826299.089196:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789639808 00000100:00100000:0.0:1787826299.089228:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6123 00000100:00100000:0.0:1787826299.089236:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84166:x1874668789639808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.089246:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.089262:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb705 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.089287:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f7 expref: 11 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.089297:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.089302:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.089307:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.089334:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f7 expref: 11 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.089347:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f7 expref: 11 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.089360:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778601216:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.089418:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.091564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.091666:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778601216:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.091683:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789639936 00000100:00100000:3.0:1787826299.091690:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789639936 00010000:00010000:0.0:1787826299.091696:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.091715:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3c00, rc 0) 00000100:00100000:3.0:1787826299.091743:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110978 00000100:00100000:3.0:1787826299.091752:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84168:x1874668789639936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.091759:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84166:x1874668789639808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2525us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.091766:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6123 00010000:00010000:3.0:1787826299.091769:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.091786:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3499e4f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb70c expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.091871:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499e56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.091895:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499e56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.091905:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499e56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.092129:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10e:0x0]: returning size 0 00000004:00200000:3.0:1787826299.092134:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826299.092154:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499e56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.092180:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f3499e4f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb70c expref: 83 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.092195:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499e56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb70c expref: 82 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.092203:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826299.092206:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826299.092208:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc 0) 00000100:00100000:3.0:1787826299.092231:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84168:x1874668789639936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 481us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.092241:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110978 00000100:00100000:2.0:1787826299.092933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.092968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.092991:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789640064 00000100:00100000:2.0:1787826299.092996:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789640064 00010000:00010000:2.0:1787826299.093036:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e2 expref: 82 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.093063:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789640192 00000100:00100000:2.0:1787826299.093066:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789640192 00010000:00010000:2.0:1787826299.093079:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f7 expref: 11 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.093102:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2913 00000100:00100000:2.0:1787826299.093110:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2401:x1874668789640064:12345-192.168.203.9@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787826299.093116:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2914 00010000:00010000:2.0:1787826299.093122:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826299.093124:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789640192:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826299.093128:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e2 expref: 82 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.093131:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.093139:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e2 expref: 82 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.093149:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f7 expref: 11 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.093159:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f7 expref: 11 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.093161:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826299.093165:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.093172:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f3499e2c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6f7 expref: 11 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.093174:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.093182:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.093186:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.093190:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.093196:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826299.093197:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.093206:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.093222:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2401:x1874668789640064:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 114us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.093229:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2913 00010000:00010000:3.0:1787826299.093231:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.093243:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ee1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6501:1874668778601344:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826299.093289:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff719c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787826299.095440:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f3499e09 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e2 expref: 81 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.095466:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778601088:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.095488:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.095619:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.095627:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826299.095647:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10f:0x0]: returning size 0 00000100:00100000:1.0:1787826299.095731:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ee1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6501:1874668778601344:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826299.095745:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1787826299.095791:0:25759:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb7:0x0], index 1: 0 00000100:00100000:1.0:1787826299.095795:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789640192:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2671us (2825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.095803:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2914 00010000:00010000:0.0:1787826299.095917:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.095925:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.095933:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.095939:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.095943:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.095950:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.095965:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826299.095968:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.095972:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.095979:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499e41 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.096038:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499e3a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6fe expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.096049:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826299.096052:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826299.096056:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499e3a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6fe expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.096068:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:0.0:1787826299.096093:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84167:x1874668789639680:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9136us (9427us total) trans 8590016147 rc 301/301 00000100:00100000:0.0:1787826299.096100:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110977 00000100:00100000:2.0:1787826299.103215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.103306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.103348:0:45401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789640448 00000100:00100000:0.0:1787826299.103357:0:45401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789640448 00000100:00100000:2.0:1787826299.103393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00002000:00100000:0.0:1787826299.103406:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xb6:0x0] (0->157) req@ffff9bbe12838f00 x1874668789640448/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/0 e 0 to 0 dl 1787826310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826299.103418:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12838f00 with x1874668789640448 ext(0->157) 00002000:00010000:0.0:1787826299.103423:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe12838f00 00000100:00100000:1.0:1787826299.103466:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789640704 00000100:00100000:0.0:1787826299.103467:0:45401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1549 00000100:00100000:1.0:1787826299.103471:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789640704 00000100:00100000:0.0:1787826299.103477:0:45401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789640448:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.103498:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2580 00000100:00100000:1.0:1787826299.103503:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf123d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84167:x1874668789640704:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.103753:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf123d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84167:x1874668789640704:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 248us (358us total) trans 8590016148 rc 0/0 00000100:00100000:1.0:1787826299.103760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2580 00000100:00100000:3.0:1787826299.104452:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789640320 00000100:00100000:3.0:1787826299.104459:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789640320 00000100:00100000:3.0:1787826299.104539:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6124 00000100:00100000:3.0:1787826299.104548:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789640320:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.104560:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.104579:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb713 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826299.104601:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826299.104618:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:3.0:1787826299.104622:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.104630:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb713 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.104647:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb713 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.104659:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826299.104690:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789640320:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 144us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.104709:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6124 00000100:00080000:0.0:1787826299.105133:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826299.106191:0:45401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789640448:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2710us (2878us total) trans 4294968120 rc 0/0 00000100:00100000:2.0:1787826299.106202:0:45401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1549 00002000:00100000:2.0:1787826299.106213:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xb6:0x0] (0->157) req@ffff9bbe12838f00 x1874668789640448/t4294968120(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/448 e 0 to 0 dl 1787826310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826299.106223:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12838f00 with x1874668789640448 ext(0->157) 00002000:00010000:2.0:1787826299.106228:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe12838f00 00000100:00100000:2.0:1787826299.106625:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.106725:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789640832 00000100:00100000:0.0:1787826299.106732:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789640832 00000100:00100000:0.0:1787826299.106777:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110979 00000100:00100000:0.0:1787826299.106785:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84167:x1874668789640832:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.106802:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.106820:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499e6b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb71a expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.107244:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499e72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.107259:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499e72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.107271:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499e72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.107593:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.107614:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789641088 00000100:00100000:3.0:1787826299.107618:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789641088 00000100:00100000:3.0:1787826299.107646:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110980 00000100:00100000:3.0:1787826299.107653:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84168:x1874668789641088:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.107710:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84168:x1874668789641088:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.107717:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110980 00000004:00200000:0.0:1787826299.108446:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10f:0x0]: returning size 0 00000004:00200000:0.0:1787826299.108452:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826299.108477:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499e72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.108506:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f3499e6b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb71a expref: 83 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.108523:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499e72 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb71a expref: 82 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.108531:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826299.108534:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826299.108537:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:0.0:1787826299.108612:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84167:x1874668789640832:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1828us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.108619:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110979 00000100:00100000:3.0:1787826299.109585:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.109658:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789641216 00000100:00100000:1.0:1787826299.109665:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789641216 00000100:00100000:1.0:1787826299.109702:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6125 00000100:00100000:1.0:1787826299.109710:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84168:x1874668789641216:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.109722:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.109738:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb721 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.109765:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb713 expref: 15 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.109774:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.109777:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.109783:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.110499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826299.110760:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb713 expref: 15 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.110776:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb713 expref: 15 pid: 8433 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.110904:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.110995:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789641472 00000100:00100000:3.0:1787826299.111005:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789641472 00000100:00100000:1.0:1787826299.111074:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778601472:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.111079:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6126 00000100:00100000:3.0:1787826299.111087:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789641472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.111097:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.111112:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb728 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826299.111132:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1787826299.111140:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062240 going to sleep for 11 seconds 00010000:00010000:3.0:1787826299.111145:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:3.0:1787826299.111149:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1787826299.111156:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789641344 00010000:00010000:3.0:1787826299.111156:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb728 expref: 13 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.111159:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789641344 00010000:00010000:3.0:1787826299.111170:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb728 expref: 13 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.111181:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00000100:00100000:1.0:1787826299.111185:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110981 00000100:00100000:1.0:1787826299.111191:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84166:x1874668789641344:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.111206:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789641472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 121us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.111216:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6126 00000001:00080000:3.0:1787826299.114787:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016148 is committed 00000020:00080000:3.0:1787826299.114834:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17d56480 refcount 2 committed 0 result 0 batchid 4294970864 00000020:00080000:3.0:1787826299.114839:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d56300 00000020:00080000:3.0:1787826299.114842:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5eb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a125800 00000020:00080000:3.0:1787826299.114877:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0cb0eb40 refcount 2 committed 0 result 0 batchid 4294970863 00000020:00080000:3.0:1787826299.114881:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf1064c200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0cb0e6c0 00000020:00080000:3.0:1787826299.114884:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf123f9f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0b938400 00000020:00080000:3.0:1787826299.114895:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe15babd80 refcount 2 committed 0 result 0 batchid 4294970862 00000020:00080000:3.0:1787826299.114897:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe15baba80 00000020:00080000:3.0:1787826299.114900:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0b939400 00000020:00080000:3.0:1787826299.114913:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970861 batchid updated 00000020:00080000:2.0:1787826299.115100:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970864 committed batchid 4294970861 00000020:00080000:2.0:1787826299.115172:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970861 00010000:00010000:1.0:1787826299.115227:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115238:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115246:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115253:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.115257:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115265:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115287:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10a:0x0].0x0 (ffff9bbe0fe8c400) 00010000:00010000:1.0:1787826299.115290:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.115295:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115301:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f3499bee lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115325:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115331:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115336:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115346:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.115348:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115361:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115368:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10b:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:1.0:1787826299.115370:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.115373:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115378:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f3499bfc lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115390:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115396:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115402:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115406:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.115412:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115418:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115442:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826299.115445:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.115448:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115453:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f3499c11 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115466:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115472:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115478:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115482:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.115485:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115490:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115497:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:1.0:1787826299.115500:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826299.115502:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115508:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f3499d5a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115521:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115527:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115533:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115538:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.115540:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115545:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115552:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:1.0:1787826299.115553:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826299.115556:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115561:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f3499dae lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115569:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115573:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115578:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115583:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.115586:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115591:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115597:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:1.0:1787826299.115684:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826299.115688:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.115694:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499df4 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.116228:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778601472:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.116257:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.116274:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826299.116336:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:84168:x1874668789641216:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 6625us (6752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.116345:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6125 00000100:00100000:3.0:1787826299.116606:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.117025:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789641856 00000100:00100000:1.0:1787826299.117033:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789641856 00000100:00100000:1.0:1787826299.117071:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110982 00000100:00100000:1.0:1787826299.117079:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84167:x1874668789641856:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.117324:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84167:x1874668789641856:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 244us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.117332:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110982 00000100:00100000:2.0:1787826299.118048:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.118158:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84166:x1874668789641344:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 6963us (7657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.118167:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110981 00000100:00100000:1.0:1787826299.118346:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789641728 00000100:00100000:1.0:1787826299.118351:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789641728 00010000:00010000:1.0:1787826299.118377:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb713 expref: 15 pid: 8433 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.118412:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2915 00000100:00100000:1.0:1787826299.118420:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789641728:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826299.118449:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.118470:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb713 expref: 15 pid: 8433 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.118484:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb713 expref: 15 pid: 8433 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.118505:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f3499e64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb713 expref: 15 pid: 8433 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.118519:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.118523:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.118531:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.118547:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.118659:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.118673:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778601600:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826299.118735:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.122076:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.122161:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.122189:0:45397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789642112 00000100:00100000:2.0:1787826299.122197:0:45397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789642112 00002000:00100000:2.0:1787826299.122239:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xb6:0x0] (0->157) req@ffff9bbe12839680 x1874668789642112/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/0 e 0 to 0 dl 1787826310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826299.122250:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12839680 with x1874668789642112 ext(0->157) 00002000:00010000:2.0:1787826299.122256:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe12839680 00000100:00100000:2.0:1787826299.122291:0:45397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1550 00000100:00100000:2.0:1787826299.122300:0:45397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789642112:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.122460:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778601600:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826299.122482:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.122539:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789641728:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4119us (4492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.122548:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2915 00000100:00100000:1.0:1787826299.123107:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789641984 00000100:00100000:1.0:1787826299.123113:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789641984 00000100:00100000:1.0:1787826299.123152:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6127 00000100:00100000:1.0:1787826299.123159:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789641984:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.123352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.123396:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789642240 00000100:00100000:3.0:1787826299.123402:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789642240 00000100:00100000:3.0:1787826299.123446:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6128 00000100:00100000:3.0:1787826299.123454:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84167:x1874668789642240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.123464:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.123483:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb72f expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.123511:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb728 expref: 15 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.123520:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.123525:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.123531:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.123574:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb728 expref: 15 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.123587:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb728 expref: 15 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.123602:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778601728:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.123674:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff719c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.124777:0:45397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789642112:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2475us (2612us total) trans 4294968137 rc 0/0 00000100:00100000:2.0:1787826299.124788:0:45397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1550 00002000:00100000:2.0:1787826299.124798:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xb6:0x0] (0->157) req@ffff9bbe12839680 x1874668789642112/t4294968137(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/448 e 0 to 0 dl 1787826310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826299.124807:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12839680 with x1874668789642112 ext(0->157) 00002000:00010000:2.0:1787826299.124812:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe12839680 00000100:00100000:3.0:1787826299.127981:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778601728:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.128020:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.128040:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000001:00080000:0.0:1787826299.128418:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968120 is committed 00000001:00080000:0.0:1787826299.128443:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968119 is committed 00000100:00100000:1.0:1787826299.130145:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.130221:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.130321:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789641984:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 7161us (8253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.130331:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6127 00000100:00100000:2.0:1787826299.130406:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789642368 00000100:00100000:2.0:1787826299.130415:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789642368 00010000:00010000:2.0:1787826299.130998:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb728 expref: 12 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.131038:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2916 00000100:00100000:2.0:1787826299.131048:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789642368:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826299.131062:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.131078:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb728 expref: 12 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.131091:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb728 expref: 12 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.131113:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f3499e80 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb728 expref: 12 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.131129:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.131133:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.131142:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.131152:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.131340:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84167:x1874668789642240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 7885us (7986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.131353:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6128 00000100:00100000:3.0:1787826299.131381:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789642496 00000100:00100000:3.0:1787826299.131386:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789642496 00000100:00100000:3.0:1787826299.131417:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110983 00000100:00100000:3.0:1787826299.131423:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84168:x1874668789642496:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.131520:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84168:x1874668789642496:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 96us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.131528:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110983 00010000:00010000:2.0:1787826299.131547:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.131564:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12839a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778601856:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826299.131665:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.137097:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12839a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778601856:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826299.137123:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826299.137183:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789642368:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 6136us (7045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.137195:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2916 00000100:00100000:1.0:1787826299.139634:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.139662:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.139698:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.139897:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789642752 00000100:00100000:3.0:1787826299.139906:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789642752 00000100:00100000:3.0:1787826299.139955:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110984 00000100:00100000:3.0:1787826299.139964:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84166:x1874668789642752:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.140019:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.140045:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f3499e1e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6e9 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.140064:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826299.140069:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826299.140098:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.140111:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.140120:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826299.140235:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f48c30ff reply state 000000004219771b transno 8590016149 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.140248:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.140255:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826299.140258:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826299.140260:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826299.140356:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84166:x1874668789642752:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 392us (729us total) trans 8590016149 rc 0/0 00000100:00100000:3.0:1787826299.140363:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110984 00000100:00100000:2.0:1787826299.140562:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789643008 00000100:00100000:2.0:1787826299.140567:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789643008 00002000:00100000:2.0:1787826299.140597:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xb7:0x0] (0->157) req@ffff9bbf0c8df0c0 x1874668789643008/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/0 e 0 to 0 dl 1787826310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826299.140607:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf0c8df0c0 with x1874668789643008 ext(0->157) 00002000:00010000:2.0:1787826299.140612:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf0c8df0c0 00000100:00100000:2.0:1787826299.140676:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1551 00000100:00100000:2.0:1787826299.140684:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789643008:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.141066:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789642880 00000100:00100000:2.0:1787826299.141071:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789642880 00000100:00100000:2.0:1787826299.141096:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6129 00000100:00100000:2.0:1787826299.141103:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789642880:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787826299.143171:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968137 is committed 00000001:00080000:2.0:1787826299.143186:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968136 is committed 00000100:00100000:2.0:1787826299.147443:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789642880:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 6316us (7754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.147458:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6129 00000100:00100000:3.0:1787826299.147877:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789643008:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 7189us (8173us total) trans 4294968121 rc 0/0 00000100:00100000:3.0:1787826299.147887:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1551 00002000:00100000:3.0:1787826299.147899:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xb7:0x0] (0->157) req@ffff9bbf0c8df0c0 x1874668789643008/t4294968121(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/448 e 0 to 0 dl 1787826310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826299.147909:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf0c8df0c0 with x1874668789643008 ext(0->157) 00002000:00010000:3.0:1787826299.147921:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf0c8df0c0 00000100:00100000:1.0:1787826299.148468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.150532:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789643136 00000100:00100000:2.0:1787826299.150543:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789643136 00000100:00100000:2.0:1787826299.150607:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110985 00000100:00100000:2.0:1787826299.150616:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84166:x1874668789643136:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.150685:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.150706:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb736 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.150762:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb736 expref: 33 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.150779:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb736 expref: 33 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.150796:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826299.150799:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.150803:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:2.0:1787826299.151262:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84166:x1874668789643136:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 645us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.151270:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110985 00000100:00100000:0.0:1787826299.156331:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.156380:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.156496:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789643264 00000100:00100000:3.0:1787826299.156505:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789643264 00000100:00100000:3.0:1787826299.156555:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789643520 00000100:00100000:3.0:1787826299.156558:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789643520 00000100:00100000:3.0:1787826299.156579:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110986 00000100:00100000:3.0:1787826299.156588:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84167:x1874668789643264:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.156712:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84167:x1874668789643264:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 125us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.156720:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110986 00000100:00100000:3.0:1787826299.156738:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110987 00000100:00100000:3.0:1787826299.156743:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84168:x1874668789643520:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.156776:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.156802:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499e56 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb70c expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.156828:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826299.156833:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826299.156880:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.156893:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.156903:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826299.157001:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9a005e6 reply state 0000000068c5f01f transno 8590016150 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.157014:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.157020:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826299.157023:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826299.157025:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826299.157069:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84168:x1874668789643520:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 325us (687us total) trans 8590016150 rc 0/0 00000100:00100000:3.0:1787826299.157080:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110987 00000100:00100000:1.0:1787826299.163841:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.164114:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789643648 00000100:00100000:2.0:1787826299.164124:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789643648 00000100:00100000:2.0:1787826299.164178:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6130 00000100:00100000:2.0:1787826299.164187:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789643648:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826299.164415:0:25038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb6:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826299.164419:0:25038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb6:0x0] updating lvb mtime from disk: 0 -> 1787826217 00002000:00010000:2.0:1787826299.164421:0:25038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb6:0x0] updating lvb atime from disk: 0 -> 1787826217 00002000:00010000:2.0:1787826299.164423:0:25038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb6:0x0] updating lvb ctime from disk: 0 -> 1787826217 00002000:00010000:2.0:1787826299.164434:0:25038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826299.164494:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789643648:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 308us (662us total) trans 4294968122 rc 0/0 00000100:00100000:2.0:1787826299.164502:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6130 00000100:00100000:3.0:1787826299.166173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.166262:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789643776 00000100:00100000:2.0:1787826299.166270:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789643776 00000100:00100000:2.0:1787826299.166325:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6131 00000100:00100000:2.0:1787826299.166335:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789643776:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.166909:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.167114:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789643904 00000100:00100000:3.0:1787826299.167119:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789643904 00000100:00100000:3.0:1787826299.167153:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110988 00000100:00100000:3.0:1787826299.167161:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84168:x1874668789643904:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.167210:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.167229:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb73d expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.167310:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb73d expref: 35 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.167326:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb73d expref: 35 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.167500:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826299.167503:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.167507:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826299.167560:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84168:x1874668789643904:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 400us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.167567:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110988 00000001:00080000:3.0:1787826299.168180:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968122 is committed 00000100:00100000:0.0:1787826299.168279:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789643776:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 1943us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.168287:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6131 00000100:00100000:3.0:1787826299.168509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.168792:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789644160 00000100:00100000:0.0:1787826299.168798:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789644160 00000100:00100000:0.0:1787826299.168841:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110989 00000100:00100000:0.0:1787826299.168849:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84166:x1874668789644160:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.168923:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.168938:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb63a expref: 35 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.168947:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 4/0,1 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.168977:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb63a expref: 35 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.168990:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb63a expref: 35 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.169003:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778601984:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.169060:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.171137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.171461:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789644288 00000100:00100000:0.0:1787826299.171470:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789644288 00000100:00100000:0.0:1787826299.171521:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6132 00000100:00100000:0.0:1787826299.171530:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789644288:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826299.171673:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb6:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826299.171677:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb6:0x0] updating lvb mtime from disk: 0 -> 1787826217 00002000:00010000:0.0:1787826299.171679:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb6:0x0] updating lvb atime from disk: 0 -> 1787826217 00002000:00010000:0.0:1787826299.171681:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb6:0x0] updating lvb ctime from disk: 0 -> 1787826217 00002000:00010000:0.0:1787826299.171684:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826299.171752:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789644288:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 221us (621us total) trans 4294968138 rc 0/0 00000100:00100000:0.0:1787826299.171759:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6132 00000100:00100000:2.0:1787826299.173507:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.173584:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789644416 00000100:00100000:3.0:1787826299.173592:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789644416 00010000:00010000:3.0:1787826299.173627:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb63a expref: 36 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.173708:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2917 00000100:00100000:3.0:1787826299.173717:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789644416:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.173730:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.173735:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb63a expref: 36 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.173749:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb63a expref: 36 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.173770:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826299.173775:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.173784:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.173791:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.173809:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.173877:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789644416:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.173884:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2917 00010000:00010000:1.0:1787826299.173970:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f3499d3e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb63a expref: 35 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.173987:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778601984:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.174005:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.174013:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.174020:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.174056:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.174063:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.174070:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.174075:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.174079:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.174087:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.174096:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:1.0:1787826299.174099:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826299.174103:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 2/0,0 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.174110:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499eaa lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.174148:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84166:x1874668789644160:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 5300us (5640us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826299.174156:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110989 00000100:00100000:2.0:1787826299.177730:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.177814:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789644672 00000100:00100000:3.0:1787826299.177832:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789644672 00000100:00100000:3.0:1787826299.177907:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110990 00000100:00100000:3.0:1787826299.177917:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84167:x1874668789644672:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.177969:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.177997:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499e72 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb71a expref: 34 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.178014:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826299.178019:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826299.178048:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.178060:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.178069:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826299.178183:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002f9756a reply state 000000009aab192b transno 8590016151 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.178197:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.178202:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826299.178205:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826299.178207:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826299.178317:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84167:x1874668789644672:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 401us (593us total) trans 8590016151 rc 0/0 00000100:00100000:3.0:1787826299.178324:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110990 00000100:00100000:3.0:1787826299.180201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.180330:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789644928 00000100:00100000:2.0:1787826299.180338:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789644928 00000100:00100000:2.0:1787826299.180395:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110991 00000100:00100000:2.0:1787826299.180404:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84168:x1874668789644928:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.180469:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.180484:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb687 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.180493:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.180526:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb687 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.180540:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb687 expref: 35 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.180559:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41060000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778602112:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826299.180630:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.181058:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.181093:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789645056 00000100:00100000:0.0:1787826299.181098:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789645056 00000100:00100000:0.0:1787826299.181137:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6133 00000100:00100000:0.0:1787826299.181145:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789645056:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.181174:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.181190:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.181198:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.181202:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.181205:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.181227:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.181238:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 10 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.181250:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778602240:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.181300:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.182796:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.182894:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789645184 00000100:00100000:0.0:1787826299.182901:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789645184 00000100:00100000:0.0:1787826299.182949:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110992 00000100:00100000:0.0:1787826299.182958:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84167:x1874668789645184:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.182977:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.182995:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb744 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.183050:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb744 expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.183065:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb744 expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.183085:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826299.183088:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.183092:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:0.0:1787826299.183146:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84167:x1874668789645184:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 188us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.183153:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110992 00000100:00100000:2.0:1787826299.184049:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41060000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778602112:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826299.184070:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.186383:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.186420:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.186517:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778602240:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.186541:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.186597:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789645312 00000100:00100000:3.0:1787826299.186604:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789645312 00010000:00010000:3.0:1787826299.186640:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb687 expref: 37 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.186672:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789645440 00000100:00100000:3.0:1787826299.186675:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789645440 00010000:00010000:3.0:1787826299.186688:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 11 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.186719:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2918 00000100:00100000:3.0:1787826299.186728:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2402:x1874668789645312:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.186742:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.186749:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb687 expref: 37 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.186760:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb687 expref: 37 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.186781:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499d99 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb687 expref: 37 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.186795:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826299.186800:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.186809:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.186821:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.186840:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.186911:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789645312:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 185us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.186918:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2918 00000100:00100000:3.0:1787826299.186934:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2919 00000100:00100000:3.0:1787826299.186940:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40517c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789645440:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.186950:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.186967:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 11 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.186978:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 11 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.186992:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f3499e48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb705 expref: 11 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187004:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826299.187008:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826299.187012:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187021:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187043:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.187058:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40517c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789645440:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 119us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.187064:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2919 00010000:00010000:3.0:1787826299.187102:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187110:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187127:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187134:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187142:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187149:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.187153:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187162:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187178:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.187185:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f3499ebf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.187220:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789645056:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 6077us (6164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.187227:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6133 00010000:00010000:2.0:1787826299.187598:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.187606:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.187642:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.187647:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.187653:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.187658:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.187662:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.187673:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.187683:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:2.0:1787826299.187685:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826299.187688:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.187694:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499eb8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.187729:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84168:x1874668789644928:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 7327us (7535us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826299.187737:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110991 00000100:00100000:1.0:1787826299.189916:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.190120:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789645568 00000100:00100000:2.0:1787826299.190128:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789645568 00000100:00100000:2.0:1787826299.190178:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6134 00000100:00100000:2.0:1787826299.190187:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789645568:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826299.190331:0:25038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb7:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826299.190335:0:25038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb7:0x0] updating lvb mtime from disk: 0 -> 1787826217 00002000:00010000:2.0:1787826299.190338:0:25038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb7:0x0] updating lvb atime from disk: 0 -> 1787826217 00002000:00010000:2.0:1787826299.190340:0:25038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb7:0x0] updating lvb ctime from disk: 0 -> 1787826217 00002000:00010000:2.0:1787826299.190342:0:25038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb7:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826299.190387:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789645568:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 201us (478us total) trans 4294968123 rc 0/0 00000100:00100000:2.0:1787826299.190395:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6134 00000100:00100000:2.0:1787826299.195217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.195295:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.195792:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789645824 00000100:00100000:3.0:1787826299.195801:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789645824 00000100:00100000:0.0:1787826299.196005:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789645952 00000100:00100000:0.0:1787826299.196010:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789645952 00000100:00100000:0.0:1787826299.196104:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6135 00000100:00100000:3.0:1787826299.196104:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110993 00000100:00100000:0.0:1787826299.196114:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789645952:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.196114:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84166:x1874668789645824:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.196154:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.196174:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.196180:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xda:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.196182:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.196187:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.196191:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 4/1,0 mode: --/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.196191:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.196203:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.196224:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.196237:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 13 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.196251:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778602368:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.196334:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09e40 going to sleep for 11 seconds 00010000:00010000:3.0:1787826299.196444:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.196457:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb736 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.196469:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.196486:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb736 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.196494:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb736 expref: 36 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.196503:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a116940 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778602496:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.196526:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff71540 going to sleep for 11 seconds 00000004:00080000:3.0:1787826299.200002:0:38205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2937311147781ns, next at 2938311145019ns, rc = 0 00000100:00100000:3.0:1787826299.200034:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a114b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778602624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826299.200094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.200253:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778602624 00000100:00100000:0.0:1787826299.200261:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778602624 00000100:00100000:0.0:1787826299.200328:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:0.0:1787826299.200337:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778602624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826299.200357:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671904064 pending 0 free 3894837248 avail 3663142912 00000100:00100000:0.0:1787826299.200403:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778602624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.200410:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:0.0:1787826299.200461:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968119 gen 2 00000004:00080000:0.0:1787826299.200466:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968119 committed transno 4294968119 00000100:00100000:0.0:1787826299.200493:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a114b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778602624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826299.200670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.200693:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789646208 00000100:00100000:1.0:1787826299.200697:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789646208 00000100:00100000:1.0:1787826299.200726:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110994 00000100:00100000:1.0:1787826299.200733:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84167:x1874668789646208:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.200781:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.200797:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6d4 expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.200806:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.200834:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6d4 expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.200846:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6d4 expref: 37 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.200894:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078b40 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778602752:192.168.203.9@tcp:104: 00000004:00080000:2.0:1787826299.201102:0:38203:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2937312249112ns, next at 2938312247195ns, rc = 0 00000100:00080000:2.0:1787826299.203010:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826299.203101:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0620c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.203186:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778602880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826299.203249:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826299.204070:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778602880 00000100:00100000:3.0:1787826299.204082:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778602880 00000100:00100000:3.0:1787826299.204216:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1787826299.204226:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778602880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826299.204506:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828658176 avail 3596963840 00000100:00100000:3.0:1787826299.204571:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778602880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 346us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.204578:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1787826299.204622:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968136 gen 2 00000004:00080000:3.0:1787826299.204629:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968135 committed transno 4294968136 00000004:00080000:3.0:1787826299.204663:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968136 committed transno 4294968136 00000100:00100000:3.0:1787826299.204681:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778602880:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787826299.205352:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826299.209407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.209443:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.209444:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778602368:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.209468:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.209473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.209499:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789646464 00000100:00100000:2.0:1787826299.209505:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789646464 00000100:00100000:3.0:1787826299.209538:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789646336 00010000:00010000:2.0:1787826299.209541:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6d4 expref: 38 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.209541:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789646336 00010000:00010000:3.0:1787826299.209558:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb736 expref: 39 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.209574:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789646592 00000100:00100000:3.0:1787826299.209577:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789646592 00000100:00100000:2.0:1787826299.209580:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2920 00000100:00100000:2.0:1787826299.209587:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789646464:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.209589:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 14 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.209600:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826299.209605:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2921 00010000:00010000:2.0:1787826299.209607:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6d4 expref: 39 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.209610:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789646336:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.209616:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.209618:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6d4 expref: 39 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209621:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb736 expref: 39 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209629:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb736 expref: 39 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209642:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826299.209648:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209657:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209665:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209680:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.209730:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789646336:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 119us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.209738:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2921 00000100:00100000:3.0:1787826299.209756:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2922 00000100:00100000:3.0:1787826299.209762:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789646592:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.209771:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.209790:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 14 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209800:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 14 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209815:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f3499e79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb721 expref: 14 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209828:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826299.209832:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826299.209836:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.209845:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.209940:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826299.209946:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.209954:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.209961:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.209974:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826299.209994:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789646464:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 407us (598us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826299.209998:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826299.210001:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2920 00000100:00100000:3.0:1787826299.210017:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789646592:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 255us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.210023:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2922 00010000:00010000:2.0:1787826299.210033:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f3499de6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb6d4 expref: 37 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.210044:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078b40 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778602752:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.210048:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f3499e95 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb736 expref: 36 pid: 12105 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.210058:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.210058:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a116940 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778602496:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826299.210065:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.210067:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.210071:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.210074:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.210079:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.210111:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.210117:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.210122:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.210128:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.210132:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.210142:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.210150:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826299.210152:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826299.210155:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826299.210158:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016152 00010000:00010000:2.0:1787826299.210161:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f3499ee2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.210194:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84167:x1874668789646208:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 9462us (9526us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826299.210201:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110994 00000001:00080000:3.0:1787826299.210258:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016153 00000001:00080000:3.0:1787826299.210293:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016154 00010000:00010000:1.0:1787826299.210385:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.210394:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.210413:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.210421:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.210442:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.210448:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826299.210451:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.210463:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.210474:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.210481:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c172164/0x68019081f3499ecd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.210529:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789645952:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 14418us (15234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.210537:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6135 00000100:00100000:3.0:1787826299.211004:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a116940 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778603008:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787826299.211053:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826299.211076:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff71a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.211137:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778603008 00000100:00100000:1.0:1787826299.211143:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778603008 00000100:00100000:1.0:1787826299.211183:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279 00000100:00100000:1.0:1787826299.211190:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778603008:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787826299.211271:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778603008:12345-0@lo:1000:mdt00_006.0 Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.211277:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279 00000100:00100000:2.0:1787826299.211392:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a116940 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778603008:0@lo:1000:mdt00_006.0 00000001:00080000:2.0:1787826299.211626:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016155 00000100:00100000:2.0:1787826299.211677:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778603136:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787826299.211707:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826299.211730:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.211769:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778603136 00000100:00100000:3.0:1787826299.211773:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778603136 00000100:00100000:3.0:1787826299.211803:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:3.0:1787826299.211809:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778603136:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787826299.217103:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778603136:12345-0@lo:1000:mdt00_006.0 Request processed in 5286us (5386us total) trans 4294968124 rc 0/0 00000100:00100000:3.0:1787826299.217118:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00100000:2.0:1787826299.217441:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778603136:0@lo:1000:mdt00_006.0 00000001:00080000:2.0:1787826299.217540:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016156 00010000:00010000:2.0:1787826299.217573:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217583:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217590:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217597:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.217601:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217608:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217622:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826299.217625:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.217630:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217637:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f3499edb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217663:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcce00/0x68019081f349908e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217669:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcce00/0x68019081f349908e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217674:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcce00/0x68019081f349908e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217680:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0ddcce00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.217682:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcce00/0x68019081f349908e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217688:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcce00/0x68019081f349908e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217700:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xda:0x0].0x0 (ffff9bbf41389100) 00010000:00010000:2.0:1787826299.217702:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.217705:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcce00/0x68019081f349908e lrc: 2/0,0 mode: --/EX res: [0x200000403:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217711:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcce00/0x68019081f349908e lrc: 0/0,0 mode: --/EX res: [0x200000403:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217731:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xda:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217742:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217751:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217757:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217761:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217766:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217770:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.217773:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217778:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217784:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xda:0x0].0x0 (ffff9bbf41389100) 00010000:00010000:2.0:1787826299.217786:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.217788:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217793:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499ee9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xda:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217801:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xda:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217807:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xda:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217812:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xda:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217817:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.217820:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xda:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217826:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xda:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217833:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xda:0x0].0x0 (ffff9bbf41389100) 00010000:00010000:2.0:1787826299.217835:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826299.217838:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xda:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.217843:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f3499ed4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xda:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.218623:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84166:x1874668789645824:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 22507us (23412us total) trans 8590016157 rc 0/0 00000100:00100000:2.0:1787826299.218634:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110993 00000020:00080000:2.0:1787826299.218638:0:25756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826299.219774:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.221258:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.221335:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789646976 00000100:00100000:0.0:1787826299.221343:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789646976 00000100:00100000:3.0:1787826299.221396:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789646720 00000100:00100000:0.0:1787826299.221398:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110995 00000100:00100000:3.0:1787826299.221400:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789646720 00000100:00100000:0.0:1787826299.221408:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84168:x1874668789646976:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.221440:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6136 00000100:00100000:3.0:1787826299.221446:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789646720:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.221475:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.221484:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.221492:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.221494:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.221501:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.221505:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.221506:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.221509:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.221540:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.221554:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 10 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.221567:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a117840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778603264:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.221646:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787826299.221651:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.221662:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb73d expref: 40 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.221669:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.221688:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb73d expref: 40 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.221697:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb73d expref: 40 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.221707:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778603392:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.221733:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.231475:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.231507:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.231747:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a117840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778603264:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.231775:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.231806:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778603392:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.231817:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.231981:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789647104 00000100:00100000:0.0:1787826299.231988:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789647104 00010000:00010000:0.0:1787826299.232023:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 11 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.232058:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789647232 00000100:00100000:0.0:1787826299.232061:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789647232 00010000:00010000:0.0:1787826299.232074:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb73d expref: 41 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.232096:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2923 00000100:00100000:0.0:1787826299.232104:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a115e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789647104:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.232117:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.232136:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 11 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232149:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 11 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232172:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f3499e87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb72f expref: 11 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232186:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.232189:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.232194:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232202:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232223:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.232270:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a115e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789647104:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 167us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.232278:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2923 00000100:00100000:0.0:1787826299.232294:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2924 00000100:00100000:0.0:1787826299.232301:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+41:2402:x1874668789647232:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.232577:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.232585:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb73d expref: 41 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232596:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb73d expref: 41 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232611:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499ea3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb73d expref: 41 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232622:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:0.0:1787826299.232627:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232635:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232642:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232659:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.232681:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789647232:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 380us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.232688:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2924 00010000:00010000:0.0:1787826299.232714:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.232721:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826299.232820:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016158 00000001:00080000:0.0:1787826299.232959:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016159 00000001:00080000:0.0:1787826299.232996:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016160 00000100:00100000:0.0:1787826299.233068:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778603520:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787826299.233115:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826299.234214:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.234230:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.234255:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.234265:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.234273:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.234280:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826299.234284:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.234293:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.234320:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.234328:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f3499ef0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.234406:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789646720:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 12957us (14821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.234418:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6136 00000100:00100000:1.0:1787826299.235169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.235266:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789647488 00000100:00100000:1.0:1787826299.235273:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789647488 00000100:00100000:1.0:1787826299.235319:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2581 00000100:00100000:1.0:1787826299.235328:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84166:x1874668789647488:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787826299.235557:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x10d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826299.235589:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016162 00010000:00010000:1.0:1787826299.235621:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.235636:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.235647:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.235654:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.235660:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.235665:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.235681:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826299.235740:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+45:84166:x1874668789647488:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 413us (574us total) trans 8590016163 rc 0/0 00000100:00100000:1.0:1787826299.235750:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2581 00000020:00080000:1.0:1787826299.235754:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826299.236662:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826299.236671:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.236679:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826299.236682:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.236690:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.236704:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:1.0:1787826299.236707:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826299.236712:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.236718:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f05 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.236731:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826299.236733:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826299.236734:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826299.237417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.238203:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789647744 00000100:00100000:0.0:1787826299.238213:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789647744 00000100:00100000:0.0:1787826299.238267:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110996 00000100:00100000:0.0:1787826299.238277:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+45:84167:x1874668789647744:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.238357:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 3/0,1 mode: --/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.238371:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.238381:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.238527:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.238539:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb744 expref: 46 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.238548:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.238582:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb744 expref: 46 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.238596:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb744 expref: 46 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.238610:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778603648:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.238678:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.238696:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.238807:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778603520 00000100:00100000:3.0:1787826299.238813:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778603520 00000100:00100000:3.0:1787826299.238980:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3281 00000100:00100000:3.0:1787826299.238987:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778603520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826299.239071:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778603520:12345-0@lo:1000:mdt00_004.0 Request processed in 85us (5956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.239078:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3281 00000100:00100000:0.0:1787826299.239415:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778603520:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1787826299.239543:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016161 00000100:00100000:0.0:1787826299.239592:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778603776:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787826299.239627:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.239655:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778603776 00000100:00100000:0.0:1787826299.239659:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778603776 00000100:00100000:0.0:1787826299.239686:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3282 00000100:00100000:0.0:1787826299.239693:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778603776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787826299.239777:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:12105:x1874668778603776:12345-0@lo:1000:mdt00_004.0 Request processed in 84us (148us total) trans 4294968139 rc 0/0 00000100:00100000:0.0:1787826299.239784:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3282 00000100:00100000:0.0:1787826299.239805:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.241557:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778603776:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1787826299.241662:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016165 00010000:00010000:0.0:1787826299.241704:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241715:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241721:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241727:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.241731:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241740:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241756:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:0.0:1787826299.241760:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.241765:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241771:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f3499efe lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241798:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcde00/0x68019081f349909c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241804:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcde00/0x68019081f349909c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241809:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcde00/0x68019081f349909c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.241814:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0ddcde00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.242015:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcde00/0x68019081f349909c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242024:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcde00/0x68019081f349909c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242033:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdc:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:0.0:1787826299.242035:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.242038:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcde00/0x68019081f349909c lrc: 2/0,0 mode: --/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242043:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcde00/0x68019081f349909c lrc: 0/0,0 mode: --/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242100:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 3/0,1 mode: --/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242112:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242121:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242127:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242132:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242137:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242142:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.242145:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242149:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242156:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdc:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:0.0:1787826299.242158:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.242161:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 2/0,0 mode: --/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242166:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f1a lrc: 0/0,0 mode: --/EX res: [0x200000403:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242176:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242182:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242189:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242194:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.242196:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242201:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242213:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdc:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:0.0:1787826299.242215:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826299.242218:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.242223:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499ef7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.243088:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84168:x1874668789646976:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 21676us (21839us total) trans 8590016166 rc 0/0 00000100:00100000:0.0:1787826299.243099:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110995 00000020:00080000:0.0:1787826299.243105:0:12105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:0.0:1787826299.246250:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.246298:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778603648:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.246334:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.248035:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789647872 00000100:00100000:1.0:1787826299.248048:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789647872 00010000:00010000:1.0:1787826299.248092:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb744 expref: 48 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.248128:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2925 00000100:00100000:1.0:1787826299.248139:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2401:x1874668789647872:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826299.248153:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.248160:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb744 expref: 48 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.248173:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb744 expref: 48 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.248195:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f3499ec6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb744 expref: 48 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.248207:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:1.0:1787826299.248212:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.248221:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.248229:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.250193:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826299.250338:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2401:x1874668789647872:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2195us (4093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.250349:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2925 00010000:00010000:0.0:1787826299.250923:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.250933:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826299.251037:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016164 00000001:00080000:0.0:1787826299.251146:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016167 00000001:00080000:0.0:1787826299.251181:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016168 00000100:00100000:0.0:1787826299.251257:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafe580 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778603904:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1787826299.251321:0:45682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.251355:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.251380:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778603904 00000100:00100000:0.0:1787826299.251386:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778603904 00000100:00100000:0.0:1787826299.251436:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3283 00000100:00100000:0.0:1787826299.251444:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778603904:12345-0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1787826299.251521:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778603904:12345-0@lo:1000:mdt00_008.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.251529:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3283 00000100:00100000:0.0:1787826299.251574:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafe580 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778603904:0@lo:1000:mdt00_008.0 00000001:00080000:0.0:1787826299.251691:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016169 00000100:00100000:0.0:1787826299.251726:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafe580 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778604032:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1787826299.251750:0:45682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.251766:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.251779:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778604032 00000100:00100000:0.0:1787826299.251782:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778604032 00000100:00100000:0.0:1787826299.251808:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3284 00000100:00100000:0.0:1787826299.251815:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778604032:12345-0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1787826299.251933:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:45682:x1874668778604032:12345-0@lo:1000:mdt00_008.0 Request processed in 118us (181us total) trans 4294968125 rc 0/0 00000100:00100000:0.0:1787826299.251940:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3284 00000100:00100000:0.0:1787826299.251986:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafe580 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778604032:0@lo:1000:mdt00_008.0 00000001:00080000:0.0:1787826299.252032:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016170 00010000:00010000:0.0:1787826299.252054:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252064:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252074:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252081:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.252085:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252093:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252109:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826299.252113:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.252117:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252124:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f13 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252152:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcda00/0x68019081f3499095 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252158:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcda00/0x68019081f3499095 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252164:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcda00/0x68019081f3499095 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252169:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0ddcda00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.252172:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcda00/0x68019081f3499095 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252182:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcda00/0x68019081f3499095 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252189:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdb:0x0].0x0 (ffff9bbf41389200) 00010000:00010000:0.0:1787826299.252191:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.252194:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcda00/0x68019081f3499095 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252199:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcda00/0x68019081f3499095 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252221:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252231:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252240:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252246:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252251:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252257:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252262:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.252264:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252270:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252277:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdb:0x0].0x0 (ffff9bbf41389200) 00010000:00010000:0.0:1787826299.252279:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.252282:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252287:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f3499f21 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252297:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252303:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252309:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252314:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.252317:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252322:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252328:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdb:0x0].0x0 (ffff9bbf41389200) 00010000:00010000:0.0:1787826299.252330:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826299.252333:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 2/0,0 mode: --/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.252343:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f3499f0c lrc: 0/0,0 mode: --/PW res: [0x200000403:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.252453:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84167:x1874668789647744:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 14176us (15037us total) trans 8590016171 rc 0/0 00000100:00100000:0.0:1787826299.252462:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110996 00000020:00080000:0.0:1787826299.252467:0:45682:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:2.0:1787826299.252838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.252930:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789648128 00000100:00100000:2.0:1787826299.252935:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789648128 00000100:00100000:2.0:1787826299.252967:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2582 00000100:00100000:2.0:1787826299.252975:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84168:x1874668789648128:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1787826299.253014:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826299.253019:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826299.255469:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9670 count 103 00000040:00080000:3.0:1787826299.255484:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826299.255662:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a116580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778604160:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826299.255737:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2300 going to sleep for 11 seconds 00000004:00080000:2.0:1787826299.255771:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x10e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826299.255811:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016172 00010000:00010000:2.0:1787826299.256051:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.256067:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.256080:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.256089:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.256096:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.256103:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.256124:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826299.256177:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84168:x1874668789648128:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 3203us (3338us total) trans 8590016173 rc 0/0 00000100:00100000:2.0:1787826299.256187:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2582 00000020:00080000:2.0:1787826299.256192:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826299.256772:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826299.256779:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.256787:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.256790:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.256798:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.256811:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826299.256814:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826299.256818:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.257002:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f3499f28 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.257016:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.257018:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.257020:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826299.259485:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a116580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778604160:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826299.260718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.260794:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.260833:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789648256 00000100:00100000:0.0:1787826299.260840:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789648256 00000100:00100000:3.0:1787826299.260945:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789648384 00000100:00100000:3.0:1787826299.260950:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789648384 00000100:00100000:0.0:1787826299.261664:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110997 00000100:00100000:3.0:1787826299.263280:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110998 00000100:00100000:3.0:1787826299.263292:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84173:x1874668789648384:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826299.263323:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xdd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826299.263549:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84173:x1874668789648384:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 258us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.263557:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110998 00000100:00100000:2.0:1787826299.263816:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.263845:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789648512 00000100:00100000:2.0:1787826299.263867:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789648512 00000100:00100000:2.0:1787826299.264016:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110999 00000100:00100000:2.0:1787826299.264024:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84175:x1874668789648512:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826299.264044:0:45683:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xdf:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826299.264097:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84175:x1874668789648512:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.264104:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110999 00000100:00100000:2.0:1787826299.264220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.264241:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789648768 00000100:00100000:2.0:1787826299.264359:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789648768 00000100:00100000:2.0:1787826299.264436:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2583 00000100:00100000:2.0:1787826299.264444:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84167:x1874668789648768:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826299.264665:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x10f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1787826299.264677:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84174:x1874668789648256:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000001:00080000:2.0:1787826299.264704:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016174 00010000:00010000:2.0:1787826299.264737:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1787826299.264750:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xde:0x0] from 18446744073709551615 #0 00010000:00010000:2.0:1787826299.264752:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.264767:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.264775:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.264782:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.264788:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.264802:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826299.264806:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84174:x1874668789648256:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 3134us (4093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.264812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110997 00010000:00010000:0.0:1787826299.264843:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787826299.264881:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84167:x1874668789648768:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 408us (630us total) trans 8590016175 rc 0/0 00000100:00100000:2.0:1787826299.264890:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2583 00000020:00080000:2.0:1787826299.264893:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826299.264933:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.264941:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826299.264945:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.264952:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.264970:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826299.264973:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826299.264977:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 1/0,0 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.264982:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f3499f2f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.264994:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826299.264996:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826299.264998:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826299.275383:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.275415:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.275450:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.276735:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789648896 00000100:00100000:1.0:1787826299.276745:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789648896 00000100:00100000:1.0:1787826299.276792:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789649024 00000100:00100000:1.0:1787826299.276796:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789649024 00000100:00100000:1.0:1787826299.276811:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789649152 00000100:00100000:1.0:1787826299.276823:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789649152 00000100:00100000:1.0:1787826299.276845:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111000 00000100:00100000:1.0:1787826299.276882:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84174:x1874668789648896:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.276954:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.276971:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.276983:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.276997:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277004:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277011:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277037:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xde:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277045:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277051:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.277097:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xde:0x0]: returning size 158 00000004:00200000:1.0:1787826299.277101:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826299.277114:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277125:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277133:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277139:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277146:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277152:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.277156:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277164:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277175:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826299.277178:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.277183:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277189:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f3499f36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277204:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277211:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277217:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277223:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.277226:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277232:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.277240:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3f13a856 (ffff9bbe16e56d00) 00010000:00010000:1.0:1787826299.277242:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.278020:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278035:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f3499f3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3f13a856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278054:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278060:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278065:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278071:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.278074:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278081:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278090:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xde:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:1.0:1787826299.278092:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.278096:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278101:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f3499f44 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.278180:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84174:x1874668789648896:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1305us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.278188:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111000 00000100:00100000:1.0:1787826299.278212:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111001 00000100:00100000:1.0:1787826299.278221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84175:x1874668789649024:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.278335:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278346:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278354:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278371:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278378:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278385:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278405:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278413:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278420:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.278472:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xdf:0x0]: returning size 158 00000004:00200000:1.0:1787826299.278476:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826299.278485:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278495:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278501:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278507:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278516:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278520:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.278523:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278528:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278536:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826299.278539:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.278542:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278547:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f3499f4b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278554:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278560:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278565:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278569:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.278571:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278580:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278657:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xf906be0b (ffff9bbe16e56b00) 00010000:00010000:1.0:1787826299.278659:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.278662:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278668:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f3499f52 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf906be0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.278680:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.278681:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111002 00010000:00010000:1.0:1787826299.278686:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.278691:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84173:x1874668789649152:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.278723:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278732:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278740:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278751:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278757:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278763:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278783:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278790:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278796:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826299.278817:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xdd:0x0]: returning size 158 00000004:00200000:0.0:1787826299.278820:0:45682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826299.278826:0:45682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278833:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278839:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278845:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278871:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.278874:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278881:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278889:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826299.278892:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.278895:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278901:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499f60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278911:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278916:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278921:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278926:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.278929:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278935:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278941:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xc7310b6c (ffff9bbf0f565000) 00010000:00010000:0.0:1787826299.278944:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.278947:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278952:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499f67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc7310b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278964:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278970:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278975:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278980:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.278982:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278988:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.278995:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdd:0x0].0x0 (ffff9bbf41389700) 00010000:00010000:0.0:1787826299.278998:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.279001:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 2/0,0 mode: --/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.279006:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499f6e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.279020:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.279027:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.279030:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.279036:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.279044:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdf:0x0].0x0 (ffff9bbf41389900) 00010000:00010000:1.0:1787826299.279046:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.279049:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.279051:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84173:x1874668789649152:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 362us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.279058:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111002 00010000:00010000:1.0:1787826299.279059:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f3499f59 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.279090:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84175:x1874668789649024:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 871us (3674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.279096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111001 00000100:00100000:2.0:1787826299.283216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.283292:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789649408 00000100:00100000:3.0:1787826299.283302:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789649408 00000100:00100000:3.0:1787826299.283446:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111003 00000100:00100000:3.0:1787826299.283457:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84174:x1874668789649408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.283477:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.283495:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499f75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb74b expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283593:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xde:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283608:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283620:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.283630:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xde:0x0]: returning size 158 00010000:00010000:3.0:1787826299.283704:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283710:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283716:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283721:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.283725:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283732:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283743:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xde:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:3.0:1787826299.283746:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826299.283749:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 2/0,0 mode: --/PR res: [0x200000403:0xde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283755:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499f7c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283789:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499f75 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb74b expref: 57 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283802:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826299.283804:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826299.283807:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499f75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb74b expref: 57 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.283816:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826299.283910:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84174:x1874668789649408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 455us (701us total) trans 8590016176 rc 301/301 00000100:00100000:3.0:1787826299.283917:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111003 00000100:00100000:3.0:1787826299.289271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.289386:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789649664 00000100:00100000:2.0:1787826299.289395:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789649664 00000100:00100000:2.0:1787826299.289458:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111004 00000100:00100000:2.0:1787826299.289468:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84173:x1874668789649664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.289488:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.289507:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499f8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb752 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289617:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289635:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289646:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826299.289658:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xdd:0x0]: returning size 158 00010000:00010000:2.0:1787826299.289729:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289738:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289744:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289750:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.289754:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289761:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289773:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdd:0x0].0x0 (ffff9bbf41389700) 00010000:00010000:2.0:1787826299.289776:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826299.289780:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289786:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f3499f91 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xdd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289825:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499f8a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb752 expref: 58 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289835:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826299.289837:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826299.289841:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f3499f8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb752 expref: 58 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.289867:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3800, rc 0) 00000100:00100000:2.0:1787826299.289919:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84173:x1874668789649664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 453us (656us total) trans 8590016177 rc 301/301 00000100:00100000:2.0:1787826299.289926:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111004 00000100:00100000:3.0:1787826299.289986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.290206:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789649920 00000100:00100000:2.0:1787826299.290211:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789649920 00000100:00100000:2.0:1787826299.290237:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111005 00000100:00100000:2.0:1787826299.290242:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84175:x1874668789649920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.290252:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.290261:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499f9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb759 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290323:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290333:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290340:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826299.290347:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xdf:0x0]: returning size 158 00010000:00010000:2.0:1787826299.290380:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290387:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290393:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290398:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.290401:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290406:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290413:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdf:0x0].0x0 (ffff9bbf41389900) 00010000:00010000:2.0:1787826299.290416:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826299.290419:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290434:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f3499fa6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xdf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290456:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499f9f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb759 expref: 59 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290465:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826299.290467:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826299.290471:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f3499f9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb759 expref: 59 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.290477:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:2.0:1787826299.290505:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84175:x1874668789649920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 262us (1198us total) trans 8590016178 rc 301/301 00000100:00100000:2.0:1787826299.290511:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111005 00000100:00100000:2.0:1787826299.290553:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.291407:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789650048 00000100:00100000:1.0:1787826299.291414:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789650048 00000100:00100000:1.0:1787826299.291492:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111006 00000100:00100000:1.0:1787826299.291502:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84174:x1874668789650048:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826299.291527:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xde:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826299.291606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84174:x1874668789650048:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 106us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.291613:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111006 00000100:00100000:1.0:1787826299.295620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.295703:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.295880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.296218:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789650304 00000100:00100000:0.0:1787826299.296227:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789650304 00000100:00100000:0.0:1787826299.296274:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789650432 00000100:00100000:0.0:1787826299.296277:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789650432 00000100:00100000:0.0:1787826299.296299:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111007 00000100:00100000:0.0:1787826299.296372:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84174:x1874668789650304:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.296394:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.296417:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499fb4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb760 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.296846:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789650560 00000100:00100000:1.0:1787826299.296877:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789650560 00000100:00100000:1.0:1787826299.296908:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111008 00000100:00100000:1.0:1787826299.296916:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84173:x1874668789650432:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826299.296938:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xdd:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826299.297026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84173:x1874668789650432:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 111us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.297032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111008 00000100:00100000:1.0:1787826299.297051:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111009 00000100:00100000:1.0:1787826299.297057:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84175:x1874668789650560:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826299.297072:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xdf:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826299.297111:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84175:x1874668789650560:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 54us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.297117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111009 00010000:00010000:0.0:1787826299.298102:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499fbb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.298120:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499fbb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.298131:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499fbb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826299.298142:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x110:0x0]: returning size 0 00010000:00010000:0.0:1787826299.298192:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f3499fb4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb760 expref: 61 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.298210:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499fbb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb760 expref: 60 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.298218:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbf0f565000) 00010000:00010000:0.0:1787826299.298220:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826299.298224:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:0.0:1787826299.298267:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84174:x1874668789650304:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1900us (2655us total) trans 8590016179 rc 0/0 00000100:00100000:0.0:1787826299.298274:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111007 00000100:00100000:1.0:1787826299.300990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.301057:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789650816 00000100:00100000:0.0:1787826299.301067:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789650816 00000100:00100000:0.0:1787826299.301122:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111010 00000100:00100000:0.0:1787826299.301133:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84174:x1874668789650816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.301191:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.301218:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f3499fbb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb760 expref: 60 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301237:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbf0f565000) 00010000:00010000:0.0:1787826299.301248:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826299.301268:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301280:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301289:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301303:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301310:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301317:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301361:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301373:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301385:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301390:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.301394:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301401:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301409:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826299.301411:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.301415:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301420:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f3499fc9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301440:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301446:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301452:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301457:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.301461:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301470:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301477:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x99259877 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826299.301479:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.301482:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.301487:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f3499fd0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x99259877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.301555:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84174:x1874668789650816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 423us (575us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826299.301563:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111010 00000100:00100000:1.0:1787826299.304369:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.304409:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.304456:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789650944 00000100:00100000:3.0:1787826299.304464:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789650944 00000100:00100000:3.0:1787826299.304515:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789651200 00000100:00100000:3.0:1787826299.304518:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789651200 00000100:00100000:3.0:1787826299.304539:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111011 00000100:00100000:3.0:1787826299.304547:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84174:x1874668789650944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.304565:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.304587:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499fd7 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb767 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.304621:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 3/1,0 mode: --/PR res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.304634:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.304650:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.304754:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f3499fd7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb767 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.304769:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb767 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.304777:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:3.0:1787826299.304780:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826299.304784:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826299.304832:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84174:x1874668789650944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 285us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.304839:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111011 00000100:00100000:3.0:1787826299.304881:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111012 00000100:00100000:3.0:1787826299.304889:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84175:x1874668789651200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.304897:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.304907:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499fe5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.305288:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499fec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.305298:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499fec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.305433:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499fec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.305442:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x111:0x0]: returning size 0 00010000:00010000:3.0:1787826299.305485:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f3499fe5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb76e expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.305498:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499fec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb76e expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.305505:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0a9bf600) 00010000:00010000:3.0:1787826299.305508:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826299.305511:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826299.305552:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84175:x1874668789651200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 664us (1142us total) trans 8590016180 rc 0/0 00000100:00100000:3.0:1787826299.305559:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111012 00000100:00100000:1.0:1787826299.307569:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.309292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.309666:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789651456 00000100:00100000:2.0:1787826299.309676:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789651456 00000100:00100000:2.0:1787826299.309899:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789651712 00000100:00100000:2.0:1787826299.309903:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789651712 00000100:00100000:1.0:1787826299.309952:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111013 00000100:00100000:1.0:1787826299.309964:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84174:x1874668789651456:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.310045:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.310062:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.310073:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826299.310198:0:7736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f5303f0 reply state 0000000065818d8c transno 8590016181 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.310211:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.310219:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:1.0:1787826299.310223:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826299.310226:0:7736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826299.310377:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84174:x1874668789651456:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 415us (2814us total) trans 8590016181 rc 0/0 00000100:00100000:1.0:1787826299.310384:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111013 00000100:00100000:1.0:1787826299.310405:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111014 00000100:00100000:1.0:1787826299.310411:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84173:x1874668789651712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.310436:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.310448:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a001 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb775 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.310762:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a008 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.310772:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a008 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.310779:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a008 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.310788:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x112:0x0]: returning size 0 00010000:00010000:1.0:1787826299.310909:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a001 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb775 expref: 67 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.310924:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a008 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb775 expref: 66 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.310932:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56b00) 00010000:00010000:1.0:1787826299.310936:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826299.310939:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826299.310965:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84173:x1874668789651712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 554us (1681us total) trans 8590016182 rc 0/0 00000100:00100000:1.0:1787826299.310972:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111014 00000100:00100000:1.0:1787826299.313585:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.313658:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789651840 00000100:00100000:2.0:1787826299.313667:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789651840 00000100:00100000:2.0:1787826299.313725:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111015 00000100:00100000:2.0:1787826299.313735:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84174:x1874668789651840:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.313756:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.313785:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb77c expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.313839:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb77c expref: 67 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.313883:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb77c expref: 67 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.313893:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:2.0:1787826299.313896:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.313900:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:2.0:1787826299.313955:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84174:x1874668789651840:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 222us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.313962:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111015 00000100:00100000:3.0:1787826299.314781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.314842:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789652096 00000100:00100000:2.0:1787826299.314962:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789652096 00000100:00100000:2.0:1787826299.315003:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111016 00000100:00100000:2.0:1787826299.315012:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84175:x1874668789652096:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.315057:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.315080:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f3499fec lrc: 0/0,0 mode: --/PR res: [0x200000403:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb76e expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315093:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0a9bf600) 00010000:00010000:2.0:1787826299.315101:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826299.315119:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315131:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315140:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315153:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315160:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315166:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315209:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315216:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315222:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315228:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.315231:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315238:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315348:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.315352:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.315356:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315363:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a01d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315373:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315379:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315386:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315392:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.315395:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315401:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315409:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x168a2045 (ffff9bbe0fe8c800) 00010000:00010000:2.0:1787826299.315412:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.315415:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.315421:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a024 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x168a2045 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.315527:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84175:x1874668789652096:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 515us (748us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826299.315535:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111016 00000100:00100000:1.0:1787826299.317582:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.317993:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.318074:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789652224 00000100:00100000:0.0:1787826299.318082:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789652224 00000100:00100000:0.0:1787826299.318134:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3285 00000100:00100000:0.0:1787826299.318144:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe02258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2401:x1874668789652224:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826299.318187:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.318205:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a02b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb783 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318326:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318339:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318350:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318364:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318371:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318377:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318413:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318421:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318439:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318445:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.318449:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318456:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318468:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826299.318471:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.318476:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318481:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a032 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318492:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318498:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318503:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318508:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.318510:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318516:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318523:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x533e45af (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826299.318525:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.318527:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318532:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a039 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x533e45af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318557:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a02b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb783 expref: 67 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318565:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826299.318567:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826299.318571:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a02b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb783 expref: 67 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.318579:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc -2) 00000100:00100000:0.0:1787826299.318635:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe02258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2401:x1874668789652224:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 492us (1059us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826299.318642:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3285 00000100:00100000:2.0:1787826299.319157:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789652352 00000100:00100000:2.0:1787826299.319163:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789652352 00000100:00100000:2.0:1787826299.319201:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2584 00000100:00100000:2.0:1787826299.319209:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84174:x1874668789652352:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.319362:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84174:x1874668789652352:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 153us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.319369:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2584 00000100:00100000:1.0:1787826299.319920:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.320012:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789652480 00000100:00100000:2.0:1787826299.320017:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789652480 00000100:00100000:2.0:1787826299.320044:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111017 00000100:00100000:2.0:1787826299.320051:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84175:x1874668789652480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.320063:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.320079:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a040 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb7bb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.320105:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.320116:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.320126:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.320200:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a040 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7bb expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.320214:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7bb expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.320223:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:2.0:1787826299.320225:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826299.320228:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826299.320522:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84175:x1874668789652480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 469us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.320529:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111017 00000100:00100000:3.0:1787826299.325126:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.327187:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.327466:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789652992 00000100:00100000:3.0:1787826299.327476:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789652992 00000100:00100000:3.0:1787826299.327566:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2585 00000100:00100000:3.0:1787826299.327577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84174:x1874668789652992:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.327837:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84174:x1874668789652992:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 261us (657us total) trans 8590016183 rc 0/0 00000100:00100000:3.0:1787826299.327845:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2585 00000100:00100000:3.0:1787826299.327961:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.328056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.328221:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789653120 00000100:00100000:0.0:1787826299.328226:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789653120 00000100:00100000:0.0:1787826299.328271:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3286 00000100:00100000:0.0:1787826299.328280:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+68:2399:x1874668789653120:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826299.328319:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.328338:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a04e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb7c2 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328389:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328402:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328414:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328437:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328444:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328455:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328487:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328493:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328499:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328505:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.328509:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328517:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328528:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826299.328531:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.328535:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328542:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a055 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328553:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328559:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328564:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328569:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.328572:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328577:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328584:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x697a6b16 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826299.328586:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.328588:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328593:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a05c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x697a6b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328619:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a04e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7c2 expref: 69 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328629:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826299.328631:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826299.328634:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a04e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7c2 expref: 69 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.328642:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc -2) 00000100:00100000:0.0:1787826299.328678:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+68:2399:x1874668789653120:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 400us (718us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826299.328689:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3286 00000100:00100000:3.0:1787826299.330979:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.331060:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789652736 00000100:00100000:1.0:1787826299.331070:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789652736 00000100:00100000:1.0:1787826299.331113:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789653376 00000100:00100000:1.0:1787826299.331117:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789653376 00000100:00100000:1.0:1787826299.331136:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111018 00000100:00100000:1.0:1787826299.331144:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84173:x1874668789652736:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.331195:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.331218:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a008 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb775 expref: 69 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331233:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56b00) 00010000:00010000:1.0:1787826299.331243:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826299.331261:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331273:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331283:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331295:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331362:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331372:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331412:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331419:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331435:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331441:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.331445:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331451:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331459:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826299.331462:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.331466:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331472:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a063 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331480:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331486:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331491:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331496:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.331498:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331504:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331510:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xd0c5ab80 (ffff9bbe16e56d00) 00010000:00010000:1.0:1787826299.331512:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.331515:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331520:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a06a lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xd0c5ab80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.331588:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84173:x1874668789652736:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 444us (6471us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826299.331596:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111018 00000100:00100000:1.0:1787826299.331614:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111019 00000100:00100000:1.0:1787826299.331621:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84175:x1874668789653376:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.331659:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331672:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331679:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826299.331979:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004855c7b0 reply state 0000000063abba48 transno 8590016184 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331993:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.331999:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:1.0:1787826299.332001:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826299.332004:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826299.332057:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84175:x1874668789653376:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 436us (4000us total) trans 8590016184 rc 0/0 00000100:00100000:1.0:1787826299.332063:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111019 00000100:00100000:2.0:1787826299.333233:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789653632 00000100:00100000:2.0:1787826299.333243:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789653632 00000100:00100000:2.0:1787826299.333452:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111020 00000100:00100000:2.0:1787826299.333461:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84174:x1874668789653632:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.333547:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84174:x1874668789653632:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 87us (2572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.333555:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111020 00000100:00100000:0.0:1787826299.336197:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.336682:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789653760 00000100:00100000:1.0:1787826299.336705:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789653760 00000100:00100000:1.0:1787826299.336756:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111021 00000100:00100000:1.0:1787826299.336766:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84173:x1874668789653760:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.336789:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.336811:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a078 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb7fa expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.336844:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.336889:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.336900:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.336998:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a078 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7fa expref: 71 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.337015:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7fa expref: 70 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.337023:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:1.0:1787826299.337026:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826299.337029:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc 0) 00000100:00100000:1.0:1787826299.337091:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84173:x1874668789653760:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 327us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.337099:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111021 00000100:00100000:0.0:1787826299.337978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.338169:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789654144 00000100:00100000:1.0:1787826299.338177:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789654144 00000100:00100000:1.0:1787826299.338219:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111022 00000100:00100000:1.0:1787826299.338227:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84174:x1874668789654144:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.338251:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.338268:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a086 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb808 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.338421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826299.338527:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.338541:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb77c expref: 71 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.338551:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.338580:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb77c expref: 71 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.338594:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb77c expref: 71 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.338607:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778604288:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826299.338687:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.338704:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789653888 00000100:00100000:1.0:1787826299.338708:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789653888 00000100:00100000:1.0:1787826299.338735:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111023 00000100:00100000:1.0:1787826299.338741:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84175:x1874668789653888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.338749:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.338758:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb801 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.338788:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb801 expref: 73 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.338799:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb801 expref: 73 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.338807:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:1.0:1787826299.338810:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826299.338812:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826299.338838:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84175:x1874668789653888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 97us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.338845:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111023 00000100:00100000:0.0:1787826299.341558:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.341961:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789654400 00000100:00100000:1.0:1787826299.341971:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789654400 00000100:00100000:1.0:1787826299.342022:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111024 00000100:00100000:1.0:1787826299.342031:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84173:x1874668789654400:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.342116:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.342135:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.342146:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826299.342289:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff1df0e5 reply state 00000000483c4a5e transno 8590016185 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.342301:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.342308:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:1.0:1787826299.342311:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826299.342315:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826299.342404:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84173:x1874668789654400:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 373us (854us total) trans 8590016185 rc 0/0 00000100:00100000:1.0:1787826299.342411:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111024 00000100:00100000:1.0:1787826299.343826:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778604288:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.343992:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.346944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.346987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.347059:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789654528 00000100:00100000:2.0:1787826299.347068:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789654528 00000100:00100000:2.0:1787826299.347241:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2586 00000100:00100000:2.0:1787826299.347261:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf123d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84175:x1874668789654528:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.347377:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf123d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84175:x1874668789654528:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 120us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.347384:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2586 00000100:00100000:1.0:1787826299.347478:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.347555:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789654784 00000100:00100000:0.0:1787826299.347559:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789654784 00000100:00100000:0.0:1787826299.347586:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111025 00000100:00100000:0.0:1787826299.347592:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84173:x1874668789654784:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.347602:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.347619:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb80f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.347660:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb80f expref: 76 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.347674:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb80f expref: 76 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.347683:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:0.0:1787826299.347686:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.347689:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:0.0:1787826299.347710:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84173:x1874668789654784:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 118us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.347716:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111025 00000100:00100000:2.0:1787826299.349915:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789654656 00000100:00100000:2.0:1787826299.349928:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789654656 00010000:00010000:2.0:1787826299.349972:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb77c expref: 76 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.350011:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2926 00000100:00100000:2.0:1787826299.350019:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40516c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:2402:x1874668789654656:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826299.350033:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.350039:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb77c expref: 76 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.350052:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb77c expref: 76 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.350078:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a016 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb77c expref: 76 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.350093:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:2.0:1787826299.350098:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.350106:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.350113:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.350140:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826299.350183:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40516c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:2402:x1874668789654656:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 165us (3195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.350191:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2926 00010000:00010000:0.0:1787826299.350945:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.350955:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826299.350975:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x110:0x0]: returning size 0 00000004:00080000:0.0:1787826299.351129:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb7:0x0], index 0: 0 00010000:00010000:0.0:1787826299.351219:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.351228:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.351235:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.351242:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.351320:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.351330:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.351343:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826299.351346:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.351350:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.351356:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a08d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.351416:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a086 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb808 expref: 75 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.351441:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826299.351444:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826299.351447:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a086 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb808 expref: 75 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.351457:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:0.0:1787826299.351497:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84174:x1874668789654144:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 13271us (13521us total) trans 8590016186 rc 301/301 00000100:00100000:0.0:1787826299.351505:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111022 00000100:00100000:1.0:1787826299.352300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.352904:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789655040 00000100:00100000:2.0:1787826299.352912:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789655040 00000100:00100000:2.0:1787826299.352957:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2587 00000100:00100000:2.0:1787826299.352966:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84175:x1874668789655040:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.353156:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84175:x1874668789655040:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 190us (858us total) trans 8590016187 rc 0/0 00000100:00100000:2.0:1787826299.353163:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2587 00000100:00100000:2.0:1787826299.356577:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.356659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.356829:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.356885:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789655680 00000100:00100000:0.0:1787826299.356895:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789655680 00000100:00100000:0.0:1787826299.356954:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111026 00000100:00100000:0.0:1787826299.356964:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84175:x1874668789655680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.357063:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84175:x1874668789655680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 100us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.357070:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111026 00000100:00100000:1.0:1787826299.357138:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789655168 00000100:00100000:1.0:1787826299.357142:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789655168 00000100:00100000:1.0:1787826299.357174:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789655424 00000100:00100000:1.0:1787826299.357177:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789655424 00000100:00100000:1.0:1787826299.357190:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2588 00000100:00100000:1.0:1787826299.357196:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84173:x1874668789655168:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.357261:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84173:x1874668789655168:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 65us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.357268:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2588 00000100:00100000:1.0:1787826299.357282:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2589 00000100:00100000:1.0:1787826299.357288:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84174:x1874668789655424:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.357498:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84174:x1874668789655424:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 209us (838us total) trans 8590016188 rc 0/0 00000100:00100000:1.0:1787826299.357505:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2589 00000100:00100000:1.0:1787826299.361385:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.361442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.361468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.361492:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789655936 00000100:00100000:1.0:1787826299.361499:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789655936 00000100:00100000:1.0:1787826299.361537:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789656320 00000100:00100000:1.0:1787826299.361540:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789656320 00000100:00100000:1.0:1787826299.361559:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111027 00000100:00100000:1.0:1787826299.361567:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84175:x1874668789655936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.361585:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.361605:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a0b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb816 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.361902:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789656192 00000100:00100000:0.0:1787826299.361906:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789656192 00000100:00100000:0.0:1787826299.361937:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2590 00000100:00100000:0.0:1787826299.361944:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84173:x1874668789656192:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.362194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111028 00000100:00100000:3.0:1787826299.362204:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84174:x1874668789656320:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.362214:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.362225:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a0b7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb81d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.362267:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a0be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.362282:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a0be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.362294:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a0be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.362327:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x110:0x0]: returning size 0 00000004:00200000:3.0:1787826299.362331:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826299.362344:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a0be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.362365:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a0b7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb81d expref: 82 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.362382:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a0be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb81d expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.362389:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:3.0:1787826299.362393:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826299.362396:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00010000:00010000:1.0:1787826299.362473:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.362485:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb801 expref: 81 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.362493:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.362522:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb801 expref: 81 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.362536:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb801 expref: 81 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.362549:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778604416:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.363589:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84173:x1874668789656192:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1637us (2138us total) trans 8590016189 rc 0/0 00000100:00100000:3.0:1787826299.363589:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84174:x1874668789656320:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1386us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.363599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111028 00000100:00100000:0.0:1787826299.363600:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2590 00000100:00100000:1.0:1787826299.363666:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.368144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.368250:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789656448 00000100:00100000:3.0:1787826299.368259:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789656448 00000100:00100000:3.0:1787826299.368324:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6137 00000100:00100000:3.0:1787826299.368334:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789656448:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.368352:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.368382:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb824 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826299.368406:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826299.368434:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:3.0:1787826299.368439:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.368449:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb824 expref: 13 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.368466:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb824 expref: 13 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.368479:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:3.0:1787826299.368541:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789656448:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 209us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.368549:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6137 00000100:00100000:2.0:1787826299.368626:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778604416:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826299.368645:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.369695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.369743:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789656576 00000100:00100000:1.0:1787826299.369750:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789656576 00010000:00010000:1.0:1787826299.369788:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb801 expref: 80 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.369831:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2927 00000100:00100000:1.0:1787826299.369841:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789656576:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826299.369886:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.369894:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb801 expref: 80 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.369907:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb801 expref: 80 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.369927:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a094 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb801 expref: 80 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.369942:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:1.0:1787826299.369947:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.369957:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.369965:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.369983:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826299.370024:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2401:x1874668789656576:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 184us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.370031:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2927 00010000:00010000:2.0:1787826299.370219:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370226:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826299.370242:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x111:0x0]: returning size 0 00000004:00080000:2.0:1787826299.370393:0:25759:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb8:0x0], index 1: 0 00010000:00010000:2.0:1787826299.370508:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370516:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370523:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370529:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.370533:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370540:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370551:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:2.0:1787826299.370553:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.370557:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370564:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a0c5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370606:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a0b0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb816 expref: 79 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370615:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.370618:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826299.370621:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a0b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb816 expref: 79 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.370629:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:2.0:1787826299.370671:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84175:x1874668789655936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9105us (9295us total) trans 8590016190 rc 301/301 00000100:00100000:2.0:1787826299.370679:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111027 00000100:00100000:0.0:1787826299.372562:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.372605:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789656832 00000100:00100000:1.0:1787826299.372613:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789656832 00000100:00100000:1.0:1787826299.372667:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111029 00000100:00100000:1.0:1787826299.372677:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84174:x1874668789656832:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.372790:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84174:x1874668789656832:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.372798:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111029 00000100:00100000:0.0:1787826299.373473:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.373520:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789657088 00000100:00100000:2.0:1787826299.373526:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789657088 00000100:00100000:2.0:1787826299.373565:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2591 00000100:00100000:2.0:1787826299.373574:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84175:x1874668789657088:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.374040:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84175:x1874668789657088:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 466us (567us total) trans 8590016191 rc 0/0 00000100:00100000:2.0:1787826299.374048:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2591 00000100:00100000:3.0:1787826299.374453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.374933:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789657344 00000100:00100000:0.0:1787826299.374939:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789657344 00000100:00100000:0.0:1787826299.374977:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111030 00000100:00100000:0.0:1787826299.374985:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84173:x1874668789657344:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.375058:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84173:x1874668789657344:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 73us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.375064:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111030 00000100:00100000:0.0:1787826299.377995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.378207:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789657472 00000100:00100000:1.0:1787826299.378216:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789657472 00000100:00100000:1.0:1787826299.378277:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111031 00000100:00100000:1.0:1787826299.378286:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84175:x1874668789657472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.378305:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.378340:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a0da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb82b expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.378406:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a0e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.378432:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.378445:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.378485:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x111:0x0]: returning size 0 00000004:00200000:1.0:1787826299.378489:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826299.378503:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.378524:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a0da lrc: 0/0,0 mode: --/CR res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb82b expref: 81 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.378540:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb82b expref: 80 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.378547:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:1.0:1787826299.378550:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826299.378553:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:1.0:1787826299.378607:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84175:x1874668789657472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 323us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.378614:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111031 00000100:00100000:2.0:1787826299.379674:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.379737:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789657600 00000100:00100000:3.0:1787826299.379744:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789657600 00000100:00100000:3.0:1787826299.379785:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6138 00000100:00100000:3.0:1787826299.379795:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84174:x1874668789657600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.379807:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.379821:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb832 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.379847:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb824 expref: 14 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.379963:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.379968:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.379974:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.380007:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb824 expref: 14 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.380019:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb824 expref: 14 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.380033:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778604544:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.380103:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.382198:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.382385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.382469:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789658112 00000100:00100000:2.0:1787826299.382476:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789658112 00010000:00010000:2.0:1787826299.382511:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb824 expref: 15 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.382555:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2928 00000100:00100000:2.0:1787826299.382565:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789658112:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826299.382578:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.382599:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb824 expref: 15 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.382613:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb824 expref: 15 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.382637:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.382642:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.382650:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 15 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.382661:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 15 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.382699:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 15 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.382713:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb5ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778604672:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826299.382778:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56240 going to sleep for 11 seconds 00010000:00010000:3.0:1787826299.383146:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a0cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb824 expref: 15 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.383162:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778604544:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.383186:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.383196:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826299.383236:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84174:x1874668789657600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 3442us (3565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.383243:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6138 00000100:00100000:1.0:1787826299.383350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.383373:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789657984 00000100:00100000:1.0:1787826299.383377:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789657984 00000100:00100000:1.0:1787826299.383410:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111032 00000100:00100000:1.0:1787826299.383417:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84173:x1874668789657984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.383444:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.383461:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a0ef lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.383554:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.383569:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb80f expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.383578:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.383599:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb80f expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.383612:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb80f expref: 81 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.383623:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778604800:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826299.383658:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.383803:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789657728 00000100:00100000:3.0:1787826299.383806:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789657728 00000100:00100000:0.0:1787826299.383895:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6139 00000100:00100000:0.0:1787826299.383905:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789657728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.383914:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.383928:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb839 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826299.383947:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826299.383960:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:0.0:1787826299.383963:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.383971:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb839 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.383985:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb839 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.383995:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc 0) 00000100:00100000:0.0:1787826299.384031:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789657728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 128us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.384038:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6139 00000100:00100000:3.0:1787826299.389558:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778604800:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.389650:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.389717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.389753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.389832:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.389887:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789658624 00000100:00100000:1.0:1787826299.389893:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789658624 00000100:00100000:1.0:1787826299.389939:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111033 00000100:00100000:1.0:1787826299.389949:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84175:x1874668789658624:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.390041:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84175:x1874668789658624:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.390049:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111033 00000100:00100000:0.0:1787826299.390229:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789658368 00000100:00100000:0.0:1787826299.390233:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789658368 00002000:00100000:0.0:1787826299.390273:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xb7:0x0] (0->157) req@ffff9bbf3fcc12c0 x1874668789658368/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/0 e 0 to 0 dl 1787826310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826299.390283:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fcc12c0 with x1874668789658368 ext(0->157) 00002000:00010000:0.0:1787826299.390288:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fcc12c0 00000100:00100000:0.0:1787826299.390314:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1552 00000100:00100000:0.0:1787826299.390321:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789658368:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.390839:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb5ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778604672:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826299.390888:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826299.390920:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789658112:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 8357us (8536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.390928:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2928 00000100:00100000:2.0:1787826299.390946:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789658240 00000100:00100000:2.0:1787826299.390950:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789658240 00010000:00010000:2.0:1787826299.390968:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb80f expref: 82 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.390988:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2929 00000100:00100000:2.0:1787826299.390994:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2401:x1874668789658240:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826299.391003:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.391009:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb80f expref: 82 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.391021:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb80f expref: 82 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.391042:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a0a2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb80f expref: 82 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.391057:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:2.0:1787826299.391061:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.391070:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.391081:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.391101:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826299.391119:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2401:x1874668789658240:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 126us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.391126:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2929 00010000:00010000:3.0:1787826299.391353:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391361:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.391377:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x112:0x0]: returning size 0 00000004:00080000:3.0:1787826299.391513:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb8:0x0], index 0: 0 00010000:00010000:3.0:1787826299.391589:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391598:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391605:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391611:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.391615:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391686:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391696:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:3.0:1787826299.391699:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.391702:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391709:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a0f6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391750:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a0ef lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb840 expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391759:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826299.391761:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826299.391765:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a0ef lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb840 expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.391774:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:3.0:1787826299.391802:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84173:x1874668789657984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 8385us (8453us total) trans 8590016192 rc 301/301 00000100:00100000:3.0:1787826299.391812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111032 00000100:00100000:1.0:1787826299.392210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.392382:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789658752 00000100:00100000:3.0:1787826299.392387:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789658752 00000100:00100000:3.0:1787826299.392431:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6140 00000100:00100000:3.0:1787826299.392440:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84175:x1874668789658752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.392452:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.392467:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb847 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.392497:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb839 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.392506:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.392510:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.392516:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 11 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.392545:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb839 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.392558:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb839 expref: 11 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.392571:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778604928:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.392634:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.392637:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789658368:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2315us (2882us total) trans 4294968140 rc 0/0 00000100:00100000:2.0:1787826299.392644:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1552 00002000:00100000:2.0:1787826299.392653:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xb7:0x0] (0->157) req@ffff9bbf3fcc12c0 x1874668789658368/t4294968140(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/448 e 0 to 0 dl 1787826310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826299.392663:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fcc12c0 with x1874668789658368 ext(0->157) 00002000:00010000:2.0:1787826299.392668:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fcc12c0 00000100:00100000:3.0:1787826299.397755:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.399283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.400097:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789658880 00000100:00100000:0.0:1787826299.400109:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789658880 00010000:00010000:0.0:1787826299.400150:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb839 expref: 12 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.400201:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2930 00000100:00100000:0.0:1787826299.400211:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789658880:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.400224:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.400937:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb839 expref: 12 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.400955:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb839 expref: 12 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.400988:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.400993:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.401001:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 12 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.401012:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 12 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.401051:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 12 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.401066:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08848000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778605056:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826299.401156:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15baba80 going to sleep for 11 seconds 00010000:00010000:0.0:1787826299.401201:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349a0fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb839 expref: 12 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.401215:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778604928:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.401239:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 11 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.401584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.401986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789659008 00000100:00100000:1.0:1787826299.401993:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789659008 00000100:00100000:1.0:1787826299.402043:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111034 00000100:00100000:1.0:1787826299.402052:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84174:x1874668789659008:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.402958:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606600, rc 0) 00000100:00100000:0.0:1787826299.403015:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84175:x1874668789658752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 10575us (10805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.403027:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6140 00000100:00100000:1.0:1787826299.403543:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789659264 00000100:00100000:1.0:1787826299.403550:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789659264 00000100:00100000:1.0:1787826299.403590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2592 00000100:00100000:1.0:1787826299.403598:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf123d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84173:x1874668789659264:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.404571:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08848000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778605056:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826299.404595:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826299.404638:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789658880:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4427us (6891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.404646:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2930 00000100:00100000:2.0:1787826299.408683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.408725:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789659392 00000100:00100000:2.0:1787826299.408735:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789659392 00002000:00100000:2.0:1787826299.408801:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xb8:0x0] (0->157) req@ffff9bbf0cb5ad00 x1874668789659392/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/0 e 0 to 0 dl 1787826310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826299.408811:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf0cb5ad00 with x1874668789659392 ext(0->157) 00002000:00010000:2.0:1787826299.408823:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf0cb5ad00 00000100:00100000:2.0:1787826299.408875:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1553 00000100:00100000:2.0:1787826299.408885:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789659392:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000001:00080000:1.0:1787826299.409059:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016192 is committed 00000020:00080000:1.0:1787826299.409101:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0fd09c00 refcount 2 committed 0 result 0 batchid 4294970867 00000020:00080000:1.0:1787826299.409105:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dd7a200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0fd09f00 00000020:00080000:1.0:1787826299.409108:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dd7a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0de29e00 00000020:00080000:1.0:1787826299.409122:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0d0f29c0 refcount 2 committed 0 result 0 batchid 4294970866 00000020:00080000:1.0:1787826299.409125:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dd7ad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d0f2780 00000020:00080000:1.0:1787826299.409128:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf1064cf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a2fd600 00000020:00080000:1.0:1787826299.409141:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17d56cc0 refcount 2 committed 0 result 0 batchid 4294970865 00000020:00080000:1.0:1787826299.409143:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5ec00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d56b40 00000020:00080000:1.0:1787826299.409146:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c3e0400 00000004:00080000:1.0:1787826299.409154:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 28 committed 00000004:00080000:1.0:1787826299.409163:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 25 committed 00000020:00080000:1.0:1787826299.409174:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970864 batchid updated 00010000:00010000:2.0:1787826299.409266:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409278:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409287:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409293:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00000100:00100000:1.0:1787826299.409297:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778605184:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787826299.409298:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409312:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409326:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826299.409329:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.409334:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409340:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f3499e8e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826299.409362:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409368:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409374:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409379:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.409382:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409384:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778605696:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787826299.409389:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409396:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10e:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:2.0:1787826299.409399:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826299.409402:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826299.409402:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409408:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f3499e9c lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409420:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409421:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826299.409436:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778605568:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787826299.409437:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409443:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409448:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.409451:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826299.409457:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409465:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10f:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826299.409467:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.409471:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409476:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f3499eb1 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409478:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778605312:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787826299.409490:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409496:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826299.409502:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409507:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.409510:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409513:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778605824:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787826299.409516:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409524:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:2.0:1787826299.409526:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826299.409528:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826299.409529:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409534:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f3499ffa lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409543:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787826299.409544:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409548:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778605440:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787826299.409555:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409561:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826299.409566:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.409569:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409575:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409581:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:2.0:1787826299.409584:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826299.409586:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409592:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a071 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409594:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778605184 00000100:00100000:1.0:1787826299.409597:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778605184 00010000:00010000:2.0:1787826299.409602:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409608:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409613:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409617:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.409621:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409622:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778605696 00000100:00100000:1.0:1787826299.409624:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778605696 00010000:00010000:2.0:1787826299.409627:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409632:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778605568 00000100:00100000:1.0:1787826299.409634:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778605568 00010000:00010000:2.0:1787826299.409635:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:2.0:1787826299.409637:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826299.409640:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409641:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778605312 00000100:00100000:1.0:1787826299.409643:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778605312 00010000:00010000:2.0:1787826299.409647:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a09b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.409650:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778605824 00000100:00100000:1.0:1787826299.409652:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778605824 00000100:00100000:1.0:1787826299.409660:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778605440 00000100:00100000:1.0:1787826299.409662:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778605440 00000020:00080000:2.0:1787826299.409662:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970867 committed batchid 4294970864 00000100:00100000:1.0:1787826299.409672:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6141 00000100:00100000:1.0:1787826299.409677:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3644:x1874668778605184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826299.409692:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:170 count 1 00000020:00080000:2.0:1787826299.409700:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970864 00002000:00010000:1.0:1787826299.409716:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xaa:0x0] initial LVB size: 158, mtime: 0x6a90102d, atime: 0x0, ctime: 0x6a90102d, blocks: 0x8 00010000:00010000:1.0:1787826299.409722:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.409737:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaa:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:1.0:1787826299.409741:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.409748:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.409759:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.409767:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.409773:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.409797:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826299.409844:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826299.409868:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409876:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826299.409879:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409886:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409899:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409913:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349a112 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.409928:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826299.409930:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826299.409932:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826299.409991:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3644:x1874668778605184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 312us (642us total) trans 4294968127 rc 0/0 00000100:00100000:1.0:1787826299.409998:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6141 00000100:00100000:1.0:1787826299.410016:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6142 00000100:00100000:1.0:1787826299.410027:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3644:x1874668778605696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826299.410040:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:174 count 1 00002000:00010000:1.0:1787826299.410053:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xae:0x0] initial LVB size: 158, mtime: 0x6a90102e, atime: 0x0, ctime: 0x6a90102e, blocks: 0x8 00010000:00010000:1.0:1787826299.410058:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410067:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xae:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:1.0:1787826299.410070:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.410074:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410082:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410089:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410095:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410109:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826299.410169:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3644:x1874668778605696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 147us (765us total) trans 4294968128 rc 0/0 00000100:00100000:1.0:1787826299.410176:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6142 00000100:00100000:1.0:1787826299.410187:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6143 00000100:00100000:1.0:1787826299.410193:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3644:x1874668778605568:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1787826299.410198:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0dd2a940/2, rc 0, transno 4294968127 00002000:00080000:1.0:1787826299.410202:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:173 count 1 00000100:00100000:2.0:1787826299.410203:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778605184:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1787826299.410212:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0dd2bc00/2, rc 0, transno 4294968128 00002000:00010000:1.0:1787826299.410215:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xad:0x0] initial LVB size: 158, mtime: 0x6a90102e, atime: 0x0, ctime: 0x6a90102e, blocks: 0x8 00000100:00100000:2.0:1787826299.410215:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778605696:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787826299.410220:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410228:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xad:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:1.0:1787826299.410231:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.410235:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410242:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410249:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410255:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410267:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1787826299.410279:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789659392:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1394us (1603us total) trans 4294968126 rc 0/0 00000100:00100000:2.0:1787826299.410286:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1553 00002000:00100000:2.0:1787826299.410295:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xb8:0x0] (0->157) req@ffff9bbf0cb5ad00 x1874668789659392/t4294968126(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/448 e 0 to 0 dl 1787826310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826299.410316:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf0cb5ad00 with x1874668789659392 ext(0->157) 00002000:00010000:2.0:1787826299.410321:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf0cb5ad00 00000100:00100000:1.0:1787826299.410324:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3644:x1874668778605568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 132us (868us total) trans 4294968129 rc 0/0 00000100:00100000:1.0:1787826299.410330:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6143 00000100:00100000:1.0:1787826299.410341:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6144 00000004:00080000:2.0:1787826299.410346:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0dd292c0/2, rc 0, transno 4294968129 00000100:00100000:1.0:1787826299.410347:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3645:x1874668778605312:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787826299.410350:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778605568:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826299.410357:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:171 count 1 00002000:00010000:1.0:1787826299.410370:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xab:0x0] initial LVB size: 158, mtime: 0x6a90102d, atime: 0x0, ctime: 0x6a90102d, blocks: 0x8 00010000:00010000:1.0:1787826299.410375:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410383:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xab:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:1.0:1787826299.410386:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.410389:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410399:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410407:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410414:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410443:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1787826299.410509:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3645:x1874668778605312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 162us (1008us total) trans 4294968130 rc 0/0 00000100:00100000:1.0:1787826299.410515:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6144 00000100:00100000:1.0:1787826299.410525:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6145 00000100:00100000:1.0:1787826299.410531:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3645:x1874668778605824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826299.410542:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:175 count 1 00002000:00010000:1.0:1787826299.410555:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xaf:0x0] initial LVB size: 158, mtime: 0x6a90102f, atime: 0x0, ctime: 0x6a90102f, blocks: 0x8 00010000:00010000:1.0:1787826299.410560:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410572:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaf:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:1.0:1787826299.410575:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.410578:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410586:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410594:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410601:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410606:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826299.410613:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787826299.410615:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410627:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826299.410631:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410638:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410650:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410657:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e99be72/0x68019081f349a119 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.410664:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3645:x1874668778605824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 133us (1134us total) trans 4294968131 rc 0/0 00010000:00010000:2.0:1787826299.410669:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787826299.410670:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6145 00010000:00010000:2.0:1787826299.410673:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410679:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc0c00440) 00000100:00100000:1.0:1787826299.410681:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6146 00010000:00010000:2.0:1787826299.410682:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.410687:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3645:x1874668778605440:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787826299.410690:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787826299.410697:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:172 count 1 00010000:00010000:2.0:1787826299.410699:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410706:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005477887e/0x68019081f349a120 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826299.410709:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xac:0x0] initial LVB size: 158, mtime: 0x6a90102e, atime: 0x0, ctime: 0x6a90102e, blocks: 0x8 00010000:00010000:1.0:1787826299.410714:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410718:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826299.410721:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410727:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xac:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:2.0:1787826299.410727:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826299.410730:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.410730:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410734:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410738:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410743:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410747:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410750:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410755:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c206195b/0x68019081f349a127 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410758:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.410770:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787826299.410777:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826299.410780:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410787:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826299.410790:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410798:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410807:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.410820:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3645:x1874668778605440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 133us (1254us total) trans 4294968132 rc 0/0 00010000:00010000:2.0:1787826299.410825:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349a12e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.410826:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6146 00010000:00010000:2.0:1787826299.410837:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826299.410839:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410845:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826299.410848:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410874:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410883:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410890:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000077a45e0/0x68019081f349a135 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.410902:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826299.410904:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826299.410906:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826299.410911:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826299.414760:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826299.414769:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826299.414810:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0dd2b840/2, rc 0, transno 4294968132 00000100:00100000:1.0:1787826299.414821:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778605440:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787826299.414833:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0dd28f00/2, rc 0, transno 4294968130 00000100:00100000:1.0:1787826299.414837:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778605312:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787826299.414905:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0dd2ad00/2, rc 0, transno 4294968131 00000100:00100000:1.0:1787826299.414911:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778605824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787826299.415030:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84174:x1874668789659008:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 12977us (15751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.415039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111034 00000100:00100000:2.0:1787826299.415433:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826299.415515:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778606080:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826299.415560:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826299.415584:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826299.415589:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778606208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826299.415604:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826299.415641:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778606336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826299.415664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826299.415684:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0884bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778605952:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826299.415700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826299.415723:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778606080 00000100:00100000:2.0:1787826299.415728:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778606080 00000100:00100000:2.0:1787826299.415753:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778606208 00000100:00100000:2.0:1787826299.415755:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778606208 00000100:00100000:2.0:1787826299.415763:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778606336 00000100:00100000:2.0:1787826299.415765:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778606336 00000100:00100000:2.0:1787826299.415772:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778605952 00000100:00100000:2.0:1787826299.415773:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778605952 00000100:00100000:2.0:1787826299.415783:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6147 00000100:00100000:2.0:1787826299.415790:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3643:x1874668778606080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826299.415809:0:25038:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:170 count 1 00002000:00010000:2.0:1787826299.415846:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xaa:0x0] initial LVB size: 158, mtime: 0x6a90102d, atime: 0x0, ctime: 0x6a90102d, blocks: 0x8 00010000:00010000:2.0:1787826299.415938:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.415955:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaa:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:2.0:1787826299.415959:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.415966:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.415980:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.415991:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.415998:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.416011:0:25038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826299.416126:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3643:x1874668778606080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 335us (565us total) trans 4294968141 rc 0/0 00000100:00100000:2.0:1787826299.416133:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6147 00000100:00100000:2.0:1787826299.416147:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6148 00000100:00100000:2.0:1787826299.416152:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3643:x1874668778606208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826299.416162:0:25038:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:171 count 1 00002000:00010000:2.0:1787826299.416175:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xab:0x0] initial LVB size: 158, mtime: 0x6a90102e, atime: 0x0, ctime: 0x6a90102e, blocks: 0x8 00010000:00010000:2.0:1787826299.416180:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.416188:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xab:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:2.0:1787826299.416191:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.416195:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.416210:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.416218:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.416225:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.416236:0:25038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1787826299.416284:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3643:x1874668778606208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 132us (678us total) trans 4294968142 rc 0/0 00000100:00100000:2.0:1787826299.416289:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6148 00000100:00100000:2.0:1787826299.416300:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6149 00000100:00100000:3.0:1787826299.416407:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6150 00000100:00100000:3.0:1787826299.416416:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3645:x1874668778605952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826299.416436:0:8433:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:169 count 1 00002000:00010000:3.0:1787826299.416451:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa9:0x0] initial LVB size: 158, mtime: 0x6a90102d, atime: 0x0, ctime: 0x6a90102d, blocks: 0x8 00010000:00010000:3.0:1787826299.416456:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416464:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa9:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:3.0:1787826299.416467:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.416471:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416480:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416488:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416494:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416508:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1787826299.416569:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3645:x1874668778605952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 155us (867us total) trans 4294968143 rc 0/0 00000100:00100000:3.0:1787826299.416575:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6150 00010000:00010000:3.0:1787826299.416589:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826299.416595:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416603:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.416608:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416617:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416632:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416640:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043e7dfbc/0x68019081f349a13c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416657:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826299.416660:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416671:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.416674:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416681:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416689:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416696:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349a143 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416705:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826299.416708:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416713:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.416716:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416723:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416731:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416739:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a14a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.416748:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.416750:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.416751:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826299.416773:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe08848000/2, rc 0, transno 4294968142 00000100:00100000:3.0:1787826299.416778:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778606208:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787826299.416786:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe08848f00/2, rc 0, transno 4294968141 00000100:00100000:3.0:1787826299.416789:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778606080:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787826299.416982:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.416987:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826299.417020:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3645:x1874668778606336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826299.417033:0:25038:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:172 count 1 00002000:00010000:2.0:1787826299.417047:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xac:0x0] initial LVB size: 158, mtime: 0x6a90102e, atime: 0x0, ctime: 0x6a90102e, blocks: 0x8 00010000:00010000:2.0:1787826299.417052:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.417060:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xac:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:2.0:1787826299.417063:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.417067:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.417082:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.417090:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.417098:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.417144:0:25038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826299.417215:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3645:x1874668778606336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 910us (1550us total) trans 4294968144 rc 0/0 00000100:00100000:2.0:1787826299.417221:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6149 00000004:00080000:2.0:1787826299.417259:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0a31e940/2, rc 0, transno 4294968144 00000100:00100000:2.0:1787826299.417263:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778606336:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787826299.417271:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0884bc00/2, rc 0, transno 4294968143 00000100:00100000:2.0:1787826299.417273:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0884bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778605952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826299.417398:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778606592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826299.417407:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778606464:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826299.417440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826299.417466:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826299.417472:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778606720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826299.417492:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826299.417562:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778606592 00000100:00100000:2.0:1787826299.417566:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778606592 00000100:00100000:2.0:1787826299.417589:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778606720 00000100:00100000:2.0:1787826299.417591:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778606720 00000100:00100000:2.0:1787826299.417605:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6151 00000100:00100000:2.0:1787826299.417610:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3643:x1874668778606592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826299.417621:0:25038:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:174 count 1 00002000:00010000:2.0:1787826299.417634:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xae:0x0] initial LVB size: 158, mtime: 0x6a90102f, atime: 0x0, ctime: 0x6a90102f, blocks: 0x8 00010000:00010000:2.0:1787826299.417640:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.417649:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xae:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:2.0:1787826299.417652:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.417656:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.417665:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.417674:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.417681:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417785:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826299.417790:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417798:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.417801:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417810:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417831:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417844:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fbf6c6f/0x68019081f349a151 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417878:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826299.417882:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417888:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.417891:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417899:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417909:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417916:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.417918:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.417920:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826299.417930:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6152 00000100:00100000:3.0:1787826299.417937:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3643:x1874668778606720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826299.417948:0:8433:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:175 count 1 00002000:00010000:3.0:1787826299.417960:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xaf:0x0] initial LVB size: 158, mtime: 0x6a90102f, atime: 0x0, ctime: 0x6a90102f, blocks: 0x8 00010000:00010000:3.0:1787826299.417965:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417973:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaf:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:3.0:1787826299.417976:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.417980:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417989:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.417997:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.418004:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.418015:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826299.418083:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3643:x1874668778606720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 147us (590us total) trans 4294968145 rc 0/0 00000100:00100000:3.0:1787826299.418089:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6152 00010000:00010000:3.0:1787826299.418103:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826299.418107:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.418115:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.418118:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.418132:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.418142:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.418148:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349a15f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.418160:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.418161:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.418163:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826299.418388:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826299.418401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.418451:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778606464 00000100:00100000:0.0:1787826299.418456:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778606464 00000100:00100000:0.0:1787826299.418475:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6153 00000100:00100000:0.0:1787826299.418481:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3646:x1874668778606464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787826299.418492:0:8605:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:173 count 1 00002000:00010000:0.0:1787826299.418508:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xad:0x0] initial LVB size: 158, mtime: 0x6a90102e, atime: 0x0, ctime: 0x6a90102e, blocks: 0x8 00010000:00010000:0.0:1787826299.418513:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418522:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xad:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:0.0:1787826299.418525:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.418529:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418538:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418546:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418554:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418574:0:8605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826299.418645:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3646:x1874668778606464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 164us (243us total) trans 4294968146 rc 0/0 00000100:00100000:0.0:1787826299.418651:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6153 00000004:00080000:0.0:1787826299.418680:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbf05cbd2c0/2, rc 0, transno 4294968146 00000100:00100000:0.0:1787826299.418686:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778606464:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787826299.418697:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826299.418702:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418709:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826299.418712:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418720:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418731:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418738:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fa79f2f/0x68019081f349a166 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.418750:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826299.418752:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826299.418754:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826299.419292:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf123d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84173:x1874668789659264:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 15692us (17707us total) trans 8590016193 rc 0/0 00000100:00100000:0.0:1787826299.419313:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2592 00000004:00080000:0.0:1787826299.420521:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbf3fc792c0/2, rc 0, transno 4294968145 00000100:00100000:0.0:1787826299.420533:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778606720:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826299.421947:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826299.421951:0:25038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787826299.421962:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53974da/0x68019081f349a158 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.422189:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3643:x1874668778606592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4566us (4736us total) trans 4294968147 rc 0/0 00000100:00100000:2.0:1787826299.422200:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6151 00000004:00080000:0.0:1787826299.422205:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbf3fc78780/2, rc 0, transno 4294968147 00000100:00100000:0.0:1787826299.422213:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778606592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826299.423015:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.423083:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.423121:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789659648 00000100:00100000:3.0:1787826299.423128:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789659648 00000100:00100000:3.0:1787826299.423180:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6154 00000100:00100000:3.0:1787826299.423189:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789659648:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.423283:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789659520 00000100:00100000:1.0:1787826299.423287:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789659520 00000100:00100000:1.0:1787826299.423384:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111035 00000100:00100000:1.0:1787826299.423394:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84175:x1874668789659520:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.423504:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84175:x1874668789659520:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 112us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.423511:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111035 00000100:00100000:3.0:1787826299.424707:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.424789:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789659776 00000100:00100000:3.0:1787826299.424795:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789659776 00000100:00100000:3.0:1787826299.424838:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111036 00000100:00100000:3.0:1787826299.424846:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84173:x1874668789659776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.424886:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.424905:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a16d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb84e expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.424975:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a174 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.424989:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a174 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.425000:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a174 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.425036:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x112:0x0]: returning size 0 00000004:00200000:3.0:1787826299.425040:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826299.425057:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a174 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.425078:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a16d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb84e expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.425092:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a174 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb84e expref: 32 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.425102:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:3.0:1787826299.425105:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826299.425108:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826299.425148:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84173:x1874668789659776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 302us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.425154:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111036 00000001:00080000:3.0:1787826299.425946:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968147 is committed 00000001:00080000:3.0:1787826299.425964:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968140 is committed 00000100:00100000:3.0:1787826299.426045:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789659648:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2855us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.426055:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6154 00000100:00100000:3.0:1787826299.433419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.433503:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789659904 00000100:00100000:0.0:1787826299.433513:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789659904 00000100:00100000:0.0:1787826299.433568:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6155 00000100:00100000:0.0:1787826299.433578:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789659904:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.435273:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.435335:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789660160 00000100:00100000:0.0:1787826299.435342:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789660160 00000100:00100000:0.0:1787826299.435387:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111037 00000100:00100000:0.0:1787826299.435394:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84174:x1874668789660160:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.435460:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.435488:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a0be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x110:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb81d expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.435506:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826299.435511:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826299.435515:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.435541:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789660288 00010000:00010000:0.0:1787826299.435542:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.435545:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789660288 00010000:00010000:0.0:1787826299.435559:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.435568:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.435569:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6156 00000100:00100000:1.0:1787826299.435575:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789660288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.435584:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.435597:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb855 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826299.435620:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826299.435634:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:1.0:1787826299.435638:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.435645:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb855 expref: 13 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.435658:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb855 expref: 13 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.435667:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000004:00010000:0.0:1787826299.435668:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b4796ff reply state 00000000641e98ca transno 8590016194 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.435677:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.435683:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826299.435686:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826299.435688:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826299.435720:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789660288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 144us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.435726:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6156 00000100:00100000:0.0:1787826299.435822:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84174:x1874668789660160:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 427us (554us total) trans 8590016194 rc 0/0 00000100:00100000:0.0:1787826299.435828:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111037 00000001:00080000:1.0:1787826299.436088:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968132 is committed 00000001:00080000:1.0:1787826299.436101:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968126 is committed 00000100:00100000:0.0:1787826299.436200:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2399:x1874668789659904:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2623us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.436208:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6155 00000100:00100000:1.0:1787826299.437756:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.437899:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789660544 00000100:00100000:3.0:1787826299.437906:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789660544 00000100:00100000:3.0:1787826299.437950:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111038 00000100:00100000:3.0:1787826299.437960:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84173:x1874668789660544:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.438040:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84173:x1874668789660544:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 81us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.438681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.439261:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111038 00000100:00100000:3.0:1787826299.439286:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789660672 00000100:00100000:3.0:1787826299.439290:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789660672 00000100:00100000:3.0:1787826299.439774:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111039 00000100:00100000:3.0:1787826299.439784:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84174:x1874668789660672:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.439802:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.439831:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb85c expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.439900:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb85c expref: 34 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.439915:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb85c expref: 34 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.439934:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:3.0:1787826299.439938:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.439941:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:3.0:1787826299.439992:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84174:x1874668789660672:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 210us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.439998:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111039 00000100:00100000:0.0:1787826299.440042:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.440167:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789660928 00000100:00100000:1.0:1787826299.440172:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789660928 00000100:00100000:1.0:1787826299.440200:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111040 00000100:00100000:1.0:1787826299.440207:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84175:x1874668789660928:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.440239:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.440257:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a0e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x111:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb82b expref: 34 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.440273:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:1.0:1787826299.440277:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826299.440297:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.440312:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.440321:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826299.440321:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826299.440413:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f24b8678 reply state 0000000011552db4 transno 8590016195 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.440432:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.440440:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:1.0:1787826299.440442:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826299.440444:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826299.440473:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789661056 00000100:00100000:3.0:1787826299.440476:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789661056 00000100:00100000:1.0:1787826299.440505:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84175:x1874668789660928:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 298us (464us total) trans 8590016195 rc 0/0 00000100:00100000:3.0:1787826299.440510:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6157 00000100:00100000:1.0:1787826299.440512:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111040 00000100:00100000:3.0:1787826299.440517:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84173:x1874668789661056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.440524:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.440535:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb863 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.440556:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb855 expref: 14 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.440565:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.440569:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.440575:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.440605:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb855 expref: 14 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.440622:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb855 expref: 14 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.440642:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778606848:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.440717:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.443419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.443471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.443525:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789661312 00000100:00100000:3.0:1787826299.443534:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789661312 00000100:00100000:0.0:1787826299.443581:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789661184 00000100:00100000:0.0:1787826299.443586:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789661184 00000100:00100000:3.0:1787826299.443590:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111041 00000100:00100000:3.0:1787826299.443599:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84175:x1874668789661312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.443610:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6158 00000100:00100000:0.0:1787826299.443617:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789661184:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.443618:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.443638:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb86a expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.443685:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb86a expref: 36 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.443697:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb86a expref: 36 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.443713:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:3.0:1787826299.443716:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.443719:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00002000:00010000:0.0:1787826299.443742:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb7:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826299.443746:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb7:0x0] updating lvb mtime from disk: 0 -> 1787826218 00002000:00010000:0.0:1787826299.443749:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb7:0x0] updating lvb atime from disk: 0 -> 1787826218 00002000:00010000:0.0:1787826299.443751:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb7:0x0] updating lvb ctime from disk: 0 -> 1787826218 00002000:00010000:0.0:1787826299.443754:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb7:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826299.443979:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84175:x1874668789661312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 170us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.444327:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789661184:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 156us (363us total) trans 4294968148 rc 0/0 00000100:00100000:0.0:1787826299.444335:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6158 00000100:00100000:3.0:1787826299.446893:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111041 00000100:00100000:3.0:1787826299.449071:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.449106:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789661440 00000100:00100000:3.0:1787826299.449114:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789661440 00010000:00010000:3.0:1787826299.449152:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb855 expref: 16 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.449196:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2931 00000100:00100000:3.0:1787826299.449205:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789661440:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.449220:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.449240:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb855 expref: 16 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.449255:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb855 expref: 16 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.449279:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.449284:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.449292:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 16 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.449391:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 16 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.449438:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 16 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.449452:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778606976:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826299.449536:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7c00 going to sleep for 11 seconds 00010000:00010000:3.0:1787826299.449568:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a182 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb855 expref: 16 pid: 19335 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.449580:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778606848:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.449602:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.449613:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00000100:00100000:3.0:1787826299.449639:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:84173:x1874668789661056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9122us (9317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.449647:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6157 00000100:00100000:3.0:1787826299.453254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.453325:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789661568 00000100:00100000:1.0:1787826299.453334:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789661568 00000100:00100000:1.0:1787826299.453394:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6159 00000100:00100000:1.0:1787826299.453404:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789661568:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826299.453564:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb8:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826299.453568:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb8:0x0] updating lvb mtime from disk: 0 -> 1787826218 00002000:00010000:1.0:1787826299.453570:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb8:0x0] updating lvb atime from disk: 0 -> 1787826218 00002000:00010000:1.0:1787826299.453572:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb8:0x0] updating lvb ctime from disk: 0 -> 1787826218 00002000:00010000:1.0:1787826299.453574:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb8:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826299.453635:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789661568:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 231us (388us total) trans 4294968133 rc 0/0 00000100:00100000:1.0:1787826299.453643:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6159 00000100:00100000:3.0:1787826299.455514:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778606976:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826299.455539:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.455593:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789661440:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 6389us (6529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.455604:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2931 00000100:00100000:0.0:1787826299.456144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.456179:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.456186:0:45405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789661952 00000100:00100000:1.0:1787826299.456192:0:45405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789661952 00000100:00100000:0.0:1787826299.456211:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.456233:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789661824 00002000:00100000:1.0:1787826299.456233:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xb8:0x0] (0->157) req@ffff9bbe128052c0 x1874668789661952/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/0 e 0 to 0 dl 1787826310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826299.456236:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789661824 00002000:00100000:1.0:1787826299.456243:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe128052c0 with x1874668789661952 ext(0->157) 00002000:00010000:1.0:1787826299.456249:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe128052c0 00000100:00100000:0.0:1787826299.456263:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789662208 00000100:00100000:0.0:1787826299.456265:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789662208 00000100:00100000:1.0:1787826299.456272:0:45405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1554 00000100:00100000:1.0:1787826299.456280:0:45405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789661952:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.456281:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111042 00000100:00100000:0.0:1787826299.456287:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84174:x1874668789661824:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.456336:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.456352:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb767 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.456361:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.456390:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb767 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.456402:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb767 expref: 37 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.456415:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12804b40 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778607104:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.456478:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.456496:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111043 00000100:00100000:0.0:1787826299.456502:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84175:x1874668789662208:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.456526:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.456535:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7bb expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.456542:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 4/0,1 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.456558:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7bb expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.456566:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7bb expref: 37 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.456575:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12806940 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778607232:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.456596:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.457262:0:45405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2399:x1874668789661952:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 981us (1117us total) trans 4294968149 rc 0/0 00000100:00100000:1.0:1787826299.457270:0:45405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1554 00002000:00100000:1.0:1787826299.457278:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xb8:0x0] (0->157) req@ffff9bbe128052c0 x1874668789661952/t4294968149(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/448 e 0 to 0 dl 1787826310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826299.457287:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe128052c0 with x1874668789661952 ext(0->157) 00002000:00010000:1.0:1787826299.457291:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe128052c0 00000100:00100000:3.0:1787826299.459884:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.459914:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789662336 00000100:00100000:3.0:1787826299.459922:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789662336 00000100:00100000:3.0:1787826299.459970:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111044 00000100:00100000:3.0:1787826299.459980:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84173:x1874668789662336:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.460097:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84173:x1874668789662336:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 118us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.460105:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111044 00000100:00100000:1.0:1787826299.460290:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12804b40 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778607104:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.460340:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.461053:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.461138:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.461146:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12806940 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778607232:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.461174:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.461200:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789662464 00000100:00100000:0.0:1787826299.461204:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789662464 00000100:00100000:1.0:1787826299.461214:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789662592 00000100:00100000:1.0:1787826299.461218:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789662592 00010000:00010000:0.0:1787826299.461230:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb767 expref: 39 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.461232:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7bb expref: 39 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.461261:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2932 00000100:00100000:0.0:1787826299.461265:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2933 00000100:00100000:1.0:1787826299.461268:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40516450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789662592:12345-192.168.203.9@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787826299.461271:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789662464:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.461280:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.461280:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.461286:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb767 expref: 39 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.461286:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7bb expref: 39 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461300:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb767 expref: 39 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.461300:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7bb expref: 39 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461324:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f3499fde lrc: 0/0,0 mode: --/PR res: [0x200000403:0x110:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb767 expref: 39 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.461324:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a047 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x111:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7bb expref: 39 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461337:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:1.0:1787826299.461337:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:0.0:1787826299.461342:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.461342:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461352:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.461352:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461361:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.461361:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461380:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826299.461380:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.461412:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2402:x1874668789662464:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 140us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.461420:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2933 00010000:00010000:0.0:1787826299.461451:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461459:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461489:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461497:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461504:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461509:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.461514:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461521:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461529:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:0.0:1787826299.461532:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826299.461536:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 2/0,0 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.461542:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1ac lrc: 0/0,0 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.462033:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40516450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789662592:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 762us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.462042:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2932 00000100:00100000:0.0:1787826299.462529:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84175:x1874668789662208:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 6025us (6314us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826299.462537:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111043 00010000:00010000:0.0:1787826299.462659:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.462667:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.462744:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.462752:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.462759:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.462764:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.462768:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.462774:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.462786:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826299.462789:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826299.462793:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.462804:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1a5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.462993:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84174:x1874668789661824:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 6705us (6812us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826299.463000:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111042 00000100:00100000:0.0:1787826299.464766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.464833:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789662720 00000100:00100000:2.0:1787826299.464842:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789662720 00000100:00100000:3.0:1787826299.466462:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.469682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.469833:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789662976 00000100:00100000:2.0:1787826299.469843:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789662976 00000100:00100000:2.0:1787826299.469910:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6160 00000100:00100000:2.0:1787826299.469920:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2399:x1874668789662720:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.469965:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6161 00000100:00100000:1.0:1787826299.469974:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789662976:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.470003:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.470025:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 10 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.470034:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.470039:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826299.470044:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.470076:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 10 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.470091:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 10 pid: 45681 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.470104:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778607360:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826299.470182:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe131b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.472759:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789662848 00000100:00100000:2.0:1787826299.472771:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789662848 00000100:00100000:2.0:1787826299.472997:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6162 00000100:00100000:2.0:1787826299.473010:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789662848:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.473053:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.473072:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 17 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.473081:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.473085:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826299.473090:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 4/1,0 mode: --/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.473121:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 17 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.473134:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 17 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.473147:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778607488:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826299.473538:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56480 going to sleep for 11 seconds 00000001:00080000:3.0:1787826299.474613:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968149 is committed 00000100:00100000:2.0:1787826299.474788:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789662720:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 4866us (10023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.478150:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778607360:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.478179:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.479478:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778607488:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.479499:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.479570:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6160 00000100:00100000:3.0:1787826299.482829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.482893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.482949:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789663104 00000100:00100000:0.0:1787826299.482958:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789663104 00010000:00010000:0.0:1787826299.482997:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 11 pid: 45681 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.483023:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789663232 00000100:00100000:0.0:1787826299.483025:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789663232 00010000:00010000:0.0:1787826299.483035:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 14 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.483054:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2934 00000100:00100000:0.0:1787826299.483062:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789663104:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.483075:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.483094:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 11 pid: 45681 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.483095:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2935 00000100:00100000:2.0:1787826299.483103:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789663232:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.483106:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 11 pid: 45681 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483111:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.483122:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 14 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.483134:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a10b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb847 expref: 11 pid: 45681 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483137:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 14 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.483148:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826299.483150:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349a0e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb832 expref: 14 pid: 8432 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.483152:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.483158:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483159:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826299.483162:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826299.483165:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.483168:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483173:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.483191:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826299.483191:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826299.483375:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789663232:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 270us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.483382:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2935 00010000:00010000:2.0:1787826299.483411:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483421:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483454:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483462:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483471:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483479:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826299.483482:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483492:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483503:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.483511:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349a1ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.484462:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789663104:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1395us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.484462:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789662848:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 11455us (14789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.484472:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2934 00000100:00100000:2.0:1787826299.484473:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6162 00010000:00010000:0.0:1787826299.484506:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.484517:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.484535:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.484544:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.484552:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.484558:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826299.484562:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.484570:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.484583:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.484592:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349a1b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.484636:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2399:x1874668789662976:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 14664us (18181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.484644:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6161 00000100:00100000:0.0:1787826299.492510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.492551:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.492583:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789663488 00000100:00100000:0.0:1787826299.492591:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789663488 00000100:00100000:0.0:1787826299.492635:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789663744 00000100:00100000:0.0:1787826299.492638:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789663744 00000100:00100000:0.0:1787826299.492657:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111045 00000100:00100000:0.0:1787826299.492667:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84173:x1874668789663488:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.492719:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.492744:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a174 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x112:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb84e expref: 35 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.492760:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:0.0:1787826299.492764:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826299.492791:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.492803:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.492812:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826299.492949:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1218839 reply state 00000000e8a0e273 transno 8590016196 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.492961:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.492968:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:0.0:1787826299.492970:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826299.492973:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826299.493061:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84173:x1874668789663488:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 394us (559us total) trans 8590016196 rc 0/0 00000100:00100000:0.0:1787826299.493068:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111045 00000100:00100000:0.0:1787826299.493087:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111046 00000100:00100000:0.0:1787826299.493094:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84174:x1874668789663744:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.493132:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xde:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493142:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xde:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493149:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xde:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.493318:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:0.0:1787826299.493579:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493591:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb85c expref: 36 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493599:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 4/0,1 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493627:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb85c expref: 36 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493640:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb85c expref: 36 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.493651:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778607616:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.493703:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.493718:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789664000 00000100:00100000:0.0:1787826299.493722:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789664000 00000100:00100000:0.0:1787826299.493749:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111047 00000100:00100000:0.0:1787826299.493754:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84175:x1874668789664000:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.493784:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493793:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493801:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493946:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493956:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb86a expref: 38 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493963:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493980:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb86a expref: 38 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.493988:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb86a expref: 38 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.493997:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778607744:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.494021:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe13482840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.496301:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778607616:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.496329:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.497078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.497108:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.497129:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.497154:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789664256 00000100:00100000:0.0:1787826299.497160:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789664256 00010000:00010000:0.0:1787826299.497193:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb85c expref: 39 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.497222:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789664384 00000100:00100000:0.0:1787826299.497225:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789664384 00010000:00010000:0.0:1787826299.497238:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb86a expref: 40 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.497260:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2936 00000100:00100000:0.0:1787826299.497268:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2401:x1874668789664256:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.497282:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.497288:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb85c expref: 40 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497300:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb85c expref: 40 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497321:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a189 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb85c expref: 40 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497338:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826299.497343:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497351:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497359:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497378:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.497421:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789664256:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 153us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.497440:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2936 00000100:00100000:0.0:1787826299.497456:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2937 00000100:00100000:0.0:1787826299.497462:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789664384:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.497471:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.497476:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb86a expref: 38 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497486:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb86a expref: 38 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497498:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:0.0:1787826299.497502:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497512:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497518:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497528:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.497545:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789664384:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 84us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.497552:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2937 00010000:00010000:0.0:1787826299.497645:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a19e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb86a expref: 37 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.497657:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778607744:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.497670:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497678:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.497684:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826299.497776:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016198 00000100:00100000:3.0:1787826299.497959:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789664128 00000100:00100000:3.0:1787826299.497964:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789664128 00000100:00100000:3.0:1787826299.497993:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111048 00000100:00100000:3.0:1787826299.497999:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84173:x1874668789664128:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.498012:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.498025:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb871 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.498061:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb871 expref: 39 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.498073:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb871 expref: 39 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.498089:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:3.0:1787826299.498092:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.498095:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607a00, rc 0) 00000100:00100000:3.0:1787826299.498132:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84173:x1874668789664128:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 133us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.498138:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111048 00000001:00080000:0.0:1787826299.498227:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016199 00000001:00080000:0.0:1787826299.498263:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016200 00000100:00100000:0.0:1787826299.498324:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778607872:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826299.498366:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.498398:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2900 going to sleep for 11 seconds 00010000:00010000:0.0:1787826299.498414:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.498436:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.498454:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778607872 00000100:00100000:2.0:1787826299.498459:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778607872 00000001:00080000:0.0:1787826299.498479:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016197 00000100:00100000:2.0:1787826299.498535:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287 00000100:00100000:2.0:1787826299.498542:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778607872:12345-0@lo:1000:mdt00_005.0 00000001:00080000:0.0:1787826299.498555:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016202 00000001:00080000:0.0:1787826299.498583:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016203 00000100:00100000:2.0:1787826299.498608:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778607872:12345-0@lo:1000:mdt00_005.0 Request processed in 66us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.498614:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287 00000100:00100000:0.0:1787826299.498626:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778608000:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826299.498653:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826299.500805:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778608000 00000100:00100000:3.0:1787826299.500827:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778608000 00000100:00100000:0.0:1787826299.500954:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.501073:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288 00000100:00100000:3.0:1787826299.501083:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778608000:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787826299.501188:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778608000:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.501196:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288 00000100:00100000:0.0:1787826299.501307:0:6515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968147 gen 2 00000004:00080000:0.0:1787826299.501324:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968139 committed transno 4294968147 00000004:00080000:0.0:1787826299.501340:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe08848f00, transno 4294968141 00000004:00080000:0.0:1787826299.501351:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe08848000, transno 4294968142 00000004:00080000:0.0:1787826299.501354:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0884bc00, transno 4294968143 00000004:00080000:0.0:1787826299.501357:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0a31e940, transno 4294968144 00000004:00080000:0.0:1787826299.501359:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf3fc792c0, transno 4294968145 00000004:00080000:0.0:1787826299.501362:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf05cbd2c0, transno 4294968146 00000004:00080000:0.0:1787826299.501364:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf3fc78780, transno 4294968147 00000100:00100000:0.0:1787826299.501371:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778608000:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787826299.501505:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016204 00000100:00100000:0.0:1787826299.501567:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778608128:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826299.501600:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.501618:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e900 going to sleep for 11 seconds 00000004:00080000:1.0:1787826299.501775:0:38202:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 7 done 00000100:00100000:2.0:1787826299.501991:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778608128 00000100:00100000:2.0:1787826299.501997:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778608128 00000100:00100000:2.0:1787826299.502061:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289 00000100:00100000:2.0:1787826299.502069:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778608128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787826299.502191:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778608128:12345-0@lo:1000:mdt00_000.0 Request processed in 122us (590us total) trans 4294968150 rc 0/0 00000100:00100000:2.0:1787826299.502197:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289 00000100:00100000:3.0:1787826299.502203:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778608128:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787826299.502259:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016205 00000100:00100000:2.0:1787826299.502266:0:23845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968132 gen 2 00000004:00080000:2.0:1787826299.502270:0:23845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968124 committed transno 4294968132 00000004:00080000:2.0:1787826299.502282:0:23845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968125 committed transno 4294968132 00010000:00010000:3.0:1787826299.502282:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502291:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826299.502293:0:23845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dd2a940, transno 4294968127 00010000:00010000:3.0:1787826299.502298:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502304:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.502309:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502317:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502332:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:3.0:1787826299.502335:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.502340:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 2/0,0 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502347:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a1cf lrc: 0/0,0 mode: --/EX res: [0x200000403:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502369:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd200/0x68019081f34990aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502375:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd200/0x68019081f34990aa lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826299.502380:0:23845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dd2bc00, transno 4294968128 00010000:00010000:3.0:1787826299.502381:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd200/0x68019081f34990aa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502386:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0ddcd200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.502461:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd200/0x68019081f34990aa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502471:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd200/0x68019081f34990aa lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826299.502480:0:23845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dd292c0, transno 4294968129 00010000:00010000:3.0:1787826299.502480:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xde:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:3.0:1787826299.502482:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:2.0:1787826299.502484:0:23845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dd28f00, transno 4294968130 00010000:00010000:3.0:1787826299.502485:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd200/0x68019081f34990aa lrc: 2/0,0 mode: --/EX res: [0x200000403:0xde:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826299.502486:0:23845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dd2ad00, transno 4294968131 00000004:00080000:2.0:1787826299.502490:0:23845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dd2b840, transno 4294968132 00010000:00010000:3.0:1787826299.502491:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd200/0x68019081f34990aa lrc: 0/0,0 mode: --/EX res: [0x200000403:0xde:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.502495:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778607872:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1787826299.502512:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 3/0,1 mode: --/EX res: [0x200000403:0xde:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502527:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502537:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502545:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826299.502549:0:38204:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00010000:00010000:3.0:1787826299.502552:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502558:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502564:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.502567:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502573:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502580:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xde:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:3.0:1787826299.502582:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.502585:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 2/0,0 mode: --/EX res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502590:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a1eb lrc: 0/0,0 mode: --/EX res: [0x200000403:0xde:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502599:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xde:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502605:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xde:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502610:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xde:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502615:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.502617:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xde:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502623:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xde:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502630:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xde:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:3.0:1787826299.502632:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826299.502635:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xde:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.502640:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a1c8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xde:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826299.502642:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016201 00000100:00100000:2.0:1787826299.502679:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778608256:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826299.503381:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826299.503405:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.503431:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778608256 00000100:00100000:2.0:1787826299.503436:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778608256 00000100:00100000:2.0:1787826299.503468:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290 00000100:00100000:2.0:1787826299.503476:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778608256:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826299.503578:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:23845:x1874668778608256:12345-0@lo:1000:mdt00_005.0 Request processed in 103us (198us total) trans 4294968134 rc 0/0 00000100:00100000:2.0:1787826299.503586:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290 00000100:00100000:2.0:1787826299.503621:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778608256:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1787826299.503677:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016207 00010000:00010000:2.0:1787826299.503700:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503709:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503716:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503721:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.503724:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503730:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503743:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:2.0:1787826299.503745:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.503748:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503754:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a1dd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503773:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd000/0x68019081f34990b1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503779:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd000/0x68019081f34990b1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503785:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd000/0x68019081f34990b1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503790:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0ddcd000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.503793:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd000/0x68019081f34990b1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503798:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd000/0x68019081f34990b1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503805:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdf:0x0].0x0 (ffff9bbf41389900) 00010000:00010000:2.0:1787826299.503808:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.503810:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd000/0x68019081f34990b1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503816:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd000/0x68019081f34990b1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503838:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503939:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503950:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503957:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503962:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503967:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503971:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.503974:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503979:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503986:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdf:0x0].0x0 (ffff9bbf41389900) 00010000:00010000:2.0:1787826299.503989:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.503992:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.503997:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a1f2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.504006:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.504012:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.504016:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.504021:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.504023:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.504029:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.504035:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdf:0x0].0x0 (ffff9bbf41389900) 00010000:00010000:2.0:1787826299.504038:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826299.504041:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.504046:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a1d6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.506810:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+47:84174:x1874668789663744:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 13706us (14248us total) trans 8590016206 rc 0/0 00000100:00100000:3.0:1787826299.506901:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111046 00000020:00080000:3.0:1787826299.506908:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:2.0:1787826299.508958:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84175:x1874668789664000:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 15194us (15632us total) trans 8590016208 rc 0/0 00000100:00100000:2.0:1787826299.508972:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111047 00000020:00080000:2.0:1787826299.508979:0:23845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:0.0:1787826299.509090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.509344:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789664512 00000100:00100000:1.0:1787826299.509353:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789664512 00000100:00100000:1.0:1787826299.509401:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6163 00000100:00100000:1.0:1787826299.509410:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789664512:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826299.509555:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb8:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826299.509559:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb8:0x0] updating lvb mtime from disk: 0 -> 1787826217 00002000:00010000:1.0:1787826299.509562:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb8:0x0] updating lvb atime from disk: 0 -> 1787826217 00002000:00010000:1.0:1787826299.509564:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb8:0x0] updating lvb ctime from disk: 0 -> 1787826217 00002000:00010000:1.0:1787826299.509566:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb8:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826299.509627:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789664512:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 217us (537us total) trans 4294968151 rc 0/0 00000100:00100000:1.0:1787826299.509635:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6163 00000100:00100000:3.0:1787826299.513136:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.513175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.513241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.513256:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789665024 00000100:00100000:1.0:1787826299.513266:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789665024 00000100:00100000:3.0:1787826299.513267:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789664768 00000100:00100000:3.0:1787826299.513273:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789664768 00000100:00100000:3.0:1787826299.513309:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789665280 00000100:00100000:3.0:1787826299.513312:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789665280 00000100:00100000:3.0:1787826299.513328:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2593 00000100:00100000:3.0:1787826299.513338:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84174:x1874668789664768:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.513369:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111049 00000100:00100000:1.0:1787826299.513379:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84173:x1874668789665024:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.513441:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.513459:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7fa expref: 48 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.513474:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.513509:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7fa expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.513524:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7fa expref: 49 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.513538:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778608384:192.168.203.9@tcp:104: 00000004:00080000:3.0:1787826299.513591:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x110:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1787826299.513620:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe131b4180 going to sleep for 11 seconds 00000001:00080000:3.0:1787826299.513625:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016209 00010000:00010000:3.0:1787826299.513648:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.513660:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.513671:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.513680:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.513687:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.513750:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.513766:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826299.513781:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2594 00000100:00100000:2.0:1787826299.513791:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84175:x1874668789665280:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.513816:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84174:x1874668789664768:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 480us (687us total) trans 8590016210 rc 0/0 00000100:00100000:3.0:1787826299.513823:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2593 00000020:00080000:3.0:1787826299.513828:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00080000:2.0:1787826299.513926:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x111:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826299.513942:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016211 00010000:00010000:2.0:1787826299.513963:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.513973:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.513981:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.513987:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.513993:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.513998:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514249:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826299.514411:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826299.514414:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514429:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.514434:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514442:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514454:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:3.0:1787826299.514458:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826299.514462:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514468:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a200 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.514469:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84175:x1874668789665280:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 680us (1227us total) trans 8590016212 rc 0/0 00000100:00100000:2.0:1787826299.514477:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2594 00010000:00010000:3.0:1787826299.514479:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:2.0:1787826299.514480:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826299.514482:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514487:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.514490:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514496:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514503:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:3.0:1787826299.514505:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826299.514508:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514513:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a207 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.514521:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.514523:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.514524:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826299.514608:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826299.517301:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778608384:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.517333:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.520013:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.520062:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789665408 00000100:00100000:3.0:1787826299.520070:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789665408 00010000:00010000:3.0:1787826299.520109:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7fa expref: 51 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.520519:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2938 00000100:00100000:3.0:1787826299.520531:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+51:2401:x1874668789665408:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.520545:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.520552:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7fa expref: 51 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520567:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7fa expref: 51 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520590:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a07f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x112:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb7fa expref: 51 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520604:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:3.0:1787826299.520609:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520632:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520641:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520668:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.520738:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2401:x1874668789665408:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 209us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.520746:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2938 00010000:00010000:3.0:1787826299.520777:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520785:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520832:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520840:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520847:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520871:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.520876:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520883:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520893:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:3.0:1787826299.520897:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787826299.520899:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.520905:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a1f9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.520954:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84173:x1874668789665024:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 7577us (7777us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787826299.520962:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111049 00000100:00100000:3.0:1787826299.522768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.523466:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789665536 00000100:00100000:0.0:1787826299.523475:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789665536 00000100:00100000:0.0:1787826299.523531:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6164 00000100:00100000:0.0:1787826299.523540:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789665536:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.523581:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.523600:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.523609:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.523614:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.523618:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 4/1,0 mode: --/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.523650:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.523665:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 13 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.523678:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778608512:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.523749:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.526775:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778608512:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.526806:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826299.527548:0:54852:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826299.527554:0:54852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826299.527827:0:54852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:0.0:1787826299.527834:0:54852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:0.0:1787826299.527930:0:54852:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826299.527933:0:54852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787826299.528116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.528183:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789665664 00000100:00100000:2.0:1787826299.528192:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789665664 00010000:00010000:2.0:1787826299.528227:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 14 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826299.528277:0:54852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000100:00100000:2.0:1787826299.528281:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2939 00000040:00080000:0.0:1787826299.528283:0:54852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1787826299.528296:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789665664:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826299.528312:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.528331:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 14 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826299.528332:0:54852:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826299.528337:0:54852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00010000:00010000:2.0:1787826299.528352:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 14 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.528374:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349a197 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb863 expref: 14 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.528389:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826299.528393:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826299.528398:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.528408:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.528452:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826299.528501:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789665664:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 207us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.528518:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2939 00010000:00010000:3.0:1787826299.528526:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.528549:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.528582:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.528595:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.528616:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.528662:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.528669:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.528700:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.528725:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.528746:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003810602f/0x68019081f349a20e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826299.528785:0:54852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:0.0:1787826299.528792:0:54852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1787826299.528824:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789665536:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 5278us (6055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.528833:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6164 00000040:00080000:0.0:1787826299.528883:0:54852:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826299.528887:0:54852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826299.529306:0:54852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:0.0:1787826299.529310:0:54852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1787826299.533395:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.533462:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789665920 00000100:00100000:0.0:1787826299.533472:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789665920 00000100:00100000:0.0:1787826299.533531:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111050 00000100:00100000:0.0:1787826299.533541:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84173:x1874668789665920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.533620:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.533636:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.533648:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.534337:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.534351:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb871 expref: 50 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.534360:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.534393:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb871 expref: 50 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.534407:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb871 expref: 50 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.534430:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778608640:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.534518:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.543408:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.543491:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789666048 00000100:00100000:3.0:1787826299.543501:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789666048 00010000:00010000:3.0:1787826299.543543:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb871 expref: 51 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.543584:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2940 00000100:00100000:3.0:1787826299.543595:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40517450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+51:2402:x1874668789666048:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.543616:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.543625:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb871 expref: 51 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.543639:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb871 expref: 51 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.543662:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:3.0:1787826299.543667:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.543675:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.543682:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.543703:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.543759:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40517450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+51:2402:x1874668789666048:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 166us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.543768:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2940 00010000:00010000:0.0:1787826299.545371:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a1e4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb871 expref: 50 pid: 25759 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.545393:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778608640:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.545417:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.545438:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.545444:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826299.545558:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016213 00000001:00080000:0.0:1787826299.545672:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016214 00000001:00080000:0.0:1787826299.545709:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016215 00000100:00100000:0.0:1787826299.545788:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778608768:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787826299.545881:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.545914:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.546178:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778608768 00000100:00100000:2.0:1787826299.546184:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778608768 00000100:00100000:2.0:1787826299.546242:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3291 00000100:00100000:2.0:1787826299.546252:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778608768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826299.546348:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778608768:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.546356:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3291 00000100:00100000:3.0:1787826299.546704:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778608768:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787826299.546833:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016216 00000100:00100000:3.0:1787826299.546905:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778608896:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826299.546939:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826299.546958:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.547019:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778608896 00000100:00100000:2.0:1787826299.547025:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778608896 00000100:00100000:2.0:1787826299.547053:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3292 00000100:00100000:2.0:1787826299.547061:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778608896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826299.547194:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6517:x1874668778608896:12345-0@lo:1000:mdt00_002.0 Request processed in 129us (248us total) trans 4294968152 rc 0/0 00000100:00100000:2.0:1787826299.547203:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3292 00000100:00100000:2.0:1787826299.547241:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778608896:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787826299.547370:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016217 00010000:00010000:2.0:1787826299.547400:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547410:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547418:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547436:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.547441:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547449:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547470:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:2.0:1787826299.547473:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.547479:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547486:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a21c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547511:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcc600/0x68019081f34990a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547518:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcc600/0x68019081f34990a3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547525:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcc600/0x68019081f34990a3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547530:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0ddcc600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.547533:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcc600/0x68019081f34990a3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547539:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcc600/0x68019081f34990a3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547547:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdd:0x0].0x0 (ffff9bbf41389700) 00010000:00010000:2.0:1787826299.547550:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.547553:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcc600/0x68019081f34990a3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547560:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcc600/0x68019081f34990a3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547590:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547601:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547611:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547618:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547624:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547629:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547634:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.547637:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547644:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547652:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdd:0x0].0x0 (ffff9bbf41389700) 00010000:00010000:2.0:1787826299.547654:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.547657:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547662:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a223 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547672:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547678:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547683:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547689:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.547692:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547699:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547706:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xdd:0x0].0x0 (ffff9bbf41389700) 00010000:00010000:2.0:1787826299.547708:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826299.547711:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.547716:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a215 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.547835:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84173:x1874668789665920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 14295us (14448us total) trans 8590016218 rc 0/0 00000100:00100000:2.0:1787826299.547844:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111050 00000020:00080000:2.0:1787826299.547849:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1787826299.548005:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826299.548010:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826299.548210:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9673 count 103 00000040:00080000:1.0:1787826299.548217:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787826299.548325:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafcb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778609024:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826299.548369:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.556747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.556809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.556834:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.557027:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafcb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778609024:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826299.557981:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789666432 00000100:00100000:0.0:1787826299.557990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789666432 00000100:00100000:0.0:1787826299.558050:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789666560 00000100:00100000:0.0:1787826299.558053:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789666560 00000100:00100000:0.0:1787826299.558080:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111051 00000100:00100000:0.0:1787826299.558095:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84181:x1874668789666432:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826299.558130:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe1:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826299.558245:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84181:x1874668789666432:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 151us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.558252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111051 00000100:00100000:0.0:1787826299.558271:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111052 00000100:00100000:0.0:1787826299.558277:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84180:x1874668789666560:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826299.558290:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe0:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826299.558344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84180:x1874668789666560:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 66us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.558352:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111052 00000100:00100000:0.0:1787826299.558381:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789666304 00000100:00100000:0.0:1787826299.558385:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789666304 00000100:00100000:0.0:1787826299.558409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2595 00000100:00100000:0.0:1787826299.558415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84173:x1874668789666304:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787826299.558622:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x112:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826299.558653:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016219 00010000:00010000:0.0:1787826299.558691:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.558708:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.558720:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.558728:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.558735:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.558741:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.558761:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826299.558781:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826299.558790:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.558800:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826299.558804:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.558814:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.558821:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84173:x1874668789666304:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 404us (2083us total) trans 8590016220 rc 0/0 00000100:00100000:0.0:1787826299.558831:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2595 00010000:00010000:3.0:1787826299.558831:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:3.0:1787826299.558837:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:0.0:1787826299.558838:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826299.558843:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 1/0,0 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.558879:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a22a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.558892:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.558894:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826299.558896:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826299.562645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.562687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.562874:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789666688 00000100:00100000:3.0:1787826299.562885:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789666688 00000100:00100000:3.0:1787826299.562934:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789666816 00000100:00100000:3.0:1787826299.562937:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789666816 00000100:00100000:3.0:1787826299.562959:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111053 00000100:00100000:3.0:1787826299.562968:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84182:x1874668789666688:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826299.563001:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826299.563126:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84182:x1874668789666688:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 158us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.563133:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111053 00000100:00100000:3.0:1787826299.563150:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111054 00000100:00100000:3.0:1787826299.563156:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84181:x1874668789666816:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.563216:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563234:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563246:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563261:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563267:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563274:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563303:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563310:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563317:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.563344:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe1:0x0]: returning size 158 00000004:00200000:3.0:1787826299.563349:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826299.563361:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563373:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563380:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563386:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563392:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.563397:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563404:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563418:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826299.563431:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.563436:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563442:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a231 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563455:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563461:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563466:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563471:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.563474:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563479:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563486:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xc58429e3 (ffff9bbe08124a00) 00000100:00100000:0.0:1787826299.563534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826299.563534:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.563538:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563544:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a238 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc58429e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563557:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563563:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563569:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563574:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.563576:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563582:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563594:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe1:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:3.0:1787826299.563597:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.563600:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.563606:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a23f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.563653:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84181:x1874668789666816:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 495us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.563660:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111054 00000100:00100000:1.0:1787826299.564094:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789666944 00000100:00100000:1.0:1787826299.564100:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789666944 00000100:00100000:1.0:1787826299.564597:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111055 00000100:00100000:1.0:1787826299.564609:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84180:x1874668789666944:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.564666:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564678:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564687:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564701:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564707:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564712:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564733:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564741:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564748:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.564779:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe0:0x0]: returning size 158 00000004:00200000:1.0:1787826299.564782:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826299.564792:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564802:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564809:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564825:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564830:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.564833:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564839:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564849:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826299.564871:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.564875:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564882:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a246 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564893:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564898:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564903:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564909:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.564911:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564916:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564923:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3a61662e (ffff9bbe15dc4100) 00010000:00010000:1.0:1787826299.564925:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.564928:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564933:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a24d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3a61662e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564945:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564951:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564957:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564961:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.564964:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564971:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564982:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe0:0x0].0x0 (ffff9bbf41389600) 00010000:00010000:1.0:1787826299.564984:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.564986:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.564991:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a254 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.565038:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84180:x1874668789666944:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 432us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.565045:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111055 00000100:00100000:3.0:1787826299.570916:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.570954:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.570995:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789667072 00000100:00100000:1.0:1787826299.571004:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789667072 00000100:00100000:1.0:1787826299.571058:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789667328 00000100:00100000:1.0:1787826299.571062:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789667328 00000100:00100000:1.0:1787826299.571086:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111056 00000100:00100000:1.0:1787826299.571099:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84182:x1874668789667072:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.571159:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111057 00000100:00100000:3.0:1787826299.571168:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84181:x1874668789667328:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.571171:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571186:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571188:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.571198:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571199:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a262 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb878 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571213:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571219:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571226:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571248:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571256:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571261:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571275:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571284:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.571292:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe2:0x0]: returning size 158 00010000:00010000:3.0:1787826299.571292:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.571296:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:3.0:1787826299.571304:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe1:0x0]: returning size 158 00000004:00010000:1.0:1787826299.571308:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571319:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571325:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571331:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571337:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571342:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.571346:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571352:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571363:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826299.571366:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.571369:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571371:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571377:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a25b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571377:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571383:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571387:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.571388:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571391:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571394:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571397:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571400:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571404:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe1:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:1.0:1787826299.571405:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.571406:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826299.571407:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571409:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571413:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571415:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a277 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571420:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x990abdf7 (ffff9bbe15dc4100) 00010000:00010000:1.0:1787826299.571433:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.571436:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571445:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a269 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x990abdf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571454:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a262 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb878 expref: 59 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571457:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571463:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571464:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826299.571467:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826299.571469:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571471:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a262 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb878 expref: 59 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571474:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.571477:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.571480:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00010000:00010000:1.0:1787826299.571483:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571489:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe2:0x0].0x0 (ffff9bbe0bd66200) 00010000:00010000:1.0:1787826299.571491:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.571493:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.571498:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a270 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.571534:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84181:x1874668789667328:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 367us (578us total) trans 8590016221 rc 301/301 00000100:00100000:3.0:1787826299.571541:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111057 00000100:00100000:1.0:1787826299.572000:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84182:x1874668789667072:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 903us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.572008:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111056 00000100:00100000:0.0:1787826299.575087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.575122:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789667584 00000100:00100000:0.0:1787826299.575131:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789667584 00000100:00100000:0.0:1787826299.575197:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111058 00000100:00100000:0.0:1787826299.575207:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84180:x1874668789667584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.575228:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.575251:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a285 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb87f expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575369:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575384:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575394:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826299.575404:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe0:0x0]: returning size 158 00010000:00010000:0.0:1787826299.575489:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575496:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575503:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575509:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.575513:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575520:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575534:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe0:0x0].0x0 (ffff9bbf41389600) 00010000:00010000:0.0:1787826299.575537:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826299.575541:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575548:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a28c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575584:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a285 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb87f expref: 59 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575594:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826299.575597:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826299.575600:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a285 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb87f expref: 59 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.575609:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826299.575662:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84180:x1874668789667584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 457us (582us total) trans 8590016222 rc 301/301 00000100:00100000:0.0:1787826299.575670:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111058 00000100:00100000:0.0:1787826299.577528:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.577592:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789667840 00000100:00100000:3.0:1787826299.577601:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789667840 00000100:00100000:3.0:1787826299.577748:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111059 00000100:00100000:3.0:1787826299.577758:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84182:x1874668789667840:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.577776:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.577795:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a29a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb886 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.577921:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.577936:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.577947:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.577956:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe2:0x0]: returning size 158 00010000:00010000:3.0:1787826299.578031:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.578038:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.578049:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.578055:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.578059:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.578066:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.578078:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe2:0x0].0x0 (ffff9bbe0bd66200) 00010000:00010000:3.0:1787826299.578081:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826299.578085:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.578092:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a2a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.578126:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a29a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb886 expref: 60 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.578137:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826299.578139:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826299.578143:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a29a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb886 expref: 60 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.578152:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00000100:00100000:3.0:1787826299.578220:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84182:x1874668789667840:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 462us (696us total) trans 8590016223 rc 301/301 00000100:00100000:3.0:1787826299.578230:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111059 00000100:00100000:0.0:1787826299.581176:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.581462:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.581587:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789667968 00000100:00100000:3.0:1787826299.581596:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789667968 00000100:00100000:2.0:1787826299.581646:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789668096 00000100:00100000:2.0:1787826299.581650:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789668096 00000100:00100000:2.0:1787826299.581689:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111060 00000100:00100000:2.0:1787826299.581699:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84181:x1874668789667968:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826299.581731:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe1:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826299.581885:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84181:x1874668789667968:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 155us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.581891:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111060 00000100:00100000:2.0:1787826299.581908:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111061 00000100:00100000:2.0:1787826299.581915:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84180:x1874668789668096:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826299.581929:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe0:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826299.581970:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84180:x1874668789668096:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 55us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.581976:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111061 00000100:00100000:0.0:1787826299.583055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.583265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789668224 00000100:00100000:2.0:1787826299.583272:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789668224 00000100:00100000:2.0:1787826299.583458:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111062 00000100:00100000:2.0:1787826299.583469:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84182:x1874668789668224:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826299.583499:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826299.583591:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84182:x1874668789668224:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 124us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.583598:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111062 00000100:00100000:0.0:1787826299.584069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.584589:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789668480 00000100:00100000:3.0:1787826299.584596:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789668480 00000100:00100000:3.0:1787826299.584640:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111063 00000100:00100000:3.0:1787826299.584649:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84181:x1874668789668480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.584663:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.584682:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a2af lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb88d expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.585153:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a2b6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.585167:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.585177:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.585194:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x113:0x0]: returning size 0 00010000:00010000:3.0:1787826299.585237:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a2af lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb88d expref: 62 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.585253:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb88d expref: 61 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.585261:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826299.585264:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826299.585267:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607a00, rc 0) 00000100:00100000:3.0:1787826299.585932:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84181:x1874668789668480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1281us (1861us total) trans 8590016224 rc 0/0 00000100:00100000:3.0:1787826299.585940:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111063 00000100:00100000:0.0:1787826299.588036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.588085:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789668736 00000100:00100000:2.0:1787826299.588093:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789668736 00000100:00100000:2.0:1787826299.588175:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111064 00000100:00100000:2.0:1787826299.588195:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84180:x1874668789668736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.588218:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.588238:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2c4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb894 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.588654:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a2cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.588667:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a2cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.588679:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a2cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826299.588687:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x114:0x0]: returning size 0 00010000:00010000:2.0:1787826299.588730:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2c4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb894 expref: 64 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.588746:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a2cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb894 expref: 63 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.588755:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127f400) 00010000:00010000:2.0:1787826299.588758:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826299.588761:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826299.588824:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84180:x1874668789668736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 632us (797us total) trans 8590016225 rc 0/0 00000100:00100000:2.0:1787826299.588832:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111064 00000100:00100000:2.0:1787826299.599162:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.599342:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789668992 00000100:00100000:3.0:1787826299.599351:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789668992 00000100:00100000:3.0:1787826299.599445:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111065 00000100:00100000:3.0:1787826299.599456:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84182:x1874668789668992:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.599478:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.599499:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a2d9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb89b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.599951:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a2e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.599965:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.599976:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.599985:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x115:0x0]: returning size 0 00010000:00010000:3.0:1787826299.600027:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a2d9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb89b expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.600043:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb89b expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.600057:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826299.600060:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826299.600064:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00000100:00100000:3.0:1787826299.600131:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84182:x1874668789668992:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 677us (978us total) trans 8590016226 rc 0/0 00000100:00100000:3.0:1787826299.600139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111065 00000100:00100000:0.0:1787826299.603334:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.603380:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789669248 00000100:00100000:2.0:1787826299.603389:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789669248 00000100:00100000:2.0:1787826299.603454:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111066 00000100:00100000:2.0:1787826299.603464:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84181:x1874668789669248:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.603522:0:12105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.603546:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a2b6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb88d expref: 65 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603563:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124a00) 00010000:00010000:2.0:1787826299.603573:0:12105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826299.603594:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603608:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603619:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603649:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603657:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603664:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603720:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603728:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603743:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603751:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603757:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.603760:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603768:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603775:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.603778:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.603781:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603787:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a2ee lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603795:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603800:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603805:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.603809:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.603811:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.604069:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.604079:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xa7b7ac7d (ffff9bbf1127fc00) 00010000:00010000:2.0:1787826299.604081:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.604084:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.604090:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2f5 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa7b7ac7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.604176:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84181:x1874668789669248:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 711us (848us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826299.604371:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111066 00000100:00100000:2.0:1787826299.610352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.610480:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.610507:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.610761:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789669760 00000100:00100000:2.0:1787826299.610771:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789669760 00000100:00100000:2.0:1787826299.610822:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3293 00000100:00100000:2.0:1787826299.610832:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+64:2402:x1874668789669760:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826299.610907:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.610926:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2fc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb8a9 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.610980:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.610999:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611009:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611021:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611029:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611035:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611071:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611078:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611084:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611089:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.611093:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611102:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611112:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.611116:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.611121:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611127:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a303 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611138:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611143:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611149:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611153:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.611156:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611161:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611167:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x1b586894 (ffff9bbf1127fc00) 00010000:00010000:2.0:1787826299.611170:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.611173:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611178:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a30a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x1b586894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611212:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2fc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a9 expref: 65 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611221:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.611223:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826299.611227:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a2fc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a9 expref: 65 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.611234:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc -2) 00000100:00100000:2.0:1787826299.611297:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+64:2402:x1874668789669760:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 467us (816us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826299.611305:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3293 00000100:00100000:3.0:1787826299.611450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789669376 00000100:00100000:3.0:1787826299.611455:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789669376 00000100:00100000:3.0:1787826299.611493:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789669632 00000100:00100000:3.0:1787826299.611497:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789669632 00000100:00100000:3.0:1787826299.611516:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111067 00000100:00100000:3.0:1787826299.611523:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84181:x1874668789669376:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.611532:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.611545:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a311 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb8a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.611567:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.611575:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.611593:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.611803:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a311 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a2 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.611823:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a2 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.611831:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:3.0:1787826299.611833:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826299.611835:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606800, rc 0) 00000100:00100000:3.0:1787826299.611884:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84181:x1874668789669376:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 361us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.611891:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111067 00000100:00100000:3.0:1787826299.611907:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111068 00000100:00100000:3.0:1787826299.611915:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84180:x1874668789669632:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.611944:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.611959:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a2cb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb894 expref: 65 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.611969:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127f400) 00010000:00010000:3.0:1787826299.611977:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826299.611990:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.611999:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612006:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612022:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612030:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612037:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612068:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612076:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612082:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612088:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612093:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.612096:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612102:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612110:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826299.612112:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.612115:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612122:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a31f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.612131:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.614964:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.614974:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.614982:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.614986:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.614996:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.615012:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x4126bea3 (ffff9bbe08124600) 00010000:00010000:3.0:1787826299.615015:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.615020:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.615027:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a326 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x4126bea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.615525:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84180:x1874668789669632:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 3604us (5011us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826299.615535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111068 00000100:00100000:2.0:1787826299.625820:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.625893:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.625921:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789670144 00000100:00100000:2.0:1787826299.625930:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789670144 00000100:00100000:2.0:1787826299.625976:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789670016 00000100:00100000:2.0:1787826299.625979:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789670016 00000100:00100000:2.0:1787826299.625999:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111069 00000100:00100000:2.0:1787826299.626008:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84180:x1874668789670144:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.626030:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.626050:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a32d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb8e1 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626087:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626100:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626115:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626220:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a32d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e1 expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626238:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e1 expref: 66 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626247:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:2.0:1787826299.626250:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826299.626253:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826299.626306:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84180:x1874668789670144:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 298us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.626312:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111069 00000100:00100000:2.0:1787826299.626329:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111070 00000100:00100000:2.0:1787826299.626336:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84181:x1874668789670016:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.626379:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626387:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626394:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826299.626531:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cf0f5cd reply state 0000000033dc297b transno 8590016227 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626544:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.626551:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:2.0:1787826299.626553:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826299.626556:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826299.626606:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84181:x1874668789670016:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 270us (713us total) trans 8590016227 rc 0/0 00000100:00100000:2.0:1787826299.626613:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111070 00000100:00100000:1.0:1787826299.627221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.627261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.627326:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789670528 00000100:00100000:2.0:1787826299.627332:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789670528 00000100:00100000:2.0:1787826299.627404:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3294 00000100:00100000:2.0:1787826299.627412:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+67:2402:x1874668789670528:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826299.627458:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.627475:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a342 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb8e8 expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627516:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627526:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627535:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627547:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627558:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627565:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627603:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627611:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627617:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627622:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.627627:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627634:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627645:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.627648:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.627651:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627656:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a349 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627666:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627672:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627677:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627682:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.627685:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627691:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627697:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xb4cba727 (ffff9bbf1127fe00) 00010000:00010000:2.0:1787826299.627699:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.627702:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627707:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a350 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xb4cba727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627731:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a342 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e8 expref: 68 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627740:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.627743:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826299.627746:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a342 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e8 expref: 68 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.627759:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc -2) 00000100:00100000:2.0:1787826299.627804:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+67:2402:x1874668789670528:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 392us (542us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826299.627812:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3294 00000100:00100000:3.0:1787826299.627938:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789670400 00000100:00100000:3.0:1787826299.627943:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789670400 00000100:00100000:3.0:1787826299.627978:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111071 00000100:00100000:3.0:1787826299.627985:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84182:x1874668789670400:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.628013:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.628027:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a2e0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb89b expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628038:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826299.628045:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826299.628056:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628065:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628072:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628083:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628090:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628096:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628117:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628123:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628129:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628134:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.628137:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628143:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628151:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826299.628153:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.628156:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628161:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a357 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628168:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628173:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628178:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628182:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.628185:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628190:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628201:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x65c91e5f (ffff9bbe08124600) 00010000:00010000:3.0:1787826299.628204:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.628206:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.628212:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a35e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x65c91e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.628249:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84182:x1874668789670400:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 264us (1029us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826299.628255:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111071 00000100:00100000:0.0:1787826299.633460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.633505:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.633586:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789670784 00000100:00100000:3.0:1787826299.633596:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789670784 00000100:00100000:1.0:1787826299.633730:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789670912 00000100:00100000:1.0:1787826299.633735:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789670912 00000100:00100000:3.0:1787826299.633884:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111072 00000100:00100000:3.0:1787826299.633894:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84180:x1874668789670784:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.633974:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.633992:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.634009:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826299.634163:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096051bc3 reply state 0000000070b78af1 transno 8590016228 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.634176:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.634195:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:3.0:1787826299.634198:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826299.634202:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826299.634599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.634633:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789671040 00000100:00100000:0.0:1787826299.634638:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789671040 00000100:00100000:1.0:1787826299.643847:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111073 00000100:00100000:1.0:1787826299.643888:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84181:x1874668789670912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.643896:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84180:x1874668789670784:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 9999us (10442us total) trans 8590016228 rc 0/0 00000100:00100000:3.0:1787826299.643907:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111072 00010000:00010000:1.0:1787826299.643925:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.643949:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb920 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.644011:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb920 expref: 70 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.644027:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb920 expref: 70 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.644036:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:1.0:1787826299.644039:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826299.644043:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6800, rc 0) 00000100:00100000:1.0:1787826299.644074:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84181:x1874668789670912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 198us (10568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.644080:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111073 00000100:00100000:3.0:1787826299.647998:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.654595:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789671168 00000100:00100000:0.0:1787826299.654611:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789671168 00000100:00100000:0.0:1787826299.654785:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111074 00000100:00100000:0.0:1787826299.654799:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84182:x1874668789671040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.654802:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.654848:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111075 00000100:00100000:3.0:1787826299.654874:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84180:x1874668789671168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.655013:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.655038:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a373 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb927 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.655155:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.655705:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.655722:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.655735:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.655936:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a373 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb927 expref: 72 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.655965:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb927 expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.655974:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826299.655977:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826299.655981:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:0.0:1787826299.656045:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84182:x1874668789671040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1250us (21446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.656053:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111074 00010000:00010000:3.0:1787826299.656547:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb92e expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.656592:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb92e expref: 71 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.656605:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb92e expref: 71 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.656613:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:3.0:1787826299.656616:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.656619:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:3.0:1787826299.656659:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84180:x1874668789671168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1788us (8669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.656666:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111075 00000100:00100000:3.0:1787826299.656708:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789671296 00000100:00100000:3.0:1787826299.656715:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789671296 00000100:00100000:3.0:1787826299.656752:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2596 00000100:00100000:3.0:1787826299.656760:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84181:x1874668789671296:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.656824:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84181:x1874668789671296:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 65us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.656830:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2596 00000100:00100000:0.0:1787826299.664572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.664621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.664665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.664693:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789671808 00000100:00100000:0.0:1787826299.664701:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789671808 00000100:00100000:1.0:1787826299.664734:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789671936 00000100:00100000:1.0:1787826299.664740:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789671936 00000100:00100000:0.0:1787826299.664753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2597 00000100:00100000:0.0:1787826299.664765:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf123d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84180:x1874668789671808:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.664771:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2598 00000100:00100000:1.0:1787826299.664781:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84181:x1874668789671936:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.664922:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf123d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84180:x1874668789671808:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 160us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.664930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2597 00000100:00100000:1.0:1787826299.664962:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84181:x1874668789671936:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 182us (296us total) trans 8590016229 rc 0/0 00000100:00100000:1.0:1787826299.664970:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2598 00000100:00100000:3.0:1787826299.665099:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789671552 00000100:00100000:3.0:1787826299.665104:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789671552 00000100:00100000:3.0:1787826299.665130:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111076 00000100:00100000:3.0:1787826299.665134:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84182:x1874668789671552:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.665181:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.665193:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.665202:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826299.665277:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de067c39 reply state 0000000080494ef0 transno 8590016230 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.665286:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.665291:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826299.665293:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826299.665296:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826299.665329:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84182:x1874668789671552:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 195us (769us total) trans 8590016230 rc 0/0 00000100:00100000:3.0:1787826299.665334:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111076 00000100:00100000:0.0:1787826299.669166:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.669197:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789672064 00000100:00100000:0.0:1787826299.669205:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789672064 00000100:00100000:0.0:1787826299.669250:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111077 00000100:00100000:0.0:1787826299.669258:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84182:x1874668789672064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.669279:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.669303:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb935 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.669371:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb935 expref: 75 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.669385:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb935 expref: 75 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.669394:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826299.669397:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.669401:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3800, rc 0) 00000100:00100000:0.0:1787826299.669455:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84182:x1874668789672064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 197us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.669461:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111077 00000100:00100000:0.0:1787826299.671661:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.671831:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789672320 00000100:00100000:1.0:1787826299.671839:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789672320 00000100:00100000:1.0:1787826299.671908:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2599 00000100:00100000:1.0:1787826299.671917:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84180:x1874668789672320:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.672118:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84180:x1874668789672320:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 200us (463us total) trans 8590016231 rc 0/0 00000100:00100000:1.0:1787826299.672125:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2599 00000100:00100000:0.0:1787826299.672955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.672987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.673050:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789672704 00000100:00100000:3.0:1787826299.673056:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789672704 00000100:00100000:3.0:1787826299.673097:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2600 00000100:00100000:3.0:1787826299.673106:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84182:x1874668789672704:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.673203:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84182:x1874668789672704:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 97us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.673211:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2600 00000100:00100000:1.0:1787826299.673271:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789672576 00000100:00100000:1.0:1787826299.673276:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789672576 00000100:00100000:1.0:1787826299.673321:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111078 00000100:00100000:1.0:1787826299.673329:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84181:x1874668789672576:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.673403:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84181:x1874668789672576:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 75us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.673410:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111078 00000100:00100000:3.0:1787826299.680805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.680847:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.681209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.681265:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789672960 00000100:00100000:1.0:1787826299.681275:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789672960 00000100:00100000:0.0:1787826299.681279:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789673216 00000100:00100000:0.0:1787826299.681285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789673216 00000100:00100000:0.0:1787826299.681327:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789673472 00000100:00100000:0.0:1787826299.681331:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789673472 00000100:00100000:1.0:1787826299.681335:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2601 00000100:00100000:1.0:1787826299.681347:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84182:x1874668789672960:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.681357:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111079 00000100:00100000:0.0:1787826299.681366:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84181:x1874668789673216:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.681378:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.681399:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a396 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb93c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.681491:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.681508:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb920 expref: 80 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.681518:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.681550:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb920 expref: 80 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.681565:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb920 expref: 80 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.681573:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84182:x1874668789672960:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 226us (773us total) trans 8590016232 rc 0/0 00000100:00100000:0.0:1787826299.681585:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778609152:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826299.681586:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2601 00000100:00100000:1.0:1787826299.681627:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111080 00000100:00100000:1.0:1787826299.681636:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84180:x1874668789673472:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.681645:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.681683:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84180:x1874668789673472:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 48us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.681690:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111080 00000100:00100000:1.0:1787826299.692788:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.692940:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.692960:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.693161:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778609152:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.693187:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.694546:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789673728 00000100:00100000:3.0:1787826299.694561:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789673728 00000100:00100000:3.0:1787826299.694654:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789674112 00000100:00100000:3.0:1787826299.694661:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789674112 00000100:00100000:3.0:1787826299.694718:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111081 00000100:00100000:3.0:1787826299.694733:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84180:x1874668789673728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.694751:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.694772:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a3a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb943 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.694945:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 3/0,1 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.694968:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb92e expref: 81 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.694990:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 4/0,1 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.695171:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb92e expref: 81 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.695191:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb92e expref: 81 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.695217:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03da40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778609280:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.695353:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.695445:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111082 00000100:00100000:3.0:1787826299.695470:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789673856 00000100:00100000:0.0:1787826299.696164:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84182:x1874668789674112:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.696347:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789673856 00000100:00100000:0.0:1787826299.696446:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84182:x1874668789674112:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 916us (3411us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826299.696477:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb920 expref: 82 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.696527:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111082 00000100:00100000:3.0:1787826299.696573:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2941 00000100:00100000:3.0:1787826299.696585:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2401:x1874668789673856:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.696621:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.696688:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb920 expref: 82 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.697843:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb920 expref: 81 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.697882:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a36c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb920 expref: 81 pid: 45682 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.697896:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:3.0:1787826299.697901:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.697910:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.697918:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.697943:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.697982:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789673856:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1400us (5042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.697990:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2941 00010000:00010000:0.0:1787826299.698267:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698279:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826299.698298:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x113:0x0]: returning size 0 00000004:00080000:0.0:1787826299.698447:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb9:0x0], index 1: 0 00010000:00010000:0.0:1787826299.698538:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698545:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698552:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698557:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.698561:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698569:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698579:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:0.0:1787826299.698581:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.698585:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698591:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a39d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698629:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a396 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb93c expref: 80 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698643:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826299.698645:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826299.698649:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349a396 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb93c expref: 80 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.698657:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:0.0:1787826299.698694:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84181:x1874668789673216:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 17330us (17846us total) trans 8590016233 rc 301/301 00000100:00100000:0.0:1787826299.698702:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111079 00000100:00100000:0.0:1787826299.703814:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.703820:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03da40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778609280:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.703849:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 3/0,1 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.703875:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.703906:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789674368 00000100:00100000:0.0:1787826299.703912:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789674368 00000100:00100000:0.0:1787826299.703958:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111083 00000100:00100000:0.0:1787826299.703967:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84182:x1874668789674368:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.703988:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.704007:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a3b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb94a expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.704166:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.704181:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb935 expref: 80 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.704189:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.704222:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb935 expref: 80 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.704235:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb935 expref: 80 pid: 23845 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.704248:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8c780 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778609408:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.704320:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.704490:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789674496 00000100:00100000:2.0:1787826299.704495:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789674496 00010000:00010000:2.0:1787826299.704516:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb92e expref: 81 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.704587:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2942 00000100:00100000:2.0:1787826299.704598:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2402:x1874668789674496:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826299.704623:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.704630:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb92e expref: 81 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.704645:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb92e expref: 81 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.704645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:2.0:1787826299.704669:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349a381 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb92e expref: 81 pid: 45683 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.704683:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:2.0:1787826299.704688:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 3/0,1 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.704696:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.704704:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.704723:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826299.704750:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2402:x1874668789674496:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 156us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.704758:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2942 00010000:00010000:2.0:1787826299.704957:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.704965:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826299.704978:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x114:0x0]: returning size 0 00000004:00080000:2.0:1787826299.705118:0:25759:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb9:0x0], index 0: 0 00010000:00010000:2.0:1787826299.705212:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.705221:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.705229:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.705235:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.705240:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.705247:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.705261:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:2.0:1787826299.705264:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826299.705268:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 2/0,0 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.705275:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a3ab lrc: 0/0,0 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.705315:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a3a4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb943 expref: 80 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.705324:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.705327:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826299.705330:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a3a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb943 expref: 80 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.705339:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:2.0:1787826299.705365:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84180:x1874668789673728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 10639us (12586us total) trans 8590016234 rc 301/301 00000100:00100000:2.0:1787826299.705374:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111081 00000100:00100000:3.0:1787826299.708201:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789674752 00000100:00100000:3.0:1787826299.708214:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789674752 00000100:00100000:3.0:1787826299.708266:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2602 00000100:00100000:3.0:1787826299.708276:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84181:x1874668789674752:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.708555:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84181:x1874668789674752:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 279us (3912us total) trans 8590016235 rc 0/0 00000100:00100000:3.0:1787826299.708563:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2602 00000100:00100000:3.0:1787826299.709995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.710267:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789675008 00000100:00100000:2.0:1787826299.710274:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789675008 00000100:00100000:2.0:1787826299.710318:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2603 00000100:00100000:2.0:1787826299.710327:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf123d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84180:x1874668789675008:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.710723:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8c780 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778609408:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.710748:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.711021:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.711643:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf123d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84180:x1874668789675008:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1314us (1651us total) trans 8590016236 rc 0/0 00000100:00100000:2.0:1787826299.711656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2603 00000100:00100000:1.0:1787826299.712470:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789675136 00000100:00100000:1.0:1787826299.712479:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789675136 00010000:00010000:1.0:1787826299.712512:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb935 expref: 81 pid: 23845 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.712541:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2943 00000100:00100000:1.0:1787826299.712550:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2399:x1874668789675136:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826299.712563:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.712570:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb935 expref: 81 pid: 23845 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.712583:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb935 expref: 81 pid: 23845 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.712606:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a38f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb935 expref: 81 pid: 23845 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.712627:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:1.0:1787826299.712633:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.712642:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.712649:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.712672:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826299.712714:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2399:x1874668789675136:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 165us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.712721:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2943 00010000:00010000:1.0:1787826299.712745:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.712751:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.712766:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x115:0x0]: returning size 0 00000004:00080000:1.0:1787826299.713004:0:25756:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xba:0x0], index 1: 0 00010000:00010000:1.0:1787826299.713217:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.713227:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.713235:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.713243:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.713247:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.713255:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.713264:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:1.0:1787826299.713267:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826299.713271:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.713277:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a3c0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.713388:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a3b9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb94a expref: 80 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.713400:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826299.713403:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826299.713407:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a3b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb94a expref: 80 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.713418:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:1.0:1787826299.714169:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84182:x1874668789674368:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 10200us (10362us total) trans 8590016237 rc 301/301 00000100:00100000:1.0:1787826299.714178:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111083 00000100:00100000:1.0:1787826299.714242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.714458:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789675264 00000100:00100000:2.0:1787826299.714465:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789675264 00000100:00100000:2.0:1787826299.714510:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111084 00000100:00100000:2.0:1787826299.714518:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84181:x1874668789675264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.714534:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.714552:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a3d5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb951 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.714624:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a3dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.714636:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.714646:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826299.714676:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x113:0x0]: returning size 0 00000004:00200000:2.0:1787826299.714680:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826299.714696:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.714719:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a3d5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb951 expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.714733:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a3dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb951 expref: 80 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.714746:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:2.0:1787826299.714749:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826299.714752:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:2.0:1787826299.714784:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84181:x1874668789675264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 267us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.714791:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111084 00000100:00100000:1.0:1787826299.716525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.717010:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789675392 00000100:00100000:3.0:1787826299.717020:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789675392 00000100:00100000:3.0:1787826299.717589:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111085 00000100:00100000:3.0:1787826299.717601:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84180:x1874668789675392:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.717625:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.717644:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a3e3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb958 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.717703:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a3ea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.717717:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a3ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.717728:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a3ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.717765:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x114:0x0]: returning size 0 00000004:00200000:3.0:1787826299.717769:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826299.717785:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a3ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.717811:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a3e3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb958 expref: 82 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.717839:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a3ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb958 expref: 81 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.717875:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:3.0:1787826299.717879:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826299.717883:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826299.717944:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84180:x1874668789675392:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 346us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.717952:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111085 00000100:00100000:2.0:1787826299.718215:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.719635:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789675648 00000100:00100000:3.0:1787826299.719645:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789675648 00000100:00100000:3.0:1787826299.719696:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2604 00000100:00100000:3.0:1787826299.719704:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84182:x1874668789675648:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.719999:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.720028:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789675776 00000100:00100000:2.0:1787826299.720032:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789675776 00000100:00100000:2.0:1787826299.720066:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6165 00000100:00100000:2.0:1787826299.720074:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789675776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.720084:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787826299.720105:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84182:x1874668789675648:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 327us (1816us total) trans 8590016238 rc 0/0 00000100:00100000:3.0:1787826299.720115:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2604 00010000:00010000:2.0:1787826299.720372:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb95f expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826299.720399:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826299.720416:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:2.0:1787826299.720431:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.720441:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb95f expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.720459:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb95f expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.720478:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:2.0:1787826299.720503:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789675776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 430us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.720510:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6165 00000100:00100000:3.0:1787826299.724210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.724299:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789675904 00000100:00100000:2.0:1787826299.724314:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789675904 00000100:00100000:2.0:1787826299.724372:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6166 00000100:00100000:2.0:1787826299.724381:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789675904:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.724399:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.724418:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb966 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826299.724455:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826299.724474:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:2.0:1787826299.724478:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.724487:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb966 expref: 13 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.724505:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb966 expref: 13 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.724518:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826299.724575:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789675904:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 195us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.724585:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6166 00000100:00100000:2.0:1787826299.726078:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.726188:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.727148:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789676032 00000100:00100000:3.0:1787826299.727159:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789676032 00000100:00100000:3.0:1787826299.727213:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789676288 00000100:00100000:3.0:1787826299.727217:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789676288 00000100:00100000:3.0:1787826299.727245:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111086 00000100:00100000:3.0:1787826299.727255:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84182:x1874668789676032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.727276:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.727295:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a3ff lrc: 2/0,0 mode: --/CR res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb96d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.727356:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a406 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.727371:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.727378:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111087 00010000:00010000:3.0:1787826299.727385:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.727394:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+84:84181:x1874668789676288:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000004:00200000:3.0:1787826299.727444:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x115:0x0]: returning size 0 00000004:00200000:3.0:1787826299.727449:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826299.727468:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.727490:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+85:84181:x1874668789676288:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 101us (1301us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826299.727495:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a3ff lrc: 0/0,0 mode: --/CR res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb96d expref: 85 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.727503:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111087 00010000:00010000:3.0:1787826299.727521:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a406 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb96d expref: 83 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.727531:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826299.727534:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826299.727539:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826299.727563:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84182:x1874668789676032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 309us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.727570:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111086 00000100:00100000:3.0:1787826299.728212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.728277:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789676544 00000100:00100000:2.0:1787826299.728283:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789676544 00000100:00100000:2.0:1787826299.728324:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111088 00000100:00100000:2.0:1787826299.728332:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84180:x1874668789676544:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.728389:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84180:x1874668789676544:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 57us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.728396:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111088 00000100:00100000:3.0:1787826299.742279:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.742325:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.742406:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789676672 00000100:00100000:2.0:1787826299.742415:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789676672 00000100:00100000:2.0:1787826299.742476:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789676800 00000100:00100000:2.0:1787826299.742480:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789676800 00000100:00100000:2.0:1787826299.742509:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6167 00000100:00100000:2.0:1787826299.742519:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84181:x1874668789676672:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.742536:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.742555:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb974 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.742594:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb95f expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.742603:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.742608:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.742613:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 12 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.742647:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb95f expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.742662:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb95f expref: 12 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.742679:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41063840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778609536:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826299.742751:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.742814:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6168 00000100:00100000:3.0:1787826299.742825:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789676800:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.742834:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.742845:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb97b expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826299.742893:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826299.742903:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=2937s v=(0 0) 00010000:00010000:3.0:1787826299.742907:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.742915:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb97b expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.742930:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb97b expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.742942:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826299.742970:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789676800:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 149us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.742977:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6168 00000100:00100000:2.0:1787826299.748329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.750962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.751084:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789677056 00000100:00100000:1.0:1787826299.751094:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789677056 00010000:00010000:1.0:1787826299.751135:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb95f expref: 13 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.751166:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2944 00000100:00100000:1.0:1787826299.751175:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789677056:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826299.751190:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.751213:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb95f expref: 13 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.751226:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb95f expref: 13 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.751251:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.751256:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.751265:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.751274:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.751311:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.751329:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778609664:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826299.751405:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caeb40 going to sleep for 11 seconds 00010000:00010000:2.0:1787826299.751641:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349a3f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb95f expref: 13 pid: 45681 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.751657:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41063840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778609536:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826299.751679:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 12 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.751696:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826299.751738:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:84181:x1874668789676672:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9221us (9471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.751747:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6167 00000100:00100000:2.0:1787826299.751769:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789676928 00000100:00100000:2.0:1787826299.751773:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789676928 00000100:00100000:0.0:1787826299.753463:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6169 00000100:00100000:0.0:1787826299.753486:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84180:x1874668789676928:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.753502:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826299.753521:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb982 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.753551:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb966 expref: 14 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.753560:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.753565:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.753570:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 4/0,0 mode: --/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.753601:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb966 expref: 14 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.753621:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb966 expref: 14 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.753636:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778609792:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.753730:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.755157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.755287:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778609664:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826299.755310:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.755335:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789677312 00000100:00100000:3.0:1787826299.755343:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789677312 00000100:00100000:0.0:1787826299.755376:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789677056:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4201us (4423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.755387:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2944 00000100:00100000:3.0:1787826299.755392:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111089 00000100:00100000:3.0:1787826299.755403:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84182:x1874668789677312:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.755478:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84182:x1874668789677312:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 78us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.755485:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111089 00000100:00100000:3.0:1787826299.761358:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.761388:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.761458:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789677568 00000100:00100000:2.0:1787826299.761466:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789677568 00000100:00100000:2.0:1787826299.761512:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6170 00000100:00100000:2.0:1787826299.761521:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84182:x1874668789677568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.761537:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.761554:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb989 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.761582:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb97b expref: 12 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.761592:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.761596:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826299.761602:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.761632:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb97b expref: 12 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.761648:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb97b expref: 12 pid: 8605 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.761662:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41063840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778609920:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826299.761736:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.761818:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789677440 00000100:00100000:1.0:1787826299.761823:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789677440 00010000:00010000:1.0:1787826299.761846:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb966 expref: 15 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.765696:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2945 00000100:00100000:1.0:1787826299.765717:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2399:x1874668789677440:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826299.765739:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.765767:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb966 expref: 15 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.765784:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb966 expref: 15 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.765812:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.765816:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.765824:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.765834:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.765903:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.765918:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778610048:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826299.765995:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae240 going to sleep for 11 seconds 00010000:00010000:0.0:1787826299.766476:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349a3f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb966 expref: 15 pid: 8430 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.766493:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778609792:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826299.766515:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.766527:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:0.0:1787826299.766573:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84180:x1874668789676928:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 13097us (18252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.766582:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6169 00000100:00100000:0.0:1787826299.770626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.770724:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789677696 00000100:00100000:1.0:1787826299.770732:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789677696 00002000:00100000:1.0:1787826299.770779:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xb9:0x0] (0->157) req@ffff9bbe0dc8c000 x1874668789677696/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/0 e 0 to 0 dl 1787826310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826299.770791:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8c000 with x1874668789677696 ext(0->157) 00002000:00010000:1.0:1787826299.770796:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0dc8c000 00000100:00100000:1.0:1787826299.770830:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1555 00000100:00100000:1.0:1787826299.770840:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789677696:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.771808:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789677696:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 965us (1188us total) trans 4294968135 rc 0/0 00000100:00100000:1.0:1787826299.771818:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1555 00002000:00100000:1.0:1787826299.771827:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xb9:0x0] (0->157) req@ffff9bbe0dc8c000 x1874668789677696/t4294968135(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/448 e 0 to 0 dl 1787826310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826299.771835:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8c000 with x1874668789677696 ext(0->157) 00002000:00010000:1.0:1787826299.771840:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0dc8c000 00000100:00100000:3.0:1787826299.772312:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41063840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778609920:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.772342:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 14 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.772359:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:3.0:1787826299.772398:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84182:x1874668789677568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 10878us (11009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.772406:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6170 00000100:00100000:3.0:1787826299.773470:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778610048:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826299.773490:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.773536:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789677440:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 7830us (12186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.773546:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2945 00000100:00100000:1.0:1787826299.773640:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.773989:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789677824 00000100:00100000:3.0:1787826299.773995:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789677824 00010000:00010000:3.0:1787826299.774095:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb97b expref: 14 pid: 8605 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.774134:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2946 00000100:00100000:3.0:1787826299.774143:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789677824:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.774157:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.774178:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb97b expref: 14 pid: 8605 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.774197:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb97b expref: 14 pid: 8605 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.774223:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349a414 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb97b expref: 14 pid: 8605 timeout: 3037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.774240:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.774245:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.774253:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.774265:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.774297:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.774405:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778610176:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826299.774520:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.775804:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.777935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.778472:0:45404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789678080 00000100:00100000:1.0:1787826299.778482:0:45404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789678080 00002000:00100000:1.0:1787826299.778530:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xb9:0x0] (0->157) req@ffff9bbe0a115e00 x1874668789678080/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/0 e 0 to 0 dl 1787826310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826299.778542:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a115e00 with x1874668789678080 ext(0->157) 00002000:00010000:1.0:1787826299.778547:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a115e00 00000100:00100000:1.0:1787826299.778579:0:45404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1556 00000100:00100000:1.0:1787826299.778588:0:45404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a115e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789678080:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.779444:0:45404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a115e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789678080:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 852us (1512us total) trans 4294968153 rc 0/0 00000100:00100000:1.0:1787826299.779454:0:45404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1556 00002000:00100000:1.0:1787826299.779464:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xb9:0x0] (0->157) req@ffff9bbe0a115e00 x1874668789678080/t4294968153(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/448 e 0 to 0 dl 1787826310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826299.779472:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a115e00 with x1874668789678080 ext(0->157) 00002000:00010000:1.0:1787826299.779477:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a115e00 00000100:00100000:3.0:1787826299.779720:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778610176:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826299.779740:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.779764:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789677824:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5623us (6126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.779772:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2946 00010000:00010000:2.0:1787826299.780453:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826299.780519:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789677952 00000100:00100000:0.0:1787826299.780526:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789677952 00000100:00100000:0.0:1787826299.780607:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111090 00000100:00100000:0.0:1787826299.780618:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84181:x1874668789677952:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787826299.782330:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016238 is committed 00000020:00080000:1.0:1787826299.782377:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe188b7cc0 refcount 2 committed 0 result 0 batchid 4294970870 00000020:00080000:1.0:1787826299.782383:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf40505800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe188b73c0 00000020:00080000:1.0:1787826299.782387:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf40505b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf41221800 00000020:00080000:1.0:1787826299.782430:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17d56300 refcount 2 committed 0 result 0 batchid 4294970869 00000020:00080000:1.0:1787826299.782434:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d56b40 00000020:00080000:1.0:1787826299.782437:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f95c200 00000020:00080000:1.0:1787826299.782448:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe1272e9c0 refcount 2 committed 0 result 0 batchid 4294970868 00000020:00080000:1.0:1787826299.782450:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf12c0f300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe1272e840 00000020:00080000:1.0:1787826299.782452:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf12c0f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f95d200 00000020:00080000:1.0:1787826299.782468:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970867 batchid updated 00000020:00080000:2.0:1787826299.782569:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970870 committed batchid 4294970867 00000020:00080000:2.0:1787826299.782642:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970867 00000100:00100000:1.0:1787826299.783088:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84181:x1874668789677952:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 2465us (7280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.783101:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111090 00010000:00010000:0.0:1787826299.783247:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783259:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783266:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783272:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.783276:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783284:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783365:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x110:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826299.783369:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.783375:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783382:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a17b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x110:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783410:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783417:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783434:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783439:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.783442:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783448:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783456:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x111:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:0.0:1787826299.783459:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.783462:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783468:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a190 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x111:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783483:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783490:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783496:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783501:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.783503:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783511:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783518:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x112:0x0].0x0 (ffff9bbe16e56300) 00010000:00010000:0.0:1787826299.783519:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.783522:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783526:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a1c1 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x112:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783540:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783546:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783553:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783558:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.783561:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783567:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783575:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:0.0:1787826299.783577:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826299.783580:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783590:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a33b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783602:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783606:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783612:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783615:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.783617:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783621:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783627:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:0.0:1787826299.783629:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826299.783631:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783637:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a365 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783646:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783652:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783660:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783665:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.783668:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783674:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783681:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826299.783684:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826299.783686:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.783692:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a388 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.784768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.784974:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789678208 00000100:00100000:1.0:1787826299.784983:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789678208 00002000:00100000:1.0:1787826299.785090:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xba:0x0] (0->157) req@ffff9bbe0a116d00 x1874668789678208/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/0 e 0 to 0 dl 1787826310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826299.785102:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a116d00 with x1874668789678208 ext(0->157) 00002000:00010000:1.0:1787826299.785108:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a116d00 00000100:00100000:1.0:1787826299.785167:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1557 00000100:00100000:1.0:1787826299.785178:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789678208:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826299.786145:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2400:x1874668789678208:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 964us (1377us total) trans 4294968136 rc 0/0 00000100:00100000:1.0:1787826299.786155:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1557 00002000:00100000:1.0:1787826299.786164:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xba:0x0] (0->157) req@ffff9bbe0a116d00 x1874668789678208/t4294968136(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:655/0 lens 648/448 e 0 to 0 dl 1787826310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826299.786174:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a116d00 with x1874668789678208 ext(0->157) 00002000:00010000:1.0:1787826299.786179:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a116d00 00000100:00100000:2.0:1787826299.794605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.796690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.797787:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.797989:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789678336 00000100:00100000:0.0:1787826299.797998:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789678336 00000100:00100000:1.0:1787826299.798113:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789678592 00000100:00100000:1.0:1787826299.798118:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789678592 00000100:00100000:1.0:1787826299.798170:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6171 00000100:00100000:1.0:1787826299.798179:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789678592:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.799290:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789678464 00000100:00100000:0.0:1787826299.799304:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789678464 00000100:00100000:0.0:1787826299.799331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111091 00000100:00100000:0.0:1787826299.799340:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84180:x1874668789678336:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.799474:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84180:x1874668789678336:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 134us (4880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.799482:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111091 00000100:00100000:0.0:1787826299.799501:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111092 00000100:00100000:0.0:1787826299.799508:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84182:x1874668789678464:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.799660:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84182:x1874668789678464:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 151us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.799666:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111092 00000001:00080000:1.0:1787826299.800401:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968136 is committed 00000001:00080000:1.0:1787826299.800415:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968134 is committed 00000100:00100000:1.0:1787826299.802081:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789678592:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 3896us (4291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.802093:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6171 00000100:00100000:2.0:1787826299.805943:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.806036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.806755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.806908:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789679104 00000100:00100000:0.0:1787826299.806917:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789679104 00000100:00100000:0.0:1787826299.806974:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111093 00000100:00100000:0.0:1787826299.806984:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84181:x1874668789679104:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.807042:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.807068:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a3dc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x113:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb951 expref: 31 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.807088:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:0.0:1787826299.807092:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826299.807118:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.807130:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.807140:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826299.807252:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f79cc09 reply state 00000000d1b02860 transno 8590016239 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.807264:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.807271:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:0.0:1787826299.807274:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826299.807277:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826299.807375:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84181:x1874668789679104:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 392us (622us total) trans 8590016239 rc 0/0 00000100:00100000:0.0:1787826299.807382:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111093 00000100:00100000:1.0:1787826299.808178:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789678720 00000100:00100000:1.0:1787826299.808185:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789678720 00000100:00100000:1.0:1787826299.808232:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789678848 00000100:00100000:1.0:1787826299.808236:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789678848 00000100:00100000:1.0:1787826299.808261:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6172 00000100:00100000:1.0:1787826299.808269:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789678720:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.808417:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6173 00000100:00100000:2.0:1787826299.808437:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789678848:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.808504:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789678848:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 69us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.808513:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6173 00000001:00080000:2.0:1787826299.810105:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968153 is committed 00000001:00080000:2.0:1787826299.810122:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968152 is committed 00000100:00100000:1.0:1787826299.810307:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789678720:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2026us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.810317:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6172 00000100:00100000:0.0:1787826299.811972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.812115:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789679232 00000100:00100000:3.0:1787826299.812125:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789679232 00000100:00100000:3.0:1787826299.812215:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111094 00000100:00100000:3.0:1787826299.812225:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84181:x1874668789679232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.812246:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.812269:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb990 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.812330:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb990 expref: 33 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.812345:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb990 expref: 33 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.812363:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:3.0:1787826299.812366:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.812369:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826299.812417:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84181:x1874668789679232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 194us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.812435:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111094 00000100:00100000:2.0:1787826299.816231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.816265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.816354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.816511:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789679872 00000100:00100000:0.0:1787826299.816521:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789679872 00000100:00100000:0.0:1787826299.816579:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6174 00000100:00100000:0.0:1787826299.816588:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789679872:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826299.816750:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xb9:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826299.816754:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xb9:0x0] updating lvb mtime from disk: 0 -> 1787826218 00002000:00010000:0.0:1787826299.816757:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xb9:0x0] updating lvb atime from disk: 0 -> 1787826218 00002000:00010000:0.0:1787826299.816759:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xb9:0x0] updating lvb ctime from disk: 0 -> 1787826218 00002000:00010000:0.0:1787826299.816761:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xb9:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826299.816828:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789679872:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 229us (461us total) trans 4294968137 rc 0/0 00000100:00100000:0.0:1787826299.816837:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6174 00000100:00100000:1.0:1787826299.817452:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789679488 00000100:00100000:1.0:1787826299.817458:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789679488 00000100:00100000:1.0:1787826299.817530:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789679744 00000100:00100000:1.0:1787826299.817534:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789679744 00000100:00100000:1.0:1787826299.817563:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111095 00000100:00100000:1.0:1787826299.817571:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84182:x1874668789679488:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.817612:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.817638:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a406 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x115:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb96d expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.817655:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:1.0:1787826299.817660:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826299.817687:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.817718:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.817728:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826299.817826:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f00acc27 reply state 00000000f707a6b7 transno 8590016240 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.817839:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.817845:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:1.0:1787826299.817848:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826299.817879:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826299.817944:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84182:x1874668789679488:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 374us (1722us total) trans 8590016240 rc 0/0 00000100:00100000:1.0:1787826299.817951:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111095 00000100:00100000:1.0:1787826299.817967:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111096 00000100:00100000:1.0:1787826299.817975:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84180:x1874668789679744:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.817992:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826299.818004:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a3ea lrc: 0/0,0 mode: --/PR res: [0x200000403:0x114:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb958 expref: 34 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.818015:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:1.0:1787826299.818019:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826299.818804:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.818832:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.818841:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826299.818939:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067426e10 reply state 00000000a7bfc89d transno 8590016241 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.818951:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.818958:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:1.0:1787826299.818961:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826299.818964:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826299.819020:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84180:x1874668789679744:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1044us (2753us total) trans 8590016241 rc 0/0 00000100:00100000:1.0:1787826299.819515:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111096 00000100:00100000:1.0:1787826299.820495:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.820535:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.820989:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789680128 00000100:00100000:3.0:1787826299.820998:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789680128 00000100:00100000:3.0:1787826299.821055:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789680256 00000100:00100000:3.0:1787826299.821058:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789680256 00000100:00100000:3.0:1787826299.821086:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111097 00000100:00100000:3.0:1787826299.821096:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84181:x1874668789680128:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.821151:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.821167:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a2 expref: 36 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.821177:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.821209:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a2 expref: 36 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.821224:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a2 expref: 36 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.821238:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778610304:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.821319:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.821337:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111098 00000100:00100000:3.0:1787826299.821344:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84182:x1874668789680256:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.821357:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.821369:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb997 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.821411:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb997 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.821435:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb997 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.821461:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826299.821464:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.821466:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc 0) 00000100:00100000:3.0:1787826299.821494:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84182:x1874668789680256:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 149us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.821500:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111098 00000100:00100000:3.0:1787826299.822265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.822396:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789680384 00000100:00100000:1.0:1787826299.822401:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789680384 00000100:00100000:1.0:1787826299.822448:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111099 00000100:00100000:1.0:1787826299.822457:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84180:x1874668789680384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.822470:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.822485:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb99e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.822525:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb99e expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.822538:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb99e expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.822551:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:1.0:1787826299.822554:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826299.822556:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:1.0:1787826299.822588:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84180:x1874668789680384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.822595:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111099 00000100:00100000:3.0:1787826299.824758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.824788:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789680512 00000100:00100000:3.0:1787826299.824795:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789680512 00010000:00010000:3.0:1787826299.824840:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a2 expref: 38 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.824896:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2947 00000100:00100000:3.0:1787826299.824905:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40516050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2400:x1874668789680512:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.824920:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.824926:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a2 expref: 38 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.824938:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a2 expref: 38 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.824959:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:3.0:1787826299.824963:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.824976:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.824984:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.825001:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826299.825157:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a318 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x113:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8a2 expref: 38 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.825175:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778610304:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.825194:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.825202:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.825207:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.825241:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.825248:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.825256:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.825261:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.825265:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.825273:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.825282:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:1.0:1787826299.825285:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826299.825288:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.825293:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a445 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.825351:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84181:x1874668789680128:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 4256us (4858us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826299.825359:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111097 00000100:00100000:3.0:1787826299.825751:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40516050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2400:x1874668789680512:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 845us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.825759:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2947 00000100:00100000:1.0:1787826299.826668:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.826720:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.826785:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789680640 00000100:00100000:3.0:1787826299.826792:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789680640 00000100:00100000:3.0:1787826299.826830:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789680768 00000100:00100000:3.0:1787826299.826833:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789680768 00000100:00100000:3.0:1787826299.826876:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6175 00000100:00100000:3.0:1787826299.826884:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789680640:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826299.827014:0:45681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xba:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826299.827018:0:45681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xba:0x0] updating lvb mtime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826299.827020:0:45681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xba:0x0] updating lvb atime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826299.827023:0:45681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xba:0x0] updating lvb ctime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826299.827025:0:45681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xba:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826299.827076:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789680640:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 192us (410us total) trans 4294968138 rc 0/0 00000100:00100000:3.0:1787826299.827084:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6175 00000100:00100000:3.0:1787826299.827099:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6176 00000100:00100000:3.0:1787826299.827107:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789680768:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826299.827183:0:45681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xb9:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826299.827186:0:45681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xb9:0x0] updating lvb mtime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826299.827188:0:45681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xb9:0x0] updating lvb atime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826299.827190:0:45681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xb9:0x0] updating lvb ctime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826299.827192:0:45681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xb9:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826299.827213:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789680768:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 107us (494us total) trans 4294968154 rc 0/0 00000100:00100000:3.0:1787826299.827220:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6176 00000100:00100000:1.0:1787826299.829651:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.829726:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789680896 00000100:00100000:3.0:1787826299.829735:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789680896 00000100:00100000:3.0:1787826299.829788:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6177 00000100:00100000:3.0:1787826299.829797:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789680896:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.829835:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.829883:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 12 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.829891:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826299.829896:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826299.829900:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.829933:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 12 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.829952:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 12 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.829965:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778610432:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.830048:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.833661:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.833716:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.833815:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789681152 00000100:00100000:1.0:1787826299.833824:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789681152 00000100:00100000:1.0:1787826299.833897:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789681408 00000100:00100000:1.0:1787826299.833901:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789681408 00000100:00100000:1.0:1787826299.833922:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111100 00000100:00100000:1.0:1787826299.833930:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84182:x1874668789681152:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.833993:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.834012:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb927 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.834022:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.834068:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb927 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.834081:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb927 expref: 37 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.834095:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778610560:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826299.834166:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.834333:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111101 00000100:00100000:2.0:1787826299.834343:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84180:x1874668789681408:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.834370:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.834382:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e1 expref: 37 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.834390:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.834410:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e1 expref: 37 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.834430:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e1 expref: 37 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.834441:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778610688:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826299.834480:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826299.834749:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778610432:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.834770:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.837671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.837751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.838040:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778610560:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.838068:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.838610:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789681536 00000100:00100000:0.0:1787826299.838617:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789681536 00010000:00010000:0.0:1787826299.838656:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 13 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.838704:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789681664 00000100:00100000:0.0:1787826299.838707:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789681664 00010000:00010000:0.0:1787826299.838722:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb927 expref: 38 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.838749:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2948 00000100:00100000:0.0:1787826299.838758:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789681536:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.838771:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.838791:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 13 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.838804:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 13 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.838828:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349a40d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb974 expref: 13 pid: 25038 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.838844:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.838875:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.838882:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.838892:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.838920:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.838966:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789681536:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 208us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.838974:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2948 00000100:00100000:0.0:1787826299.838993:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2949 00000100:00100000:0.0:1787826299.839000:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789681664:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.839009:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.839015:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb927 expref: 38 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839026:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb927 expref: 38 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839118:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a37a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x115:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb927 expref: 38 pid: 6517 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839132:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826299.839137:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839146:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839154:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839171:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.839192:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2402:x1874668789681664:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 193us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.839199:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2949 00010000:00010000:0.0:1787826299.839220:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839236:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839256:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839265:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839274:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839281:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826299.839285:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839295:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839308:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839317:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349a45a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.839367:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789680896:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 9571us (9723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.839375:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6177 00010000:00010000:0.0:1787826299.839398:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839406:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839453:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839460:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839466:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839472:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.839476:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839483:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839491:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826299.839494:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826299.839498:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.839507:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a461 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.839542:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84182:x1874668789681152:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 5613us (5891us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826299.839550:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111100 00000100:00100000:3.0:1787826299.841285:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778610688:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.841319:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.842950:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.843385:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789681792 00000100:00100000:3.0:1787826299.843394:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789681792 00010000:00010000:3.0:1787826299.843447:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e1 expref: 36 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.843489:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2950 00000100:00100000:3.0:1787826299.843499:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789681792:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.843519:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.843526:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e1 expref: 36 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.843546:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e1 expref: 36 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.843570:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a334 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x114:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb8e1 expref: 36 pid: 25756 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.843588:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:3.0:1787826299.843593:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.843603:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.843611:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.843835:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826299.846388:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.846405:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.846456:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.846465:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.846472:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.846478:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.846482:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.846490:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.846506:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:0.0:1787826299.846509:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826299.846515:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.846522:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a468 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.848414:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2401:x1874668789681792:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4905us (5459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.848438:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2950 00000100:00100000:0.0:1787826299.848548:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84180:x1874668789681408:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 14205us (14829us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826299.848558:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111101 00000100:00100000:2.0:1787826299.849546:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.849579:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.849711:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789682176 00000100:00100000:1.0:1787826299.849719:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789682176 00000100:00100000:1.0:1787826299.849771:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111102 00000100:00100000:1.0:1787826299.849780:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84181:x1874668789682176:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.849882:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.849897:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.849908:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.850070:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.850083:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb990 expref: 35 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.850091:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.850122:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb990 expref: 35 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.850137:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb990 expref: 35 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.850153:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078b40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778610816:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826299.850216:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.850234:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789681920 00000100:00100000:1.0:1787826299.850238:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789681920 00000100:00100000:1.0:1787826299.850271:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6178 00000100:00100000:1.0:1787826299.850279:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789681920:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.850314:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.850330:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.850338:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826299.850343:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826299.850348:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.850370:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.850380:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 11 pid: 8430 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.850391:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778610944:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826299.850417:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.856486:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.856544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.856577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.856637:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778610944:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.856665:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.856713:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078b40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778610816:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.856729:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.856795:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789682304 00000100:00100000:0.0:1787826299.856804:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789682304 00000100:00100000:0.0:1787826299.856876:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6179 00000100:00100000:0.0:1787826299.856885:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789682304:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826299.856925:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.856941:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.856949:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826299.856954:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.856959:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.856993:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857007:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 13 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.857023:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778611072:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826299.857094:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.857109:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789682432 00000100:00100000:0.0:1787826299.857112:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789682432 00010000:00010000:0.0:1787826299.857132:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb990 expref: 36 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.857152:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789682560 00000100:00100000:0.0:1787826299.857155:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789682560 00010000:00010000:0.0:1787826299.857167:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 12 pid: 8430 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.857185:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2951 00000100:00100000:0.0:1787826299.857191:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789682432:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.857201:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.857207:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb990 expref: 36 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857218:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb990 expref: 36 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857238:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a430 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb990 expref: 36 pid: 7736 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857253:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:0.0:1787826299.857259:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857267:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857274:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857293:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.857331:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2401:x1874668789682432:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 139us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.857338:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2951 00000100:00100000:0.0:1787826299.857356:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2952 00000100:00100000:0.0:1787826299.857364:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789682560:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.857372:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.857392:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 12 pid: 8430 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857403:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 12 pid: 8430 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857418:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349a422 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb989 expref: 12 pid: 8430 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857440:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.857443:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826299.857448:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857456:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857474:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.857497:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789682560:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 133us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.857503:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2952 00010000:00010000:0.0:1787826299.857528:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857537:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857555:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857564:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857571:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857578:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826299.857581:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857596:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857607:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857615:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349a47d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.857657:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789681920:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 7378us (8114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.857664:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6178 00010000:00010000:0.0:1787826299.857685:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.857692:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826299.857790:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016242 00000001:00080000:0.0:1787826299.857921:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016243 00000001:00080000:0.0:1787826299.857955:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016244 00000100:00100000:0.0:1787826299.858017:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778611200:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826299.858060:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.858082:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.858099:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778611200 00000100:00100000:0.0:1787826299.858103:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778611200 00000100:00100000:0.0:1787826299.858135:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295 00000100:00100000:0.0:1787826299.858143:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778611200:12345-0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826299.858203:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778611200:12345-0@lo:1000:mdt00_007.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.858211:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295 00000100:00100000:0.0:1787826299.858241:0:25759:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968134 gen 2 00000004:00080000:0.0:1787826299.858246:0:25759:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968134 committed transno 4294968134 00000100:00100000:0.0:1787826299.858263:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778611200:0@lo:1000:mdt00_007.0 00000001:00080000:0.0:1787826299.858356:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016245 00000100:00100000:0.0:1787826299.858392:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778611328:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826299.858416:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.858445:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.858458:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778611328 00000100:00100000:0.0:1787826299.858462:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778611328 00000100:00100000:0.0:1787826299.858487:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296 00000100:00100000:0.0:1787826299.858493:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778611328:12345-0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826299.858573:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25759:x1874668778611328:12345-0@lo:1000:mdt00_007.0 Request processed in 79us (155us total) trans 4294968139 rc 0/0 00000100:00100000:0.0:1787826299.858580:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296 00000100:00100000:0.0:1787826299.858611:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778611328:0@lo:1000:mdt00_007.0 00000001:00080000:0.0:1787826299.858653:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016246 00010000:00010000:0.0:1787826299.858673:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858682:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858689:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858695:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.858700:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858707:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858719:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:0.0:1787826299.858722:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.858726:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858733:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a476 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858754:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd600/0x68019081f34990bf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858762:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd600/0x68019081f34990bf lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858768:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd600/0x68019081f34990bf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858774:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0ddcd600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.858777:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd600/0x68019081f34990bf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858784:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd600/0x68019081f34990bf lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858797:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe1:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:0.0:1787826299.858799:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826299.858802:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd600/0x68019081f34990bf lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858809:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcd600/0x68019081f34990bf lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858827:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858838:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858846:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858876:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858883:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858889:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858895:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.858898:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858904:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858913:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe1:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:0.0:1787826299.858916:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826299.858919:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858924:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349a48b lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858935:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858942:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858948:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858954:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826299.858957:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858964:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858972:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe1:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:0.0:1787826299.858974:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826299.858977:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.858984:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a46f lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.859081:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84181:x1874668789682176:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 9300us (9499us total) trans 8590016247 rc 0/0 00000100:00100000:0.0:1787826299.859089:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111102 00000020:00080000:0.0:1787826299.859093:0:25759:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826299.867396:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.867579:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.867614:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.867728:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789682816 00000100:00100000:2.0:1787826299.867737:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789682816 00000100:00100000:2.0:1787826299.867797:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2605 00000100:00100000:2.0:1787826299.867806:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84181:x1874668789682816:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826299.868088:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x113:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826299.868124:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016248 00010000:00010000:2.0:1787826299.868158:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.868174:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.868185:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.868194:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.868201:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.868207:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.868222:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826299.868492:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84181:x1874668789682816:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 684us (2189us total) trans 8590016249 rc 0/0 00000100:00100000:2.0:1787826299.868501:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2605 00000020:00080000:2.0:1787826299.868571:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826299.868668:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826299.868676:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.868683:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826299.868687:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.868695:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.868709:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:1.0:1787826299.868712:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826299.868716:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.868723:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a492 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.868736:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826299.868738:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826299.868739:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826299.868778:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778611072:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826299.868800:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.869958:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789682944 00000100:00100000:3.0:1787826299.869966:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789682944 00010000:00010000:3.0:1787826299.869999:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 14 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.870034:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2953 00000100:00100000:3.0:1787826299.870044:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789682944:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.870061:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.870081:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 14 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870094:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 14 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870115:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0cb3896/0x68019081f349a41b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb982 expref: 14 pid: 8433 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870129:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826299.870133:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826299.870138:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870148:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870208:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.870248:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789682944:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 206us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.870254:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2953 00000100:00100000:3.0:1787826299.870278:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789683200 00000100:00100000:3.0:1787826299.870281:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789683200 00000100:00100000:3.0:1787826299.870319:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111103 00000100:00100000:3.0:1787826299.870325:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84182:x1874668789683200:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.870383:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870394:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870403:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870702:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870715:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb997 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870722:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870749:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb997 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.870762:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb997 expref: 42 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.870775:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778611456:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.870836:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.876162:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.877519:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789683328 00000100:00100000:0.0:1787826299.877531:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789683328 00010000:00010000:0.0:1787826299.877575:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb997 expref: 43 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826299.877622:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2954 00000100:00100000:0.0:1787826299.877632:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40514050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2402:x1874668789683328:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826299.877650:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826299.877656:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb997 expref: 43 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.877669:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb997 expref: 43 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.877693:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826299.877698:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.877707:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.877720:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826299.877740:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826299.877796:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40514050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2402:x1874668789683328:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 165us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.877805:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2954 00010000:00010000:1.0:1787826299.878326:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.878339:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.878364:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.878373:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.878382:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.878388:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826299.878393:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.878401:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.878430:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.878438:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349a484 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.878636:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349a44c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb997 expref: 42 pid: 6516 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.878650:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778611456:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826299.878670:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.878678:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.878684:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826299.878804:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016250 00000001:00080000:2.0:1787826299.878958:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016251 00000001:00080000:2.0:1787826299.878995:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016252 00000100:00100000:2.0:1787826299.879071:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09794000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778611584:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826299.879125:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826299.879159:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826299.879234:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778611584 00000100:00100000:1.0:1787826299.879240:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778611584 00000100:00100000:1.0:1787826299.879287:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297 00000100:00100000:1.0:1787826299.879295:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09794f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7736:x1874668778611584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826299.879382:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09794f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7736:x1874668778611584:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.879389:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297 00000100:00100000:1.0:1787826299.879432:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09794000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778611584:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787826299.879544:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016253 00000100:00100000:1.0:1787826299.879581:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778611712:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826299.879608:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826299.879631:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.880004:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778611712 00000100:00100000:2.0:1787826299.880008:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778611712 00000100:00100000:2.0:1787826299.880041:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3298 00000100:00100000:2.0:1787826299.880048:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7736:x1874668778611712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826299.880143:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7736:x1874668778611712:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (534us total) trans 4294968140 rc 0/0 00000100:00100000:2.0:1787826299.880150:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3298 00000100:00100000:1.0:1787826299.880330:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778611712:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787826299.880383:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016254 00010000:00010000:1.0:1787826299.880404:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880413:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880436:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880442:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.880446:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880453:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880468:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:1.0:1787826299.880470:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826299.880474:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880481:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349a4a0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880505:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f34990c6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880609:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f34990c6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880615:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f34990c6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880620:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceaa00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.880623:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f34990c6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880633:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f34990c6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880642:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe2:0x0].0x0 (ffff9bbe0bd66200) 00010000:00010000:1.0:1787826299.880644:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826299.880647:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f34990c6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880652:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f34990c6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880672:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880684:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880704:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880711:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880717:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880722:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880726:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.880729:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880736:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880743:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe2:0x0].0x0 (ffff9bbe0bd66200) 00010000:00010000:1.0:1787826299.880745:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.880747:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880752:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4a7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880761:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880767:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880773:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880778:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.880781:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880787:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880795:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe2:0x0].0x0 (ffff9bbe0bd66200) 00010000:00010000:1.0:1787826299.880797:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826299.880800:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.880811:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349a499 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.881048:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84182:x1874668789683200:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 10721us (13431us total) trans 8590016255 rc 0/0 00000100:00100000:1.0:1787826299.881057:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111103 00000020:00080000:1.0:1787826299.881061:0:7736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:2.0:1787826299.881171:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789682304:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 24287us (24696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.881180:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6179 00000100:00100000:2.0:1787826299.886685:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.886757:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789683584 00000100:00100000:3.0:1787826299.886766:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789683584 00000100:00100000:3.0:1787826299.886825:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111104 00000100:00100000:3.0:1787826299.886835:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84180:x1874668789683584:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.886952:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.886969:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.886980:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.887194:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.887206:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb99e expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.887215:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.887244:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb99e expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.887257:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb99e expref: 47 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.887270:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778611840:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826299.887352:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826299.887534:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.887762:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789683840 00000100:00100000:3.0:1787826299.887768:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789683840 00000100:00100000:3.0:1787826299.887807:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2606 00000100:00100000:3.0:1787826299.887817:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84182:x1874668789683840:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787826299.888006:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x115:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826299.888037:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016257 00010000:00010000:3.0:1787826299.888063:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.888074:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.888083:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.888091:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.888098:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.888104:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.888124:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826299.888191:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84182:x1874668789683840:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 375us (658us total) trans 8590016258 rc 0/0 00000100:00100000:3.0:1787826299.888199:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2606 00000020:00080000:3.0:1787826299.888204:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826299.888270:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826299.888277:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.888284:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826299.888288:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.888296:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.888309:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:1.0:1787826299.888312:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826299.888316:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 1/0,0 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.888322:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349a4bc lrc: 0/0,0 mode: --/PW res: [0x200000403:0x115:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.888333:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826299.888334:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826299.888336:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826299.890799:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778611840:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826299.890827:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.894159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.894243:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789683968 00000100:00100000:3.0:1787826299.894253:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789683968 00010000:00010000:3.0:1787826299.894293:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb99e expref: 50 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.894333:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2955 00000100:00100000:3.0:1787826299.894343:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09794000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2401:x1874668789683968:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826299.894359:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.894366:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb99e expref: 50 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.894381:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb99e expref: 50 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.894452:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a453 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb99e expref: 50 pid: 6515 timeout: 3037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.894470:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:3.0:1787826299.894475:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.894485:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.894493:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.894530:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826299.894579:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09794000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2401:x1874668789683968:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 237us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.894589:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2955 00010000:00010000:1.0:1787826299.895186:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.895197:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826299.895302:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016256 00000001:00080000:1.0:1787826299.895412:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016259 00000001:00080000:1.0:1787826299.895456:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016260 00000100:00100000:1.0:1787826299.895616:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778611968:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1787826299.895671:0:45682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826299.895706:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.895759:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778611968 00000100:00100000:2.0:1787826299.895765:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778611968 00000100:00100000:2.0:1787826299.895810:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299 00000100:00100000:2.0:1787826299.895818:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45682:x1874668778611968:12345-0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1787826299.895927:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45682:x1874668778611968:12345-0@lo:1000:mdt00_008.0 Request processed in 109us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.895934:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299 00000100:00100000:3.0:1787826299.896009:0:45682:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968152 gen 2 00000004:00080000:3.0:1787826299.896015:0:45682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968150 committed transno 4294968152 00000004:00080000:3.0:1787826299.896033:0:45682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968152 committed transno 4294968152 00000100:00100000:3.0:1787826299.896047:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778611968:0@lo:1000:mdt00_008.0 00000001:00080000:3.0:1787826299.896149:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016261 00000100:00100000:3.0:1787826299.896189:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778612096:0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1787826299.896214:0:45682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826299.896236:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.896274:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778612096 00000100:00100000:2.0:1787826299.896278:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778612096 00000100:00100000:2.0:1787826299.896311:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300 00000100:00100000:2.0:1787826299.896318:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45682:x1874668778612096:12345-0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1787826299.896407:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778612096:12345-0@lo:1000:mdt00_008.0 Request processed in 89us (190us total) trans 4294968155 rc 0/0 00000100:00100000:2.0:1787826299.896414:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300 00000100:00100000:3.0:1787826299.896486:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778612096:0@lo:1000:mdt00_008.0 00000001:00080000:3.0:1787826299.896544:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016262 00010000:00010000:3.0:1787826299.896565:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896574:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896582:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896588:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.896593:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896601:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896614:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:3.0:1787826299.896617:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.896621:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896628:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a4b5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896650:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcca00/0x68019081f34990b8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896656:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcca00/0x68019081f34990b8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896662:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcca00/0x68019081f34990b8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896668:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0ddcca00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.896671:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcca00/0x68019081f34990b8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896677:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcca00/0x68019081f34990b8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896685:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe0:0x0].0x0 (ffff9bbf41389600) 00010000:00010000:3.0:1787826299.896687:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.896690:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcca00/0x68019081f34990b8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896696:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0ddcca00/0x68019081f34990b8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896716:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896732:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896741:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896748:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896753:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896759:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896764:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.896767:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896772:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896780:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe0:0x0].0x0 (ffff9bbf41389600) 00010000:00010000:3.0:1787826299.896783:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.896786:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896792:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a4c3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896801:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896807:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896813:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896818:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.896821:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896826:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896832:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe0:0x0].0x0 (ffff9bbf41389600) 00010000:00010000:3.0:1787826299.896834:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826299.896837:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.896841:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a4ae lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.896969:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84180:x1874668789683584:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 10135us (10294us total) trans 8590016263 rc 0/0 00000100:00100000:3.0:1787826299.896978:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111104 00000020:00080000:3.0:1787826299.896982:0:45682:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787826299.897175:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826299.897179:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826299.897295:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9676 count 103 00000040:00080000:2.0:1787826299.897303:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787826299.897402:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778612224:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787826299.897454:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826299.900823:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.900927:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789684224 00000100:00100000:3.0:1787826299.900936:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789684224 00000100:00100000:3.0:1787826299.900986:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2607 00000100:00100000:3.0:1787826299.900995:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84180:x1874668789684224:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787826299.901230:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x114:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826299.901260:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016264 00010000:00010000:3.0:1787826299.901291:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 3/0,1 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.901308:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.901319:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.901327:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.901334:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.901339:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.901366:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826299.901454:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84180:x1874668789684224:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 459us (640us total) trans 8590016265 rc 0/0 00000100:00100000:3.0:1787826299.901462:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2607 00000020:00080000:3.0:1787826299.901467:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787826299.901571:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778612224:192.168.203.9@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1787826299.901744:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826299.901751:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.901758:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826299.901763:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.901770:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.901783:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:2.0:1787826299.901787:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826299.901791:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 1/0,0 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.901797:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349a4ca lrc: 0/0,0 mode: --/PW res: [0x200000403:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.901810:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826299.901812:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826299.901813:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826299.902932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.902963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.902986:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.903011:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789684352 00000100:00100000:0.0:1787826299.903017:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789684352 00000100:00100000:0.0:1787826299.903056:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789684480 00000100:00100000:0.0:1787826299.903059:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789684480 00000100:00100000:0.0:1787826299.903078:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789684608 00000100:00100000:0.0:1787826299.903080:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789684608 00000100:00100000:0.0:1787826299.903098:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111105 00000100:00100000:0.0:1787826299.903107:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84188:x1874668789684352:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826299.903136:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe3:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826299.903225:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84188:x1874668789684352:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.903233:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111105 00000100:00100000:0.0:1787826299.903249:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111106 00000100:00100000:0.0:1787826299.903255:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84190:x1874668789684480:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826299.903268:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826299.903306:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84190:x1874668789684480:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.903312:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111106 00000100:00100000:0.0:1787826299.903325:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111107 00000100:00100000:0.0:1787826299.903331:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84189:x1874668789684608:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826299.903343:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826299.903380:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84189:x1874668789684608:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.903387:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111107 00000100:00100000:2.0:1787826299.909106:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.909145:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.909176:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.909223:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789684736 00000100:00100000:1.0:1787826299.909234:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789684736 00000100:00100000:1.0:1787826299.909298:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789684864 00000100:00100000:1.0:1787826299.909301:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789684864 00000100:00100000:1.0:1787826299.909317:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789684992 00000100:00100000:1.0:1787826299.909320:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789684992 00000100:00100000:1.0:1787826299.909338:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111108 00000100:00100000:1.0:1787826299.909347:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84189:x1874668789684736:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.909439:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909456:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909468:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909484:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909495:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909501:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909539:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909548:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909554:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.909603:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe4:0x0]: returning size 158 00000004:00200000:1.0:1787826299.909608:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826299.909621:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909633:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909640:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909646:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909652:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909662:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.909666:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909674:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909686:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826299.909689:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.909694:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909700:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a4d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909718:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909724:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909729:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909734:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.909736:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909743:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909753:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x1028b9c6 (ffff9bbe16e56f00) 00010000:00010000:1.0:1787826299.909755:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.909758:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909763:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a4d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1028b9c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909776:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909782:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909789:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909794:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.909796:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909801:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909808:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe4:0x0].0x0 (ffff9bbe0bd66d00) 00010000:00010000:1.0:1787826299.909810:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.909813:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.909817:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a4df lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.909930:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84189:x1874668789684736:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 583us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.909939:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111108 00000100:00100000:1.0:1787826299.909959:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111109 00000100:00100000:1.0:1787826299.909967:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84190:x1874668789684864:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.909992:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910001:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910009:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910019:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910027:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910033:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910049:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910056:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910062:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.910082:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe5:0x0]: returning size 158 00000004:00200000:1.0:1787826299.910085:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826299.910092:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910101:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910107:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910114:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910120:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910126:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.910129:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910135:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910143:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826299.910145:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.910148:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910154:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a4e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910168:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910174:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910180:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910185:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.910188:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910195:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910202:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x1dc009bb (ffff9bbe16e56000) 00010000:00010000:1.0:1787826299.910204:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.910207:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910213:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a4ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1dc009bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910223:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910230:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910235:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910240:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.910242:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910247:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910254:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe5:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:1.0:1787826299.910256:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.910260:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910266:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a4f4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.910295:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84190:x1874668789684864:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 329us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.910302:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111109 00000100:00100000:1.0:1787826299.910315:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111110 00000100:00100000:1.0:1787826299.910322:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84188:x1874668789684992:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.910347:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910356:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910363:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910378:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910384:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910390:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910406:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910413:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910429:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.910449:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe3:0x0]: returning size 158 00000004:00200000:1.0:1787826299.910453:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826299.910459:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910467:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910473:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910478:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910487:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910492:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.910494:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910502:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910511:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826299.910513:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.910516:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910522:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a4fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910531:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910537:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910542:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910547:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.910550:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910560:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910567:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4a6859f1 (ffff9bbe16e56200) 00010000:00010000:1.0:1787826299.910569:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.910571:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910577:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a502 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4a6859f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910588:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910594:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910600:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910605:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826299.910607:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910613:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910619:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe3:0x0].0x0 (ffff9bbe0bd66900) 00010000:00010000:1.0:1787826299.910622:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826299.910624:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.910634:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a509 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.910666:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84188:x1874668789684992:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 343us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.910673:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111110 00000100:00100000:2.0:1787826299.914673:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.914713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.914746:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.914891:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789685248 00000100:00100000:3.0:1787826299.914901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789685248 00000100:00100000:3.0:1787826299.914953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789685504 00000100:00100000:3.0:1787826299.914956:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789685504 00000100:00100000:3.0:1787826299.914973:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789685760 00000100:00100000:3.0:1787826299.914975:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789685760 00000100:00100000:3.0:1787826299.914993:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111111 00000100:00100000:3.0:1787826299.915002:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84190:x1874668789685248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.915022:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.915043:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a510 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb9a5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915153:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915170:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915182:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.915193:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe5:0x0]: returning size 158 00010000:00010000:3.0:1787826299.915260:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915268:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915275:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915281:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.915285:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915292:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915307:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe5:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:3.0:1787826299.915310:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826299.915315:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915320:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a517 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915374:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a510 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9a5 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915384:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826299.915386:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826299.915390:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a510 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9a5 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915399:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826299.915472:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84190:x1874668789685248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 470us (807us total) trans 8590016266 rc 301/301 00000100:00100000:3.0:1787826299.915479:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111111 00000100:00100000:3.0:1787826299.915499:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111112 00000100:00100000:3.0:1787826299.915518:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84189:x1874668789685504:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.915526:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.915535:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a525 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915577:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915587:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915594:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.915602:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe4:0x0]: returning size 158 00010000:00010000:3.0:1787826299.915631:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915638:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915644:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915648:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.915651:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915656:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915664:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe4:0x0].0x0 (ffff9bbe0bd66d00) 00010000:00010000:3.0:1787826299.915667:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826299.915670:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915676:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a52c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915702:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a525 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9ac expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915711:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826299.915714:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826299.915717:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a525 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9ac expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915725:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826299.915750:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84189:x1874668789685504:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 244us (1036us total) trans 8590016267 rc 301/301 00000100:00100000:3.0:1787826299.915756:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111112 00000100:00100000:3.0:1787826299.915770:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111113 00000100:00100000:3.0:1787826299.915778:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84188:x1874668789685760:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.915785:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.915794:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a53a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb9b3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915840:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.915874:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916022:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826299.916035:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe3:0x0]: returning size 158 00010000:00010000:3.0:1787826299.916069:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916076:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916082:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916087:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.916091:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916097:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916106:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe3:0x0].0x0 (ffff9bbe0bd66900) 00010000:00010000:3.0:1787826299.916109:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826299.916112:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916118:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a541 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916142:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a53a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9b3 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916151:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826299.916153:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826299.916157:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a53a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9b3 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.916166:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826299.916188:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84188:x1874668789685760:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 411us (1442us total) trans 8590016268 rc 301/301 00000100:00100000:3.0:1787826299.916195:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111113 00000100:00100000:0.0:1787826299.921774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.921812:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.921910:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.921947:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789685888 00000100:00100000:2.0:1787826299.921956:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789685888 00000100:00100000:2.0:1787826299.922015:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111114 00000100:00100000:0.0:1787826299.922085:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789686016 00000100:00100000:0.0:1787826299.922090:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789686016 00000100:00100000:0.0:1787826299.922117:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789686144 00000100:00100000:0.0:1787826299.922120:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789686144 00000100:00100000:0.0:1787826299.922138:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111115 00000100:00100000:0.0:1787826299.922145:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84190:x1874668789686016:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826299.922178:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826299.922286:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84190:x1874668789686016:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 141us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.922295:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111115 00000100:00100000:0.0:1787826299.922322:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111116 00000100:00100000:2.0:1787826299.922328:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84188:x1874668789685888:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000100:00100000:0.0:1787826299.922330:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84189:x1874668789686144:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826299.922346:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe4:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1787826299.922346:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe3:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826299.922385:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84189:x1874668789686144:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 56us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.922388:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84188:x1874668789685888:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 366us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.922392:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111116 00000100:00100000:2.0:1787826299.922397:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111114 00000100:00100000:3.0:1787826299.926693:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.928619:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789686400 00000100:00100000:2.0:1787826299.928632:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789686400 00000100:00100000:2.0:1787826299.928708:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111117 00000100:00100000:2.0:1787826299.928719:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84190:x1874668789686400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.928739:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.928763:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a54f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb9ba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.929741:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a556 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.929756:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a556 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.929764:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a556 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826299.929773:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x116:0x0]: returning size 0 00010000:00010000:2.0:1787826299.929816:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a54f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9ba expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.929834:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a556 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9ba expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.929842:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:2.0:1787826299.929845:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826299.929848:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2e00, rc 0) 00000100:00100000:2.0:1787826299.929971:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84190:x1874668789686400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1255us (3287us total) trans 8590016269 rc 0/0 00000100:00100000:2.0:1787826299.929979:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111117 00000100:00100000:0.0:1787826299.936945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.937141:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789686656 00000100:00100000:1.0:1787826299.937152:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789686656 00000100:00100000:1.0:1787826299.937211:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111118 00000100:00100000:1.0:1787826299.937222:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84188:x1874668789686656:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.937244:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.937266:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a564 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb9c1 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.937763:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a56b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.937777:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a56b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.937787:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a56b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.937797:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x117:0x0]: returning size 0 00010000:00010000:1.0:1787826299.937839:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a564 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9c1 expref: 63 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.938100:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a56b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9c1 expref: 62 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.939593:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe16e56200) 00010000:00010000:1.0:1787826299.939601:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826299.939607:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:2.0:1787826299.940347:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84188:x1874668789686656:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 3120us (3404us total) trans 8590016270 rc 0/0 00000100:00100000:2.0:1787826299.940357:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111118 00000100:00100000:0.0:1787826299.945278:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.945361:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789686912 00000100:00100000:2.0:1787826299.945370:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789686912 00000100:00100000:2.0:1787826299.945437:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111119 00000100:00100000:2.0:1787826299.945448:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84188:x1874668789686912:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.945507:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826299.945633:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a56b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9c1 expref: 62 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.945652:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe16e56200) 00010000:00010000:2.0:1787826299.945663:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826299.945687:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.945701:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.945711:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.945725:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.945733:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.945740:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.945788:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946844:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946874:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946881:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.946886:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946894:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946907:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.946910:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.946914:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946920:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a579 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946932:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946937:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946943:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946947:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.946950:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946955:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946962:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x55c0b97e (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826299.946964:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.946967:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.946972:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a580 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x55c0b97e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.947086:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84188:x1874668789686912:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1637us (1816us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826299.947094:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111119 00000100:00100000:3.0:1787826299.948659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.949619:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789687040 00000100:00100000:2.0:1787826299.949629:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789687040 00000100:00100000:2.0:1787826299.949681:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3301 00000100:00100000:2.0:1787826299.949691:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+61:2402:x1874668789687040:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826299.949741:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.949762:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349a587 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fb9c8 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949822:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949835:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949844:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949892:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949900:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949908:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949947:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949954:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949961:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949966:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.949970:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949982:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.949992:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.949995:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.949999:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950006:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a58e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950018:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950172:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950181:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950194:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.950197:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950204:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950212:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x7235479 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826299.950214:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.950217:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950227:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a595 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x7235479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950255:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349a587 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9c8 expref: 62 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950265:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.950267:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826299.950271:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349a587 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9c8 expref: 62 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.950280:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc -2) 00000100:00100000:2.0:1787826299.950347:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+61:2402:x1874668789687040:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 657us (1695us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826299.950355:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3301 00000100:00100000:3.0:1787826299.952911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.952956:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.952986:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789687168 00000100:00100000:3.0:1787826299.952994:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789687168 00000100:00100000:3.0:1787826299.953047:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789687424 00000100:00100000:3.0:1787826299.953051:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789687424 00000100:00100000:3.0:1787826299.953074:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111120 00000100:00100000:3.0:1787826299.953083:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84188:x1874668789687168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.953102:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.953126:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a59c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba00 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.953160:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.953173:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.953184:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.953312:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349a59c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba00 expref: 64 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.953331:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba00 expref: 63 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.953339:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826299.953342:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826299.953345:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00000100:00100000:1.0:1787826299.953458:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111121 00000100:00100000:1.0:1787826299.953469:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84189:x1874668789687424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.953479:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.953490:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a5aa lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba07 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.953906:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a5b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.953918:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.953926:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826299.953934:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x118:0x0]: returning size 0 00010000:00010000:1.0:1787826299.953975:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a5aa lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba07 expref: 66 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.953988:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba07 expref: 65 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.953996:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56000) 00010000:00010000:1.0:1787826299.953998:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826299.954001:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6800, rc 0) 00000100:00100000:3.0:1787826299.957586:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84188:x1874668789687168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4491us (4670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.957601:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111120 00000100:00100000:1.0:1787826299.958172:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84189:x1874668789687424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4702us (5211us total) trans 8590016271 rc 0/0 00000100:00100000:1.0:1787826299.958183:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111121 00000100:00100000:0.0:1787826299.960554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.961110:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789687680 00000100:00100000:3.0:1787826299.961118:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789687680 00000100:00100000:3.0:1787826299.961187:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111122 00000100:00100000:3.0:1787826299.961197:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84188:x1874668789687680:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.961284:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.961311:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.961324:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826299.961468:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaec9ee9 reply state 00000000580cda2f transno 8590016272 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.961486:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.961493:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826299.961496:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826299.961499:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826299.961594:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84188:x1874668789687680:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 399us (1047us total) trans 8590016272 rc 0/0 00000100:00100000:3.0:1787826299.961602:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111122 00000100:00100000:0.0:1787826299.966024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.966104:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789687936 00000100:00100000:2.0:1787826299.966114:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789687936 00000100:00100000:0.0:1787826299.966125:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.966173:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789688064 00000100:00100000:2.0:1787826299.966177:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789688064 00000100:00100000:2.0:1787826299.966218:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111123 00000100:00100000:2.0:1787826299.966228:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84189:x1874668789687936:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.966285:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826299.966286:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111124 00000100:00100000:1.0:1787826299.966304:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84188:x1874668789688064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.966315:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a5b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba07 expref: 67 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.966317:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.966336:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba0e expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966336:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56000) 00010000:00010000:2.0:1787826299.966350:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826299.966371:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966384:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.966389:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba0e expref: 67 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966396:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.966406:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba0e expref: 67 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966412:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.966415:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:1.0:1787826299.966431:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826299.966436:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00010000:00010000:2.0:1787826299.966437:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966447:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966487:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966494:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.966500:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84188:x1874668789688064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 201us (373us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826299.966505:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.966512:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111124 00010000:00010000:2.0:1787826299.966516:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.966522:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966529:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966539:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.966542:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.966546:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966551:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a5cd lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966560:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966565:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966570:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966575:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.966578:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966583:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966590:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xae611912 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826299.966592:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.966595:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.966600:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a5d4 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xae611912 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826299.966647:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84189:x1874668789687936:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 421us (632us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826299.966655:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111123 00000100:00100000:2.0:1787826299.968736:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.968798:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789688320 00000100:00100000:3.0:1787826299.968807:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789688320 00000100:00100000:3.0:1787826299.968886:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2608 00000100:00100000:3.0:1787826299.968896:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84188:x1874668789688320:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826299.969019:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84188:x1874668789688320:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 124us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.969026:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2608 00000100:00100000:0.0:1787826299.970063:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.970142:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789688576 00000100:00100000:3.0:1787826299.970149:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789688576 00000100:00100000:3.0:1787826299.970199:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111125 00000100:00100000:3.0:1787826299.970219:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84190:x1874668789688576:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.970262:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826299.970294:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a556 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fb9ba expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970328:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:3.0:1787826299.970341:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826299.970367:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970381:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970390:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970404:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970411:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970428:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970476:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970483:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970489:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970495:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970501:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.970505:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970517:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970525:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826299.970528:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.970532:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970538:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349a5db lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970548:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970553:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970559:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970564:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826299.970567:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970573:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970581:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xeace1368 (ffff9bbe08124300) 00010000:00010000:3.0:1787826299.970584:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826299.970588:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.970594:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a5e2 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xeace1368 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826299.970673:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84190:x1874668789688576:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 465us (614us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826299.970680:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111125 00000100:00100000:0.0:1787826299.972247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.972318:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789688704 00000100:00100000:2.0:1787826299.972326:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789688704 00000100:00100000:2.0:1787826299.972380:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3302 00000100:00100000:2.0:1787826299.972389:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+65:2401:x1874668789688704:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826299.972446:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.972463:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a5e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba1c expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972513:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972527:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972538:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972552:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972561:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972568:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972604:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972611:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972618:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972639:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.972643:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972651:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972663:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.972666:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.972670:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972677:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a5f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972688:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972694:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972699:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972705:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826299.972708:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972713:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972720:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x4234dc57 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826299.972723:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826299.972725:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972731:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a5f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x4234dc57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972758:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a5e9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba1c expref: 66 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972769:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826299.972771:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826299.972775:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a5e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba1c expref: 66 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.972785:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc -2) 00000100:00100000:2.0:1787826299.972845:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+65:2401:x1874668789688704:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 456us (605us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826299.972873:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3302 00000100:00100000:2.0:1787826299.976934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826299.977094:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789688192 00000100:00100000:1.0:1787826299.977104:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789688192 00000100:00100000:1.0:1787826299.977169:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111126 00000100:00100000:1.0:1787826299.977179:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84189:x1874668789688192:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826299.977197:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826299.977221:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a5fe lrc: 2/0,0 mode: --/PR res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba15 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.977254:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.977274:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.977286:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.977405:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a5fe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba15 expref: 67 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.977434:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba15 expref: 66 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826299.977442:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:1.0:1787826299.977444:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826299.977448:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:1.0:1787826299.977512:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84189:x1874668789688192:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 334us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.977519:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111126 00000100:00100000:0.0:1787826299.987209:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826299.987256:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.987272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789688832 00000100:00100000:2.0:1787826299.987282:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789688832 00000100:00100000:2.0:1787826299.987347:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111127 00000100:00100000:2.0:1787826299.987357:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84190:x1874668789688832:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.987376:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826299.987398:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a60c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.987401:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789689088 00000100:00100000:1.0:1787826299.987408:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789689088 00010000:00010000:2.0:1787826299.987449:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.987465:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.987479:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826299.987490:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2609 00000100:00100000:1.0:1787826299.987500:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf123d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84188:x1874668789689088:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:2.0:1787826299.987668:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a60c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba54 expref: 70 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.987686:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba54 expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826299.987695:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826299.987698:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826299.987702:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:1.0:1787826299.987707:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf123d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84188:x1874668789689088:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 206us (448us total) trans 8590016273 rc 0/0 00000100:00100000:3.0:1787826299.988000:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.988036:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789689344 00000100:00100000:3.0:1787826299.988041:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789689344 00000100:00100000:3.0:1787826299.988076:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111128 00000100:00100000:3.0:1787826299.988083:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84189:x1874668789689344:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.988129:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.988139:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.988146:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826299.988259:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ff34717 reply state 0000000022dc6257 transno 8590016274 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.988271:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.988278:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:3.0:1787826299.988280:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826299.988284:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826299.988339:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84189:x1874668789689344:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 256us (339us total) trans 8590016274 rc 0/0 00000100:00100000:3.0:1787826299.988346:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111128 00000100:00100000:2.0:1787826299.988589:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84190:x1874668789688832:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1232us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.988595:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111127 00000100:00100000:3.0:1787826299.990046:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826299.990165:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789689600 00000100:00100000:2.0:1787826299.990171:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789689600 00000100:00100000:2.0:1787826299.990218:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111129 00000100:00100000:2.0:1787826299.990227:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84188:x1874668789689600:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826299.990304:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84188:x1874668789689600:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826299.990311:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111129 00000100:00100000:3.0:1787826299.991141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.991180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826299.991211:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789689728 00000100:00100000:3.0:1787826299.991217:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789689728 00000100:00100000:3.0:1787826299.991263:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789689984 00000100:00100000:3.0:1787826299.991267:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789689984 00000100:00100000:3.0:1787826299.991465:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111130 00000100:00100000:3.0:1787826299.991480:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84189:x1874668789689728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.991495:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826299.991516:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba5b expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.991570:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba5b expref: 73 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.991586:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba5b expref: 73 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.991596:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:3.0:1787826299.991600:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826299.991603:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826299.991651:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84189:x1874668789689728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 175us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826299.991661:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111130 00000100:00100000:3.0:1787826299.991679:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111131 00000100:00100000:3.0:1787826299.991686:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84190:x1874668789689984:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826299.993473:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.993494:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.993505:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826299.993653:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007677fb8f reply state 000000001d92066b transno 8590016275 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.993666:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826299.993674:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:3.0:1787826299.993677:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826299.993680:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826299.993761:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84190:x1874668789689984:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 2072us (2579us total) trans 8590016275 rc 0/0 00000100:00100000:3.0:1787826299.993770:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111131 00000100:00100000:1.0:1787826299.999584:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2609 00000100:00100000:3.0:1787826300.002926:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.002971:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.003002:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.003460:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789690240 00000100:00100000:0.0:1787826300.003470:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789690240 00000100:00100000:0.0:1787826300.003536:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789690496 00000100:00100000:0.0:1787826300.003540:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789690496 00000100:00100000:2.0:1787826300.003551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789690368 00000100:00100000:2.0:1787826300.003557:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789690368 00000100:00100000:0.0:1787826300.003569:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111132 00000100:00100000:0.0:1787826300.003581:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84188:x1874668789690240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.003594:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2610 00010000:00010000:0.0:1787826300.003601:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787826300.003607:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84189:x1874668789690368:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.003635:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349a62f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba62 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.003719:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84189:x1874668789690368:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 116us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.003726:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2610 00010000:00010000:0.0:1787826300.003734:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.003750:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba0e expref: 75 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.003758:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111133 00010000:00010000:0.0:1787826300.003764:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.003769:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84190:x1874668789690496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.003785:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.003802:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba69 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.003803:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba0e expref: 75 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.003823:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba0e expref: 75 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.003839:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778612352:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.003881:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba69 expref: 76 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.003897:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba69 expref: 76 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.003912:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826300.003915:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.003919:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:0.0:1787826300.003927:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.003944:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84190:x1874668789690496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 177us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.003952:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111133 00000100:00080000:3.0:1787826300.003992:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826300.005819:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.005962:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789690624 00000100:00100000:1.0:1787826300.005971:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789690624 00000100:00100000:1.0:1787826300.006023:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2611 00000100:00100000:1.0:1787826300.006033:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84190:x1874668789690624:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.006141:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84190:x1874668789690624:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.006148:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2611 00000100:00100000:3.0:1787826300.007783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.007830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.007926:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789690752 00000100:00100000:2.0:1787826300.007934:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789690752 00010000:00010000:2.0:1787826300.007968:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba0e expref: 76 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.008008:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2956 00000100:00100000:2.0:1787826300.008017:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:2402:x1874668789690752:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.008029:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.008035:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba0e expref: 76 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.008048:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba0e expref: 76 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.008070:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826300.008076:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.008084:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.008096:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.008114:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.008155:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:2402:x1874668789690752:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 139us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.008162:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2956 00000100:00100000:2.0:1787826300.008188:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789691008 00000100:00100000:2.0:1787826300.008192:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789691008 00000100:00100000:2.0:1787826300.008214:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2612 00000100:00100000:2.0:1787826300.008220:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84189:x1874668789691008:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.008391:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84189:x1874668789691008:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 170us (560us total) trans 8590016276 rc 0/0 00000100:00100000:2.0:1787826300.008398:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2612 00010000:00010000:1.0:1787826300.008589:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a5c6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba0e expref: 76 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.008604:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778612352:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.008621:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008630:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008636:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.008650:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x117:0x0]: returning size 0 00000004:00080000:1.0:1787826300.008778:0:23845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xba:0x0], index 0: 0 00010000:00010000:1.0:1787826300.008885:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008893:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008899:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008904:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.008908:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008916:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008927:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:1.0:1787826300.008930:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.008935:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008941:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a636 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008980:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349a62f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba62 expref: 76 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.008989:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826300.008991:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826300.008994:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349a62f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba62 expref: 76 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.009003:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc 0) 00000100:00100000:1.0:1787826300.009030:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84188:x1874668789690240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5454us (6115us total) trans 8590016277 rc 301/301 00000100:00100000:1.0:1787826300.009040:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111132 00000100:00100000:3.0:1787826300.012372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.012521:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789691264 00000100:00100000:2.0:1787826300.012530:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789691264 00000100:00100000:2.0:1787826300.012591:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2613 00000100:00100000:2.0:1787826300.012601:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84190:x1874668789691264:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.012818:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84190:x1874668789691264:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 218us (453us total) trans 8590016278 rc 0/0 00000100:00100000:2.0:1787826300.012826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2613 00000100:00100000:3.0:1787826300.014234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.014373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.014828:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789691776 00000100:00100000:2.0:1787826300.014837:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789691776 00000100:00100000:2.0:1787826300.014908:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111134 00000100:00100000:2.0:1787826300.014917:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84189:x1874668789691776:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.015013:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84189:x1874668789691776:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 96us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.015021:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111134 00000100:00100000:3.0:1787826300.021611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.021658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.021748:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789692032 00000100:00100000:0.0:1787826300.021757:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789692032 00000100:00100000:0.0:1787826300.021819:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789692288 00000100:00100000:0.0:1787826300.021823:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789692288 00000100:00100000:0.0:1787826300.021875:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111135 00000100:00100000:0.0:1787826300.021886:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84190:x1874668789692032:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.021993:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84190:x1874668789692032:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 108us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.022001:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111135 00000100:00100000:0.0:1787826300.022019:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111136 00000100:00100000:0.0:1787826300.022026:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84189:x1874668789692288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.022036:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.022056:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a64b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba70 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.022152:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.022171:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba5b expref: 77 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.022181:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.022212:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba5b expref: 77 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.022225:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba5b expref: 77 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.022237:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778612480:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.022293:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.025447:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789691520 00000100:00100000:1.0:1787826300.025460:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789691520 00000100:00100000:3.0:1787826300.025540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.025616:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789692544 00000100:00100000:2.0:1787826300.025620:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789692544 00000100:00100000:2.0:1787826300.025672:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111137 00000100:00100000:2.0:1787826300.025682:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84190:x1874668789692544:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.025702:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.025720:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a659 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba77 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.025730:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778612480:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.025751:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.025794:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2614 00000100:00100000:0.0:1787826300.025800:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf123d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84188:x1874668789691520:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.025830:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.025844:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba69 expref: 80 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.025867:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.025895:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba69 expref: 80 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.025905:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba69 expref: 80 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.025917:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778612608:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.025986:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.025996:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf123d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84188:x1874668789691520:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 195us (11766us total) trans 8590016279 rc 0/0 00000100:00100000:0.0:1787826300.026003:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2614 00000100:00100000:3.0:1787826300.027635:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.028431:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789692672 00000100:00100000:0.0:1787826300.028440:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789692672 00010000:00010000:0.0:1787826300.028492:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba5b expref: 81 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.028716:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2957 00000100:00100000:0.0:1787826300.028726:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2401:x1874668789692672:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.028742:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.028749:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba5b expref: 81 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.028762:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba5b expref: 81 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.028784:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349a621 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba5b expref: 81 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.028800:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00000100:00100000:2.0:1787826300.029437:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778612608:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.029462:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.029672:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.029687:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.029695:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.029727:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.029786:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.029794:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.029813:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x118:0x0]: returning size 0 00000004:00080000:2.0:1787826300.029999:0:7736:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xbb:0x0], index 1: 0 00010000:00010000:2.0:1787826300.030107:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.030115:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.030122:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.030128:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.030132:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.030139:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.030152:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:2.0:1787826300.030154:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.030158:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.030164:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a652 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.030213:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a64b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba70 expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.030223:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.030225:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826300.030229:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a64b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba70 expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.030235:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2401:x1874668789692672:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1511us (2608us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826300.030239:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3c00, rc 0) 00000100:00100000:0.0:1787826300.030245:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2957 00000100:00100000:2.0:1787826300.030262:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84189:x1874668789692288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 8237us (8604us total) trans 8590016280 rc 301/301 00000100:00100000:2.0:1787826300.030270:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111136 00000100:00100000:3.0:1787826300.031253:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.031299:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.031518:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789692800 00000100:00100000:1.0:1787826300.031526:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789692800 00000100:00100000:1.0:1787826300.031577:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111138 00000100:00100000:1.0:1787826300.031585:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84188:x1874668789692800:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.031603:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.031622:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a66e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba7e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.031687:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a675 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.031709:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a675 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.031719:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a675 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.031759:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x117:0x0]: returning size 0 00000004:00200000:1.0:1787826300.031763:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826300.031778:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a675 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.031800:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a66e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba7e expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.031826:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a675 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba7e expref: 80 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.031834:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:1.0:1787826300.031836:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826300.031839:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7400, rc 0) 00000100:00100000:0.0:1787826300.031932:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789692928 00000100:00100000:0.0:1787826300.031936:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789692928 00010000:00010000:0.0:1787826300.031960:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba69 expref: 81 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.031989:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2958 00000100:00100000:0.0:1787826300.031997:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2402:x1874668789692928:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.032006:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.032012:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba69 expref: 81 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.032022:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba69 expref: 81 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.032036:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a63d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba69 expref: 81 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.032047:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826300.032051:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.032058:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.032063:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.032090:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826300.032124:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2402:x1874668789692928:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 128us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.032132:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2958 00010000:00010000:2.0:1787826300.032165:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.032174:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.032188:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x116:0x0]: returning size 0 00000004:00080000:2.0:1787826300.032304:0:25759:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xbb:0x0], index 0: 0 00010000:00010000:2.0:1787826300.032383:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.032386:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84188:x1874668789692800:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 801us (1137us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826300.032391:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.032393:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111138 00010000:00010000:2.0:1787826300.032398:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.032403:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.032406:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.032414:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.032436:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826300.032439:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.032442:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.032448:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a660 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.032483:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a659 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba77 expref: 79 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.032491:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.032493:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826300.032497:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349a659 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba77 expref: 79 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.032506:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826300.032541:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84190:x1874668789692544:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 6861us (7006us total) trans 8590016281 rc 301/301 00000100:00100000:2.0:1787826300.032552:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111137 00000100:00100000:3.0:1787826300.034999:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.035036:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.035040:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789693184 00000100:00100000:2.0:1787826300.035049:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789693184 00000100:00100000:3.0:1787826300.035077:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.035125:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789693312 00000100:00100000:2.0:1787826300.035126:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2615 00000100:00100000:0.0:1787826300.035129:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789693312 00000100:00100000:2.0:1787826300.035136:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84189:x1874668789693184:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.035159:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6180 00000100:00100000:0.0:1787826300.035164:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789693312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.035174:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.035193:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba85 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826300.035217:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826300.035230:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=2938s v=(0 0) 00010000:00010000:0.0:1787826300.035235:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.035244:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba85 expref: 13 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.035273:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba85 expref: 13 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.035285:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3600, rc 0) 00000100:00100000:1.0:1787826300.035385:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789693568 00000100:00100000:1.0:1787826300.035390:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789693568 00000100:00100000:1.0:1787826300.035454:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2616 00000100:00100000:1.0:1787826300.035462:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84190:x1874668789693568:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.035496:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84189:x1874668789693184:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 361us (506us total) trans 8590016282 rc 0/0 00000100:00100000:2.0:1787826300.035504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2615 00000100:00100000:1.0:1787826300.035575:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84190:x1874668789693568:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 114us (497us total) trans 8590016283 rc 0/0 00000100:00100000:1.0:1787826300.035582:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2616 00000100:00100000:0.0:1787826300.035641:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789693312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 475us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.035648:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6180 00000100:00100000:3.0:1787826300.039414:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.039460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.039492:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.039559:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789693824 00000100:00100000:2.0:1787826300.039559:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789693696 00000100:00100000:1.0:1787826300.039567:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789693824 00000100:00100000:2.0:1787826300.039567:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789693696 00000100:00100000:0.0:1787826300.039621:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789694080 00000100:00100000:0.0:1787826300.039625:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789694080 00000100:00100000:2.0:1787826300.039628:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111139 00000100:00100000:2.0:1787826300.039636:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84189:x1874668789693696:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.039649:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111140 00000100:00100000:0.0:1787826300.039654:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84188:x1874668789694080:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.039656:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.039675:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a68a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba8c expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.039738:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a691 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.039747:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84188:x1874668789694080:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 92us (255us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826300.039752:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a691 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.039753:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111140 00010000:00010000:2.0:1787826300.039763:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a691 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.039805:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x118:0x0]: returning size 0 00000004:00200000:2.0:1787826300.039809:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1787826300.039813:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111141 00000100:00100000:1.0:1787826300.039821:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84190:x1874668789693824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.039829:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:2.0:1787826300.039838:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a691 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.039839:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a698 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba93 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.039890:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a68a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba8c expref: 84 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.039898:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a69f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.039907:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a69f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.039907:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a691 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba8c expref: 83 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.039916:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:1.0:1787826300.039917:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a69f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.039919:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826300.039923:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000004:00200000:1.0:1787826300.039936:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x116:0x0]: returning size 0 00000004:00200000:1.0:1787826300.039938:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1787826300.039943:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84189:x1874668789693696:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 309us (538us total) trans 0 rc 0/0 00000004:00010000:1.0:1787826300.039947:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a69f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.039950:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111139 00010000:00010000:1.0:1787826300.039963:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a698 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba93 expref: 83 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.039975:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a69f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba93 expref: 82 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.039982:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:1.0:1787826300.039984:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826300.039986:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826300.040008:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84190:x1874668789693824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 189us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.040014:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111141 00000100:00100000:1.0:1787826300.042404:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.042486:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789694336 00000100:00100000:0.0:1787826300.042495:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789694336 00000100:00100000:0.0:1787826300.042549:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6181 00000100:00100000:0.0:1787826300.042559:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84188:x1874668789694336:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.042574:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.042592:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbaa1 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.042620:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba85 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.042629:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.042633:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.042639:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.042670:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba85 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.042684:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba85 expref: 14 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.042709:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778612736:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.042785:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.043295:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.043353:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789694208 00000100:00100000:1.0:1787826300.043358:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789694208 00000100:00100000:3.0:1787826300.043427:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.045516:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789694464 00000100:00100000:1.0:1787826300.045528:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789694464 00000100:00100000:3.0:1787826300.045944:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6182 00000100:00100000:3.0:1787826300.045956:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789694208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.045973:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.045992:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fba9a expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826300.046016:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826300.046033:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=2938s v=(0 0) 00010000:00010000:3.0:1787826300.046038:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.046047:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba9a expref: 11 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.046065:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba9a expref: 11 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.046077:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826300.046129:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789694208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 175us (2835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.046135:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6182 00000100:00100000:3.0:1787826300.046155:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6183 00000100:00100000:3.0:1787826300.046162:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789694464:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.046168:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.046178:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbaa8 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826300.046192:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826300.046199:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=2938s v=(0 0) 00010000:00010000:3.0:1787826300.046202:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.046207:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa8 expref: 16 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.046218:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa8 expref: 16 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.046231:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826300.046248:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789694464:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 88us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.046255:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6183 00000100:00100000:3.0:1787826300.053123:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778612736:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.053156:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 15 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.053180:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:3.0:1787826300.053241:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:84188:x1874668789694336:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 10683us (10845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.053250:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6181 00000100:00100000:0.0:1787826300.053396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.053622:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789694592 00000100:00100000:2.0:1787826300.053629:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789694592 00010000:00010000:2.0:1787826300.053662:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba85 expref: 15 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.053693:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2959 00000100:00100000:2.0:1787826300.053703:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2400:x1874668789694592:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.053717:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.053738:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba85 expref: 15 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.053751:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba85 expref: 15 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.053772:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e5ea07e/0x68019081f349a683 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba85 expref: 15 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.053791:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.053795:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.053803:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.053813:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.053844:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.053880:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778612864:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826300.053935:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.064012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.064049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.064117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.064152:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778612864:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826300.064162:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789694848 00000100:00100000:2.0:1787826300.064168:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789694848 00010000:00010000:0.0:1787826300.064175:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.064213:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789695104 00000100:00100000:2.0:1787826300.064216:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789695104 00000100:00100000:3.0:1787826300.064230:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111142 00000100:00100000:2.0:1787826300.064236:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111143 00000100:00100000:2.0:1787826300.064242:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84190:x1874668789695104:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.064247:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84189:x1874668789694848:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.064390:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789695232 00000100:00100000:1.0:1787826300.064395:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789695232 00002000:00100000:1.0:1787826300.064434:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xba:0x0] (0->157) req@ffff9bbf3fcc1a40 x1874668789695232/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/0 e 0 to 0 dl 1787826311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826300.064445:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fcc1a40 with x1874668789695232 ext(0->157) 00002000:00010000:1.0:1787826300.064450:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fcc1a40 00000100:00100000:1.0:1787826300.064470:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1558 00000100:00100000:1.0:1787826300.064477:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2400:x1874668789695232:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.065676:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2400:x1874668789694592:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 11968us (12275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.065689:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2959 00000100:00100000:0.0:1787826300.066481:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2400:x1874668789695232:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2002us (2361us total) trans 4294968156 rc 0/0 00000100:00100000:0.0:1787826300.066491:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1558 00002000:00100000:0.0:1787826300.066501:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xba:0x0] (0->157) req@ffff9bbf3fcc1a40 x1874668789695232/t4294968156(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/448 e 0 to 0 dl 1787826311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826300.066511:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fcc1a40 with x1874668789695232 ext(0->157) 00002000:00010000:0.0:1787826300.066516:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fcc1a40 00000100:00100000:2.0:1787826300.067702:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84190:x1874668789695104:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 3453us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.067716:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111143 00000100:00100000:3.0:1787826300.068535:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84189:x1874668789694848:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 4292us (4528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.068544:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111142 00000100:00100000:0.0:1787826300.068839:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.068941:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789695360 00000100:00100000:2.0:1787826300.068949:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789695360 00000100:00100000:2.0:1787826300.068989:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111144 00000100:00100000:2.0:1787826300.068998:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84188:x1874668789695360:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.071776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.071893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000001:00080000:0.0:1787826300.072339:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016283 is committed 00010000:00010000:3.0:1787826300.072434:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072445:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072456:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072466:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.072471:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072482:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072501:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x113:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:3.0:1787826300.072507:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826300.072511:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.072512:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789695488 00010000:00010000:3.0:1787826300.072517:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a429 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x113:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.072521:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789695488 00010000:00010000:3.0:1787826300.072541:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072547:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072552:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072557:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.072560:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072565:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.072569:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789695616 00000100:00100000:2.0:1787826300.072572:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789695616 00010000:00010000:3.0:1787826300.072577:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x115:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826300.072580:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826300.072583:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072589:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a437 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x115:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.072595:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6184 00000100:00100000:2.0:1787826300.072603:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+16:84190:x1874668789695488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.072603:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072608:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072613:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072617:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.072618:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.072620:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072624:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072631:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbaaf expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072631:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x114:0x0].0x0 (ffff9bbf1127fc00) 00010000:00010000:3.0:1787826300.072633:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826300.072636:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072642:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a43e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x114:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072658:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa8 expref: 17 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072663:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072667:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.072669:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072672:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.072674:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072677:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 4/0,0 mode: --/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 17 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072680:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.072683:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072688:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072698:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826300.072700:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826300.072703:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072708:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa8 expref: 17 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072711:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a5bf lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072721:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072726:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072728:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa8 expref: 17 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072733:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072738:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.072740:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.072741:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778612992:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.072746:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072752:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:3.0:1787826300.072754:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826300.072758:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072762:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a61a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072771:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072776:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072781:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072790:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.072793:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.072802:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.072811:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56600 going to sleep for 11 seconds 00010000:00010000:3.0:1787826300.072813:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00000100:00100000:2.0:1787826300.072830:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6185 00000100:00100000:2.0:1787826300.072838:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84189:x1874668789695616:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000020:00080000:0.0:1787826300.072839:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe188b70c0 refcount 2 committed 0 result 0 batchid 4294970873 00000020:00080000:0.0:1787826300.072843:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf40505e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe188b73c0 00010000:00010000:2.0:1787826300.072845:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00080000:0.0:1787826300.072846:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf40505600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0de28c00 00010000:00010000:2.0:1787826300.072873:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbab6 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826300.072881:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe16cae480 refcount 2 committed 0 result 0 batchid 4294970872 00000020:00080000:0.0:1787826300.072883:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bdb4500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16caec00 00000020:00080000:0.0:1787826300.072886:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bdb4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f048600 00010000:00010000:2.0:1787826300.072890:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba9a expref: 12 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072896:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.072900:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.072904:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072921:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba9a expref: 12 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.072931:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba9a expref: 12 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.072948:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0330c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778613120:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.072977:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56a80 going to sleep for 11 seconds 00000020:00080000:2.0:1787826300.072988:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970867 00000020:00080000:0.0:1787826300.073237:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0d062600 refcount 2 committed 0 result 0 batchid 4294970871 00000020:00080000:0.0:1787826300.073265:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09c1f200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d0629c0 00000020:00080000:0.0:1787826300.073269:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09c1f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0b938c00 00010000:00010000:3.0:1787826300.073344:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826300.073349:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.073356:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a628 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826300.073414:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970870 batchid updated 00000020:00080000:2.0:1787826300.073611:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970873 committed batchid 4294970870 00000020:00080000:2.0:1787826300.073682:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970870 00000100:00100000:3.0:1787826300.076698:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84188:x1874668789695360:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 7689us (7847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.076713:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111144 00000100:00100000:1.0:1787826300.079088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.079159:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789695744 00000100:00100000:2.0:1787826300.079167:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789695744 00000100:00100000:3.0:1787826300.079185:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0330c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778613120:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.079202:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa8 expref: 18 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.079205:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.079222:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826300.079241:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2960 00000100:00100000:2.0:1787826300.079249:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2401:x1874668789695744:12345-192.168.203.9@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787826300.079263:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:84189:x1874668789695616:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 6426us (7371us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826300.079271:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826300.079271:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6185 00010000:00010000:2.0:1787826300.079291:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa8 expref: 18 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.079303:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa8 expref: 18 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.079325:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.079329:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.079337:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 18 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.079353:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 18 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.079385:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 18 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.079398:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778613248:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826300.079455:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56300 going to sleep for 11 seconds 00010000:00010000:2.0:1787826300.079477:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349a6b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa8 expref: 18 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.079491:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778612992:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.079508:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 17 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.079517:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826300.079537:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+17:84190:x1874668789695488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 6936us (7770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.079544:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6184 00000100:00100000:1.0:1787826300.084734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.084885:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789695872 00000100:00100000:2.0:1787826300.084900:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789695872 00010000:00010000:2.0:1787826300.084949:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba9a expref: 12 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.085008:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2961 00000100:00100000:2.0:1787826300.085021:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40515050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789695872:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.085038:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.085061:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba9a expref: 12 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.085074:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba9a expref: 12 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.085101:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349a6ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba9a expref: 12 pid: 19335 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.085123:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.085127:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.085138:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.085151:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.085195:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.085214:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778613376:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826300.085311:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.093503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.093552:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.093596:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778613248:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826300.093626:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826300.093656:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789696000 00000100:00100000:0.0:1787826300.093664:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789696000 00000100:00100000:2.0:1787826300.093690:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2401:x1874668789695744:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 14441us (14611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.093699:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2960 00000100:00100000:0.0:1787826300.093711:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6186 00000100:00100000:0.0:1787826300.093719:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789696000:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.093727:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789696128 00000100:00100000:2.0:1787826300.093729:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789696128 00002000:00100000:2.0:1787826300.093748:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xbb:0x0] (0->157) req@ffff9bbe0dd2bc00 x1874668789696128/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/0 e 0 to 0 dl 1787826311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826300.093758:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dd2bc00 with x1874668789696128 ext(0->157) 00002000:00010000:2.0:1787826300.093762:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0dd2bc00 00000100:00100000:2.0:1787826300.093780:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1559 00000100:00100000:2.0:1787826300.093787:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789696128:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.093835:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778613376:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826300.093847:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.093892:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40515050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789695872:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 8875us (9168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.093899:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2961 00000100:00100000:2.0:1787826300.094904:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2402:x1874668789696128:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1113us (1346us total) trans 4294968157 rc 0/0 00000100:00100000:2.0:1787826300.094915:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1559 00002000:00100000:2.0:1787826300.094924:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xbb:0x0] (0->157) req@ffff9bbe0dd2bc00 x1874668789696128/t4294968157(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/448 e 0 to 0 dl 1787826311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826300.094933:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dd2bc00 with x1874668789696128 ext(0->157) 00002000:00010000:2.0:1787826300.094938:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0dd2bc00 00000001:00080000:0.0:1787826300.096171:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968157 is committed 00000001:00080000:0.0:1787826300.096190:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968155 is committed 00000100:00100000:2.0:1787826300.096326:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789696000:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2604us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.096335:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6186 00000100:00100000:0.0:1787826300.096473:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.097636:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789696256 00000100:00100000:3.0:1787826300.097646:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789696256 00002000:00100000:3.0:1787826300.097695:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xbb:0x0] (0->157) req@ffff9bbe073bde00 x1874668789696256/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/0 e 0 to 0 dl 1787826311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826300.097706:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe073bde00 with x1874668789696256 ext(0->157) 00002000:00010000:3.0:1787826300.097711:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe073bde00 00000100:00100000:3.0:1787826300.097751:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1560 00000100:00100000:3.0:1787826300.097760:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789696256:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.101487:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789696256:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 3717us (5003us total) trans 4294968141 rc 0/0 00000100:00100000:3.0:1787826300.101501:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1560 00002000:00100000:3.0:1787826300.101513:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xbb:0x0] (0->157) req@ffff9bbe073bde00 x1874668789696256/t4294968141(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/448 e 0 to 0 dl 1787826311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826300.101523:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe073bde00 with x1874668789696256 ext(0->157) 00002000:00010000:3.0:1787826300.101529:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe073bde00 00000100:00100000:0.0:1787826300.106893:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.106931:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.106931:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789696384 00000100:00100000:1.0:1787826300.106940:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789696384 00000100:00100000:1.0:1787826300.106996:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789696640 00000100:00100000:1.0:1787826300.106999:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789696640 00000100:00100000:1.0:1787826300.107029:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111145 00000100:00100000:1.0:1787826300.107038:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84190:x1874668789696384:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.107384:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111146 00000100:00100000:2.0:1787826300.107395:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84188:x1874668789696640:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.107440:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.107469:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a675 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x117:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba7e expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.107487:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826300.107492:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.107518:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.107532:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.107541:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826300.107652:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3be6e6d reply state 0000000057f219ba transno 8590016284 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.107664:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.107671:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826300.107673:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826300.107676:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826300.107772:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84188:x1874668789696640:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 378us (839us total) trans 8590016284 rc 0/0 00000100:00100000:1.0:1787826300.107816:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84190:x1874668789696384:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 779us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.113331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.115576:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111146 00000100:00100000:2.0:1787826300.115693:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789696768 00000100:00100000:2.0:1787826300.115703:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789696768 00000100:00100000:2.0:1787826300.115806:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111147 00000100:00100000:2.0:1787826300.115817:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84189:x1874668789696768:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.115965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84189:x1874668789696768:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 150us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.115972:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111147 00000100:00100000:1.0:1787826300.116032:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111145 00000100:00100000:3.0:1787826300.116959:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.117029:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789696896 00000100:00100000:0.0:1787826300.117036:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789696896 00000100:00100000:0.0:1787826300.117085:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111148 00000100:00100000:0.0:1787826300.117095:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84188:x1874668789696896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.117110:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.117132:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbabd expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.117182:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbabd expref: 33 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.117196:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbabd expref: 33 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.117220:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826300.117223:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.117226:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:0.0:1787826300.117270:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84188:x1874668789696896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 166us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.117277:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111148 00000100:00100000:0.0:1787826300.122430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.122472:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.122548:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789697024 00000100:00100000:1.0:1787826300.122558:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789697024 00000100:00100000:1.0:1787826300.122603:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789697152 00000100:00100000:1.0:1787826300.122605:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789697152 00000100:00100000:1.0:1787826300.122632:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6187 00000100:00100000:1.0:1787826300.122642:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789697024:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.122670:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6188 00000100:00100000:3.0:1787826300.122680:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789697152:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.122732:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789697024:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.122739:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6187 00000100:00100000:0.0:1787826300.122900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.122972:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789697280 00000100:00100000:3.0:1787826300.122977:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789697280 00000100:00100000:3.0:1787826300.123013:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6189 00000100:00100000:3.0:1787826300.123021:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789697280:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826300.123138:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xba:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826300.123141:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xba:0x0] updating lvb mtime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826300.123144:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xba:0x0] updating lvb atime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826300.123146:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xba:0x0] updating lvb ctime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826300.123148:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xba:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826300.123183:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789697280:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 163us (284us total) trans 4294968158 rc 0/0 00000100:00100000:3.0:1787826300.123190:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6189 00000100:00100000:0.0:1787826300.126518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.126621:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789697536 00000100:00100000:3.0:1787826300.126630:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789697536 00000100:00100000:3.0:1787826300.126687:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111149 00000100:00100000:3.0:1787826300.126697:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84188:x1874668789697536:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00000001:00080000:1.0:1787826300.126736:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968141 is committed 00000001:00080000:1.0:1787826300.126747:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968140 is committed 00010000:00010000:3.0:1787826300.126759:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.126775:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba00 expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.126784:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.126825:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba00 expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.126840:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba00 expref: 33 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.126881:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778613504:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826300.126951:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.128344:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.128443:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789697792 00000100:00100000:2.0:1787826300.128451:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789697792 00000100:00100000:2.0:1787826300.128501:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111150 00000100:00100000:2.0:1787826300.128510:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84190:x1874668789697792:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.128554:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.128582:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a69f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x116:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba93 expref: 34 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.128602:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826300.128606:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.128644:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 3/0,1 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.128656:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.128665:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826300.128771:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb748cc9 reply state 000000009a4009f4 transno 8590016285 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.128785:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.128792:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826300.128794:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826300.128797:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826300.128910:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84190:x1874668789697792:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 400us (571us total) trans 8590016285 rc 0/0 00000100:00100000:2.0:1787826300.128917:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111150 00000100:00100000:2.0:1787826300.129817:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.129842:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789697920 00000100:00100000:2.0:1787826300.129849:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789697920 00010000:00010000:2.0:1787826300.129898:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba00 expref: 35 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.129925:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2962 00000100:00100000:3.0:1787826300.129925:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778613504:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.129932:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2401:x1874668789697920:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.129943:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.129948:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba00 expref: 35 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.129949:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.129959:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba00 expref: 35 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.129981:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a5a3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x117:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba00 expref: 35 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.132438:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826300.132451:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.132465:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.132473:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.132490:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789697152:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 9808us (10013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.132501:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6188 00010000:00010000:2.0:1787826300.132504:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.132527:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:2401:x1874668789697920:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2595us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.132534:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2962 00000100:00100000:0.0:1787826300.132615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826300.132723:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.132731:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.132768:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.132775:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.132782:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.132787:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.132791:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.132798:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.132809:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:1.0:1787826300.132812:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826300.132816:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.132821:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a6d7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.132882:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84188:x1874668789697536:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 6186us (6371us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826300.132891:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111149 00000100:00100000:0.0:1787826300.140400:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789698048 00000100:00100000:0.0:1787826300.140414:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789698048 00000100:00100000:0.0:1787826300.140484:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111151 00000100:00100000:0.0:1787826300.141393:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84190:x1874668789698048:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.141426:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.141447:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbac4 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.141508:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbac4 expref: 34 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.141526:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbac4 expref: 34 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.141543:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826300.141546:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.141549:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3200, rc 0) 00000100:00100000:0.0:1787826300.141922:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84190:x1874668789698048:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1428us (9305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.141931:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111151 00000100:00100000:3.0:1787826300.148173:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.148497:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789698304 00000100:00100000:0.0:1787826300.148508:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789698304 00000100:00100000:0.0:1787826300.148569:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111152 00000100:00100000:0.0:1787826300.148580:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84189:x1874668789698304:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.148668:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.148699:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a691 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x118:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba8c expref: 34 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.148720:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:0.0:1787826300.148725:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826300.148758:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 3/0,1 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.148771:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.148780:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826300.148918:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d26d0963 reply state 0000000091837733 transno 8590016286 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.148930:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.148936:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:0.0:1787826300.148939:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826300.148941:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826300.149027:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84189:x1874668789698304:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 449us (862us total) trans 8590016286 rc 0/0 00000100:00100000:0.0:1787826300.149034:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111152 00000100:00100000:3.0:1787826300.149440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.150794:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789698432 00000100:00100000:0.0:1787826300.150807:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789698432 00000100:00100000:0.0:1787826300.150883:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6190 00000100:00100000:0.0:1787826300.150893:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789698432:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.150929:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.150947:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.150955:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.150959:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.150964:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.151003:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.151017:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 14 pid: 8432 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.151030:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778613632:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.151102:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.153066:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.153221:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789698560 00000100:00100000:0.0:1787826300.153232:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789698560 00000100:00100000:0.0:1787826300.153296:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6191 00000100:00100000:0.0:1787826300.153306:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789698560:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826300.153465:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xbb:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826300.153469:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xbb:0x0] updating lvb mtime from disk: 0 -> 1787826218 00002000:00010000:0.0:1787826300.153472:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xbb:0x0] updating lvb atime from disk: 0 -> 1787826218 00002000:00010000:0.0:1787826300.153474:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xbb:0x0] updating lvb ctime from disk: 0 -> 1787826218 00002000:00010000:0.0:1787826300.153476:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xbb:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826300.153536:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789698560:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 231us (476us total) trans 4294968159 rc 0/0 00000100:00100000:0.0:1787826300.153544:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6191 00000100:00100000:2.0:1787826300.154984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.155767:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789698688 00000100:00100000:0.0:1787826300.155777:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789698688 00000100:00100000:0.0:1787826300.155840:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111153 00000100:00100000:0.0:1787826300.155875:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84189:x1874668789698688:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.155899:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.155918:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbacb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.155973:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbacb expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.155988:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbacb expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.156004:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:0.0:1787826300.156007:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.156010:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2200, rc 0) 00000100:00100000:0.0:1787826300.156065:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84189:x1874668789698688:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 217us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.156072:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111153 00000100:00100000:3.0:1787826300.160044:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.160080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.160338:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778613632:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.160364:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.160869:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789698944 00000100:00100000:2.0:1787826300.160878:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789698944 00000100:00100000:2.0:1787826300.160934:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111154 00000100:00100000:2.0:1787826300.160945:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84190:x1874668789698944:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.161008:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.161022:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba54 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.161030:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.161061:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba54 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.161073:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba54 expref: 36 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.161088:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778613760:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.161162:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.162961:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789699072 00000100:00100000:0.0:1787826300.162973:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789699072 00010000:00010000:0.0:1787826300.163010:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 16 pid: 8432 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.163054:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2963 00000100:00100000:0.0:1787826300.163063:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2400:x1874668789699072:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.163077:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.163109:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 16 pid: 8432 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.163123:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 16 pid: 8432 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.163144:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a6a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaa1 expref: 16 pid: 8432 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.163159:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.163163:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.163169:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.163178:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.163201:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826300.163250:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2400:x1874668789699072:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 187us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.163268:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2963 00000100:00100000:3.0:1787826300.167317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.167353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.167670:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778613760:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.167706:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.167895:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789699200 00000100:00100000:3.0:1787826300.167902:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789699200 00000100:00100000:3.0:1787826300.167951:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6192 00000100:00100000:3.0:1787826300.167960:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2399:x1874668789699200:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826300.168103:0:45681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xbb:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826300.168106:0:45681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xbb:0x0] updating lvb mtime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826300.168109:0:45681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xbb:0x0] updating lvb atime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826300.168111:0:45681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xbb:0x0] updating lvb ctime from disk: 0 -> 1787826218 00002000:00010000:3.0:1787826300.168113:0:45681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xbb:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826300.168160:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789699200:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 201us (805us total) trans 4294968142 rc 0/0 00000100:00100000:3.0:1787826300.168166:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6192 00000100:00100000:2.0:1787826300.168392:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789699328 00000100:00100000:2.0:1787826300.168397:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789699328 00010000:00010000:2.0:1787826300.168430:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba54 expref: 37 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.168465:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2964 00000100:00100000:2.0:1787826300.168472:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2401:x1874668789699328:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.168482:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.168488:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba54 expref: 37 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168500:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba54 expref: 37 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168521:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a613 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x116:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba54 expref: 37 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168536:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826300.168541:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168550:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168561:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168591:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.168614:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789699328:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 143us (1315us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826300.168615:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.168621:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2964 00010000:00010000:2.0:1787826300.168642:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168651:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168672:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168681:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168689:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.168690:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168696:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826300.168700:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168722:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168736:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.168745:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349a6f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.168770:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.168776:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.168782:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.168783:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789698432:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 17892us (19344us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826300.168788:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00000100:00100000:2.0:1787826300.168790:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6190 00010000:00010000:0.0:1787826300.168791:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.168797:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.168806:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826300.168808:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826300.168811:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.168827:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a701 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.168883:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84190:x1874668789698944:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 7940us (8847us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826300.168892:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111154 00000100:00100000:3.0:1787826300.170828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.170905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.170944:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789699584 00000100:00100000:1.0:1787826300.170952:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789699584 00000100:00100000:1.0:1787826300.171004:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789699840 00000100:00100000:1.0:1787826300.171007:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789699840 00000100:00100000:1.0:1787826300.171031:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111155 00000100:00100000:1.0:1787826300.171040:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84188:x1874668789699584:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.171116:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.171137:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.171147:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.171192:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111156 00000100:00100000:3.0:1787826300.171201:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84189:x1874668789699840:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.171232:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.171242:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba15 expref: 36 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.171250:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 4/0,1 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.171290:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba15 expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.171312:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.171313:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba15 expref: 37 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.171322:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbabd expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.171328:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778613888:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.171334:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.171350:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbabd expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.171364:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbabd expref: 37 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.171372:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2a580 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778614016:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.171399:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.171399:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.181263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.181440:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2a580 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778614016:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.181467:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.181549:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789699968 00000100:00100000:0.0:1787826300.181556:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789699968 00000100:00100000:0.0:1787826300.181615:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6193 00000100:00100000:0.0:1787826300.181626:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789699968:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.181670:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 3/1,0 mode: --/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.181688:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.181698:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.181702:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.181708:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 4/1,0 mode: --/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.181740:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.181753:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 14 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.181944:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778613888:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.181961:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.185144:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778614144:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.185255:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.188374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.188415:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.188573:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789700224 00000100:00100000:0.0:1787826300.188580:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789700224 00000100:00100000:1.0:1787826300.188594:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778614144:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.188618:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbabd expref: 38 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.188618:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 3/1,0 mode: --/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.188660:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789700096 00000100:00100000:0.0:1787826300.188663:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789700096 00000100:00100000:1.0:1787826300.188671:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2965 00010000:00010000:0.0:1787826300.188676:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba15 expref: 39 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.188681:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789700224:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826300.188696:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826300.188703:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2966 00010000:00010000:1.0:1787826300.188703:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbabd expref: 39 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.188710:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789700096:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.188717:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.188720:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbabd expref: 39 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.188721:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba15 expref: 39 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.188730:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba15 expref: 39 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.188743:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a605 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x118:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fba15 expref: 39 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.188743:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349a6d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbabd expref: 39 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.188759:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:1.0:1787826300.188759:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826300.188764:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.188764:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.188774:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.188774:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.188783:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.188783:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.188802:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826300.188804:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826300.188882:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2401:x1874668789700096:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 172us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.188890:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2966 00010000:00010000:3.0:1787826300.189251:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.189260:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.189302:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.189310:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.189317:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.189323:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.189327:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.189334:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.189345:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:3.0:1787826300.189347:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787826300.189350:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.189356:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a70f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.189671:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789700224:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 989us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.189680:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2965 00010000:00010000:1.0:1787826300.189707:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.189714:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826300.189808:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016287 00000001:00080000:1.0:1787826300.189940:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016288 00000001:00080000:1.0:1787826300.189978:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016289 00000100:00100000:0.0:1787826300.190079:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03c780 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778614272:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826300.190129:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826300.190161:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.193180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.193316:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778614272 00000100:00100000:1.0:1787826300.193327:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778614272 00000100:00100000:1.0:1787826300.193387:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3303 00000100:00100000:1.0:1787826300.193397:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778614272:12345-0@lo:1000:mdt00_007.0 00000100:00100000:1.0:1787826300.193533:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778614272:12345-0@lo:1000:mdt00_007.0 Request processed in 138us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.193540:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3303 00000100:00100000:1.0:1787826300.193597:0:25759:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968155 gen 2 00000004:00080000:1.0:1787826300.193604:0:25759:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968155 committed transno 4294968155 00000100:00100000:1.0:1787826300.193624:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03c780 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778614272:0@lo:1000:mdt00_007.0 00000001:00080000:1.0:1787826300.193750:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016290 00000100:00100000:1.0:1787826300.193816:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2a580 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778614400:0@lo:1000:mdt00_007.0 00000100:00100000:1.0:1787826300.193870:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826300.193897:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.194272:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778614400 00000100:00100000:0.0:1787826300.194277:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778614400 00000100:00100000:0.0:1787826300.194319:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3304 00000100:00100000:0.0:1787826300.194327:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778614400:12345-0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1787826300.194442:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25759:x1874668778614400:12345-0@lo:1000:mdt00_007.0 Request processed in 116us (571us total) trans 4294968160 rc 0/0 00000100:00100000:0.0:1787826300.194449:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3304 00000100:00100000:1.0:1787826300.196314:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2a580 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778614400:0@lo:1000:mdt00_007.0 00000001:00080000:1.0:1787826300.198783:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016291 00010000:00010000:0.0:1787826300.198949:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.198961:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.198968:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.198974:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.198978:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.198991:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199007:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826300.199010:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.199015:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199021:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a716 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199047:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f34990cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199052:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f34990cd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199057:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f34990cd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199062:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.199064:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f34990cd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199069:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f34990cd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199076:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe3:0x0].0x0 (ffff9bbe0bd66900) 00010000:00010000:0.0:1787826300.199078:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.199081:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f34990cd lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199090:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f34990cd lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199113:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199125:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199133:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199140:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199146:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199152:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199157:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.199160:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199167:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199173:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe3:0x0].0x0 (ffff9bbe0bd66900) 00010000:00010000:0.0:1787826300.199175:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.199178:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199182:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a724 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199192:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199197:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199201:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199205:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.199207:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199212:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199218:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe3:0x0].0x0 (ffff9bbe0bd66900) 00010000:00010000:0.0:1787826300.199220:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826300.199222:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.199226:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a708 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.199392:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+40:84188:x1874668789699584:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 28348us (28578us total) trans 8590016292 rc 0/0 00000100:00100000:0.0:1787826300.199403:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111155 00000020:00080000:0.0:1787826300.199409:0:25759:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826300.203373:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84189:x1874668789699840:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 32158us (32453us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787826300.203388:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111156 00000100:00100000:3.0:1787826300.203445:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789700352 00000100:00100000:3.0:1787826300.203453:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789700352 00010000:00010000:3.0:1787826300.203488:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 15 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.203515:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2967 00000100:00100000:3.0:1787826300.203524:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789700352:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.203537:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.203560:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 15 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.203572:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 15 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.203593:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349a6bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaaf expref: 15 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.203610:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826300.203614:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826300.203631:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.203642:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.203674:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.203702:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789700352:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 180us (10534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.203709:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2967 00010000:00010000:1.0:1787826300.205707:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.205725:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.205755:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.205763:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.205772:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.205779:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826300.205784:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.205793:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.205810:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.205818:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349a71d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.206041:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.209485:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789699968:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 27847us (28219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.209500:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6193 00000100:00100000:3.0:1787826300.209586:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789700608 00000100:00100000:3.0:1787826300.209595:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789700608 00000100:00100000:3.0:1787826300.211523:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2617 00000100:00100000:3.0:1787826300.211541:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84188:x1874668789700608:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787826300.211789:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x117:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1787826300.212263:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.212309:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789700736 00000100:00100000:2.0:1787826300.212317:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789700736 00000100:00100000:2.0:1787826300.212362:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6194 00000100:00100000:2.0:1787826300.212371:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789700736:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.212403:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.212433:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.212442:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.212446:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826300.212452:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826300.212476:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016293 00010000:00010000:2.0:1787826300.212485:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.212501:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 10 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.212515:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778614528:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.212519:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212534:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212546:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212555:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212563:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212570:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212588:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826300.212605:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.212654:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84188:x1874668789700608:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1121us (6616us total) trans 8590016294 rc 0/0 00000100:00100000:3.0:1787826300.212662:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2617 00000020:00080000:3.0:1787826300.212666:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826300.212687:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826300.212693:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212700:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826300.212704:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212713:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212725:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826300.212728:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826300.212732:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212737:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a732 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.212748:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826300.212750:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826300.212751:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826300.215927:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778614528:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.215958:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.217358:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.217444:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789700864 00000100:00100000:2.0:1787826300.217452:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789700864 00010000:00010000:2.0:1787826300.217489:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 11 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.217531:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2968 00000100:00100000:2.0:1787826300.217541:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40517850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789700864:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.217556:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.217578:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 11 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.217597:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 11 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.217621:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349a6c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbab6 expref: 11 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.217637:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826300.217641:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826300.217647:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.217658:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.217694:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.217748:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40517850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789700864:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 208us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.217756:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2968 00010000:00010000:3.0:1787826300.217848:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.217893:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.217914:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.217924:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.217933:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.217940:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826300.217944:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.217953:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.217966:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.217975:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a72b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.218023:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789700736:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 5654us (5762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.218031:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6194 00000100:00100000:0.0:1787826300.221787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.221879:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789701120 00000100:00100000:1.0:1787826300.221897:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789701120 00000100:00100000:1.0:1787826300.221957:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111157 00000100:00100000:1.0:1787826300.221967:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84190:x1874668789701120:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.222048:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.222064:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.222076:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.222216:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.222228:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbac4 expref: 42 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.222235:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.222470:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbac4 expref: 42 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.222485:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbac4 expref: 42 pid: 12105 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.222499:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778614656:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.222583:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe131b4780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.224813:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.224948:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.225078:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789701376 00000100:00100000:0.0:1787826300.225086:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789701376 00000100:00100000:0.0:1787826300.225143:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111158 00000100:00100000:0.0:1787826300.225153:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84189:x1874668789701376:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.225174:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778614656:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.225197:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.225222:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.225235:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.225246:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.225405:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.225425:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbacb expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.225435:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 4/0,1 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.225463:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbacb expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.225475:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbacb expref: 44 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.225490:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41044f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778614784:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.225569:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.226531:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789701504 00000100:00100000:1.0:1787826300.226538:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789701504 00010000:00010000:1.0:1787826300.226569:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbac4 expref: 45 pid: 12105 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.226605:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2969 00000100:00100000:1.0:1787826300.226614:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+45:2401:x1874668789701504:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826300.226626:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.226632:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbac4 expref: 45 pid: 12105 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.226643:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbac4 expref: 45 pid: 12105 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.226663:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a6e5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbac4 expref: 45 pid: 12105 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.226678:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:1.0:1787826300.226683:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.226692:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.226700:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.226729:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826300.226777:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+44:2401:x1874668789701504:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 163us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.226784:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2969 00010000:00010000:2.0:1787826300.226788:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.226795:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826300.226900:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016295 00000001:00080000:2.0:1787826300.227003:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016297 00000001:00080000:2.0:1787826300.227038:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016298 00000100:00100000:2.0:1787826300.227122:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778614912:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1787826300.227172:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.227199:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.229198:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778614912 00000100:00100000:1.0:1787826300.229213:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778614912 00000100:00100000:2.0:1787826300.229271:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3305 00000100:00100000:2.0:1787826300.229283:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe02258c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45683:x1874668778614912:12345-0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1787826300.229429:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe02258c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45683:x1874668778614912:12345-0@lo:1000:mdt00_009.0 Request processed in 137us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.229437:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3305 00000100:00100000:3.0:1787826300.229615:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778614912:0@lo:1000:mdt00_009.0 00000001:00080000:3.0:1787826300.230039:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016299 00000100:00100000:3.0:1787826300.230150:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fe1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778615040:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1787826300.230190:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826300.230216:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.230587:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778615040 00000100:00100000:2.0:1787826300.230593:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778615040 00000100:00100000:2.0:1787826300.230647:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306 00000100:00100000:2.0:1787826300.230655:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45683:x1874668778615040:12345-0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1787826300.230779:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:45683:x1874668778615040:12345-0@lo:1000:mdt00_009.0 Request processed in 125us (589us total) trans 4294968161 rc 0/0 00000100:00100000:2.0:1787826300.230785:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306 00000100:00100000:3.0:1787826300.230967:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fe1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778615040:0@lo:1000:mdt00_009.0 00000001:00080000:3.0:1787826300.231041:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016300 00010000:00010000:3.0:1787826300.231068:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231080:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231087:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231094:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.231098:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231106:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231122:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:3.0:1787826300.231126:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.231130:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231137:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a740 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231159:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f34990db lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231166:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f34990db lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231173:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f34990db lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231178:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.231181:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f34990db lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231187:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f34990db lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231196:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe5:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:3.0:1787826300.231199:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.231202:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f34990db lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231208:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f34990db lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231230:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231242:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231250:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231256:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231262:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231269:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231274:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.231277:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231282:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231290:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe5:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:3.0:1787826300.231292:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826300.231295:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231301:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a755 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231310:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231316:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231322:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231327:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.231330:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231341:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231349:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe5:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:3.0:1787826300.231351:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826300.231354:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231359:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a739 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.231481:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84190:x1874668789701120:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 9513us (9701us total) trans 8590016301 rc 0/0 00000100:00100000:3.0:1787826300.231490:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111157 00000020:00080000:3.0:1787826300.231494:0:45683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:2.0:1787826300.231822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.231891:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789701632 00000100:00100000:3.0:1787826300.231896:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789701632 00010000:00010000:3.0:1787826300.231921:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbacb expref: 48 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.231948:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2970 00000100:00100000:3.0:1787826300.231955:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2402:x1874668789701632:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.231967:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.231972:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbacb expref: 48 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.231983:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbacb expref: 48 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.232003:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:3.0:1787826300.232007:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.232015:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.232021:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.232033:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.232059:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2402:x1874668789701632:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 105us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.232066:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2970 00010000:00010000:3.0:1787826300.232097:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349a6fa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbacb expref: 47 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.232110:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41044f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778614784:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.232127:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.232136:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.232141:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826300.232201:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016296 00000001:00080000:3.0:1787826300.232293:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016302 00000001:00080000:3.0:1787826300.232328:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016303 00000100:00100000:3.0:1787826300.232391:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778615168:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826300.232438:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826300.232458:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.232548:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778615168 00000100:00100000:2.0:1787826300.232552:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778615168 00000100:00100000:2.0:1787826300.232583:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3307 00000100:00100000:2.0:1787826300.232590:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778615168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826300.232667:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778615168:12345-0@lo:1000:mdt00_002.0 Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.232676:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3307 00000100:00100000:3.0:1787826300.233074:0:6517:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968140 gen 2 00000004:00080000:3.0:1787826300.233081:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968139 committed transno 4294968140 00000004:00080000:3.0:1787826300.233095:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968140 committed transno 4294968140 00000100:00100000:3.0:1787826300.233109:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778615168:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787826300.233212:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016304 00000100:00100000:3.0:1787826300.233258:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778615296:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826300.233287:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826300.233308:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.237637:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.238140:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778615296 00000100:00100000:0.0:1787826300.238151:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778615296 00000100:00100000:0.0:1787826300.238621:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308 00000100:00100000:0.0:1787826300.238632:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778615296:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826300.239490:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789701888 00000100:00100000:2.0:1787826300.239498:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789701888 00000100:00100000:2.0:1787826300.239542:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2618 00000100:00100000:2.0:1787826300.239551:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84190:x1874668789701888:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826300.239993:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x116:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826300.240028:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016306 00010000:00010000:2.0:1787826300.240060:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.240076:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.240088:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.240095:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.240102:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.240107:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.240126:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826300.240223:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84190:x1874668789701888:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 672us (2606us total) trans 8590016307 rc 0/0 00000100:00100000:2.0:1787826300.240231:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2618 00000020:00080000:2.0:1787826300.240238:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826300.240307:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826300.240314:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.240322:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826300.240326:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.240334:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.240337:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778615296:12345-0@lo:1000:mdt00_002.0 Request processed in 1706us (7047us total) trans 4294968143 rc 0/0 00000100:00100000:0.0:1787826300.240350:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308 00010000:00010000:1.0:1787826300.240352:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:1.0:1787826300.240356:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826300.240361:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 1/0,0 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.240367:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a75c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x116:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.240380:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826300.240382:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826300.240384:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826300.240928:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778615296:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787826300.240999:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016305 00010000:00010000:2.0:1787826300.241245:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241254:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241260:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241266:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.241271:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241276:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241286:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:2.0:1787826300.241289:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.241292:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241298:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349a74e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241321:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f34990d4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241327:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f34990d4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241336:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f34990d4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241341:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.241343:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f34990d4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241348:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f34990d4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241355:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe4:0x0].0x0 (ffff9bbe0bd66d00) 00010000:00010000:2.0:1787826300.241357:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.241360:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f34990d4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241364:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f34990d4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241382:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241390:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241398:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241404:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241409:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241414:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241430:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.241433:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241439:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241445:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe4:0x0].0x0 (ffff9bbe0bd66d00) 00010000:00010000:2.0:1787826300.241448:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.241450:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241455:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a763 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241464:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241469:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241473:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241478:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.241480:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241488:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241495:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe4:0x0].0x0 (ffff9bbe0bd66d00) 00010000:00010000:2.0:1787826300.241497:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826300.241499:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.241504:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349a747 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.241670:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84189:x1874668789701376:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 16517us (16864us total) trans 8590016308 rc 0/0 00000100:00100000:2.0:1787826300.241679:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111158 00000020:00080000:2.0:1787826300.241683:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1787826300.242330:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826300.242336:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826300.242467:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9679 count 103 00000040:00080000:1.0:1787826300.242474:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787826300.242595:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778615424:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826300.242945:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe131b4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.244593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.244738:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789702144 00000100:00100000:1.0:1787826300.244746:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789702144 00000100:00100000:1.0:1787826300.244804:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2619 00000100:00100000:1.0:1787826300.244813:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84189:x1874668789702144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787826300.245087:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x118:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826300.245116:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016309 00010000:00010000:1.0:1787826300.245150:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.245165:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.245175:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.245182:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.245188:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.245194:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.245213:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826300.245281:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84189:x1874668789702144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 469us (696us total) trans 8590016310 rc 0/0 00000100:00100000:1.0:1787826300.245289:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2619 00000020:00080000:1.0:1787826300.245293:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826300.245409:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826300.245426:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.245434:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826300.245437:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.245445:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.245457:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:3.0:1787826300.245460:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826300.245464:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 1/0,0 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.245473:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a76a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x118:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.245485:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826300.245487:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826300.245488:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826300.252633:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.252664:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.252699:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.252740:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789702272 00000100:00100000:2.0:1787826300.252749:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789702272 00000100:00100000:2.0:1787826300.252803:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789702400 00000100:00100000:2.0:1787826300.252807:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789702400 00000100:00100000:2.0:1787826300.252827:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789702528 00000100:00100000:2.0:1787826300.252830:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789702528 00000100:00100000:2.0:1787826300.252847:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111159 00000100:00100000:2.0:1787826300.252877:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84197:x1874668789702272:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826300.252907:0:25756:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe8:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826300.253024:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84197:x1874668789702272:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 150us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.253032:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111159 00000100:00100000:2.0:1787826300.253052:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111160 00000100:00100000:2.0:1787826300.253059:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84195:x1874668789702400:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826300.253074:0:25756:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe6:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826300.253099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111161 00000100:00100000:3.0:1787826300.253108:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84196:x1874668789702528:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.253115:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84195:x1874668789702400:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 56us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.253121:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111160 00000004:00000080:3.0:1787826300.253122:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826300.253169:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84196:x1874668789702528:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 63us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.253176:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111161 00000100:00100000:1.0:1787826300.253235:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778615424:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826300.259208:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.259298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.260198:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789702656 00000100:00100000:2.0:1787826300.260209:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789702656 00000100:00100000:2.0:1787826300.260264:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789702784 00000100:00100000:2.0:1787826300.260267:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789702784 00000100:00100000:2.0:1787826300.260297:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111162 00000100:00100000:2.0:1787826300.260307:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84195:x1874668789702656:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.260381:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260398:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260408:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260433:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260442:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260448:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260475:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260484:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260490:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.260532:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe6:0x0]: returning size 158 00000004:00200000:2.0:1787826300.260537:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826300.260549:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260559:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260565:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260571:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260577:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260582:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.260586:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260594:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260606:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826300.260610:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.260614:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260620:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a771 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260634:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260639:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260644:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260648:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.260650:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260656:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260662:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xe213d64b (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826300.260664:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.260667:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260672:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a778 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xe213d64b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260683:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260690:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260695:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260700:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.260703:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260708:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260716:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe6:0x0].0x0 (ffff9bbe0bd66400) 00010000:00010000:2.0:1787826300.260718:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.260721:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260727:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a77f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.260810:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84195:x1874668789702656:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 503us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.260819:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111162 00000100:00100000:2.0:1787826300.260839:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111163 00000100:00100000:2.0:1787826300.260846:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84197:x1874668789702784:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.260925:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260939:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260946:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260957:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260963:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260970:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260987:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.260994:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261001:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.261022:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe8:0x0]: returning size 158 00000004:00200000:2.0:1787826300.261025:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826300.261032:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261040:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261051:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261056:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261062:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261067:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.261070:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261075:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261083:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826300.261085:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.261088:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261093:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349a786 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261103:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261109:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261114:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261119:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.261121:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261127:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261134:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x6535d975 (ffff9bbe0fe8cb00) 00010000:00010000:2.0:1787826300.261136:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.261138:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261144:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349a78d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x6535d975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261155:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261162:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261167:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261173:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.261175:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261181:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261192:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe8:0x0].0x0 (ffff9bbe0bd66700) 00010000:00010000:2.0:1787826300.261194:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.261197:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.261201:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a794 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.261234:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84197:x1874668789702784:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 389us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.261240:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111163 00000100:00100000:0.0:1787826300.261941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.262058:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789702912 00000100:00100000:2.0:1787826300.262064:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789702912 00000100:00100000:2.0:1787826300.262106:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111164 00000100:00100000:2.0:1787826300.262113:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84196:x1874668789702912:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.262157:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262167:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262176:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262196:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262203:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262214:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262232:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262238:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262244:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.262269:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe7:0x0]: returning size 158 00000004:00200000:2.0:1787826300.262272:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826300.262281:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262290:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262296:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262302:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262308:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262314:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.262317:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262324:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262334:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826300.262337:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.262341:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262347:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a79b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262360:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262366:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262371:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262376:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.262379:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262385:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262393:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x127fc0dd (ffff9bbe0fe8cd00) 00010000:00010000:2.0:1787826300.262395:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.262398:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262407:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a7a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x127fc0dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262430:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262436:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262441:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262445:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.262453:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262459:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262467:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe7:0x0].0x0 (ffff9bbe0bd66b00) 00010000:00010000:2.0:1787826300.262469:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.262472:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.262477:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349a7a9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.262534:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84196:x1874668789702912:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 420us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.262545:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111164 00000100:00100000:3.0:1787826300.266219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.266261:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.266297:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.266372:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789703168 00000100:00100000:1.0:1787826300.266382:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789703168 00000100:00100000:1.0:1787826300.266450:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789703424 00000100:00100000:1.0:1787826300.266453:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789703424 00000100:00100000:1.0:1787826300.266473:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789703680 00000100:00100000:1.0:1787826300.266475:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789703680 00000100:00100000:1.0:1787826300.266497:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111165 00000100:00100000:1.0:1787826300.266507:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84197:x1874668789703168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.266526:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.266546:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a7b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbad2 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266648:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266663:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266673:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.266684:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe8:0x0]: returning size 158 00010000:00010000:1.0:1787826300.266759:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266766:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266773:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266779:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.266783:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266790:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266802:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe8:0x0].0x0 (ffff9bbe0bd66700) 00010000:00010000:1.0:1787826300.266805:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826300.266809:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266817:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a7b7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266883:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a7b0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbad2 expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266894:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826300.266896:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826300.266900:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a7b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbad2 expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.266909:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6800, rc 0) 00000100:00100000:1.0:1787826300.266964:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84197:x1874668789703168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 458us (755us total) trans 8590016311 rc 301/301 00000100:00100000:1.0:1787826300.266971:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111165 00000100:00100000:1.0:1787826300.266993:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111166 00000100:00100000:1.0:1787826300.266999:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84195:x1874668789703424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.267008:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.267017:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a7c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbad9 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267066:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267075:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267083:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.267090:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe6:0x0]: returning size 158 00010000:00010000:1.0:1787826300.267124:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267131:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267137:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267142:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.267145:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267150:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267159:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe6:0x0].0x0 (ffff9bbe0bd66400) 00010000:00010000:1.0:1787826300.267161:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826300.267164:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267171:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a7cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267197:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a7c5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbad9 expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267205:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826300.267208:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826300.267211:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a7c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbad9 expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267219:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:1.0:1787826300.267241:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84195:x1874668789703424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 242us (980us total) trans 8590016312 rc 301/301 00000100:00100000:1.0:1787826300.267247:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111166 00000100:00100000:1.0:1787826300.267261:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111167 00000100:00100000:1.0:1787826300.267269:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84196:x1874668789703680:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.267276:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.267284:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a7da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbae0 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267349:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267357:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267365:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.267377:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe7:0x0]: returning size 158 00010000:00010000:1.0:1787826300.267408:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267415:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267432:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267437:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.267440:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267446:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267455:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe7:0x0].0x0 (ffff9bbe0bd66b00) 00010000:00010000:1.0:1787826300.267457:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826300.267461:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267467:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a7e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267490:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a7da lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbae0 expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267499:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826300.267501:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826300.267505:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349a7da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbae0 expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.267513:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7200, rc 0) 00000100:00100000:1.0:1787826300.267536:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84196:x1874668789703680:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 268us (1238us total) trans 8590016313 rc 301/301 00000100:00100000:1.0:1787826300.267542:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111167 00000100:00100000:3.0:1787826300.271893:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.271926:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.271941:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789703808 00000100:00100000:0.0:1787826300.271951:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789703808 00000100:00100000:0.0:1787826300.272004:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789703936 00000100:00100000:0.0:1787826300.272008:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789703936 00000100:00100000:0.0:1787826300.272039:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111168 00000100:00100000:0.0:1787826300.272049:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84197:x1874668789703808:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826300.272085:0:45683:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe8:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826300.272088:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111169 00000100:00100000:3.0:1787826300.272097:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84195:x1874668789703936:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826300.272111:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe6:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826300.272193:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84195:x1874668789703936:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.272204:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111169 00000100:00100000:0.0:1787826300.272311:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84197:x1874668789703808:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 262us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.272317:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111168 00000100:00100000:0.0:1787826300.273490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.273561:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789704064 00000100:00100000:1.0:1787826300.273568:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789704064 00000100:00100000:1.0:1787826300.273618:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111170 00000100:00100000:1.0:1787826300.273636:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84196:x1874668789704064:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826300.273660:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826300.273769:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84196:x1874668789704064:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 135us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.273777:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111170 00000100:00100000:3.0:1787826300.274337:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.274500:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789704320 00000100:00100000:1.0:1787826300.274506:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789704320 00000100:00100000:1.0:1787826300.274544:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111171 00000100:00100000:1.0:1787826300.274552:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84195:x1874668789704320:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.274565:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.274584:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a7ef lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbae7 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.275046:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a7f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.275063:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.275075:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.275085:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x119:0x0]: returning size 0 00010000:00010000:1.0:1787826300.275127:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a7ef lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbae7 expref: 61 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.275145:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbae7 expref: 60 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.275153:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:1.0:1787826300.275156:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826300.275159:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:1.0:1787826300.275199:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84195:x1874668789704320:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 648us (863us total) trans 8590016314 rc 0/0 00000100:00100000:1.0:1787826300.275206:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111171 00000100:00100000:3.0:1787826300.281085:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.281117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.281193:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789704704 00000100:00100000:2.0:1787826300.281200:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789704704 00000100:00100000:2.0:1787826300.281247:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3309 00000100:00100000:2.0:1787826300.281254:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+60:2399:x1874668789704704:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826300.281313:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.281334:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a804 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbaee expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281379:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281390:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281398:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281407:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281411:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281414:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281471:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281478:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281489:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281498:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.281503:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281510:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281521:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.281524:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.281528:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281534:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a80b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281546:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281552:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281561:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281565:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.281568:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281577:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281583:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x633312ac (ffff9bbe0fe8cd00) 00010000:00010000:2.0:1787826300.281586:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.281588:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281593:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a812 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x633312ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281631:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a804 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaee expref: 61 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281641:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.281643:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826300.281647:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a804 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbaee expref: 61 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.281656:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc -2) 00000100:00100000:2.0:1787826300.281716:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+60:2399:x1874668789704704:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 462us (596us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826300.281724:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3309 00000100:00100000:1.0:1787826300.282276:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789704576 00000100:00100000:1.0:1787826300.282283:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789704576 00000100:00100000:1.0:1787826300.282535:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111172 00000100:00100000:1.0:1787826300.282545:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84195:x1874668789704576:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.282584:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.282603:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a7f6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbae7 expref: 60 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282617:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:1.0:1787826300.282639:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826300.282656:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282667:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282676:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282690:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282697:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282704:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282738:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282744:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282750:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282755:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.282760:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282766:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282779:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826300.282782:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826300.282786:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282792:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a819 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282801:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282807:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282813:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282818:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.282820:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282826:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282834:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x591bafee (ffff9bbe12458200) 00010000:00010000:1.0:1787826300.282836:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826300.282839:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.282846:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a820 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x591bafee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.282937:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84195:x1874668789704576:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 394us (1861us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826300.282944:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111172 00000100:00100000:2.0:1787826300.289390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.289448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.289511:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789704832 00000100:00100000:3.0:1787826300.289522:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789704832 00000100:00100000:3.0:1787826300.289573:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789705088 00000100:00100000:3.0:1787826300.289576:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789705088 00000100:00100000:3.0:1787826300.289603:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111173 00000100:00100000:3.0:1787826300.289613:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84195:x1874668789704832:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.289621:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111174 00000100:00100000:0.0:1787826300.289630:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84197:x1874668789705088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.289631:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.289638:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.289653:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a82e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb2d expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.289653:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a827 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb26 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.289685:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.289709:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.289720:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.289820:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a827 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb26 expref: 63 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.289837:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb26 expref: 62 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.289872:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:3.0:1787826300.289876:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826300.289879:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826300.289951:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84195:x1874668789704832:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 339us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.289958:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111173 00010000:00010000:0.0:1787826300.291023:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a83c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.291037:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a83c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.291562:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a83c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826300.291578:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11a:0x0]: returning size 0 00010000:00010000:0.0:1787826300.291649:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349a82e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb2d expref: 63 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.291670:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a83c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb2d expref: 62 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.291678:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbf41389100) 00010000:00010000:0.0:1787826300.291681:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826300.291684:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3600, rc 0) 00000100:00100000:0.0:1787826300.291744:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84197:x1874668789705088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2114us (2294us total) trans 8590016315 rc 0/0 00000100:00100000:0.0:1787826300.291752:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111174 00000100:00100000:2.0:1787826300.294108:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.294234:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789705344 00000100:00100000:1.0:1787826300.294243:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789705344 00000100:00100000:1.0:1787826300.294301:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111175 00000100:00100000:1.0:1787826300.294310:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84195:x1874668789705344:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.294396:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.294412:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.294434:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826300.294573:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd6263b4 reply state 00000000b999efd5 transno 8590016316 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.294586:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.294593:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:1.0:1787826300.294595:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826300.294599:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826300.294700:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84195:x1874668789705344:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 390us (599us total) trans 8590016316 rc 0/0 00000100:00100000:1.0:1787826300.294708:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111175 00000100:00100000:3.0:1787826300.296394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.296456:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789705600 00000100:00100000:1.0:1787826300.296464:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789705600 00000100:00100000:1.0:1787826300.296526:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111176 00000100:00100000:1.0:1787826300.296535:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84196:x1874668789705600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.296553:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.296571:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a851 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb34 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.297039:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a858 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.297064:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a858 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.297074:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a858 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.297084:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11b:0x0]: returning size 0 00010000:00010000:1.0:1787826300.297127:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a851 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb34 expref: 67 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.297143:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a858 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb34 expref: 66 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.297151:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458200) 00010000:00010000:1.0:1787826300.297154:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826300.297158:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826300.297206:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84196:x1874668789705600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 673us (819us total) trans 8590016317 rc 0/0 00000100:00100000:1.0:1787826300.297217:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111176 00000100:00100000:0.0:1787826300.307034:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.307092:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789705984 00000100:00100000:2.0:1787826300.307101:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789705984 00000100:00100000:2.0:1787826300.307161:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111177 00000100:00100000:2.0:1787826300.307171:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84196:x1874668789705984:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.307233:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.307260:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349a858 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb34 expref: 66 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307279:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458200) 00010000:00010000:2.0:1787826300.307290:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.307324:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307337:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307346:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307362:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307369:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307376:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307429:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307437:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307448:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307454:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307460:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.307464:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307471:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307480:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.307483:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.307486:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307493:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a866 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307503:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307508:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307526:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307530:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.307534:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307539:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307546:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xe0a30f35 (ffff9bbe0fe8cd00) 00010000:00010000:2.0:1787826300.307548:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.307551:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.307555:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a86d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xe0a30f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.307686:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84196:x1874668789705984:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 517us (662us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826300.307704:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111177 00000100:00100000:2.0:1787826300.313545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.314145:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789705728 00000100:00100000:1.0:1787826300.314155:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789705728 00000100:00100000:1.0:1787826300.314222:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111178 00000100:00100000:1.0:1787826300.314233:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84195:x1874668789705728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.314253:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.314274:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb3b expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.314346:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb3b expref: 66 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.314360:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb3b expref: 66 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.314369:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:1.0:1787826300.314372:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.314375:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:1.0:1787826300.314435:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84195:x1874668789705728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 204us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.314442:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111178 00000100:00100000:0.0:1787826300.321566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.321611:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.321641:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.321798:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789706112 00000100:00100000:3.0:1787826300.321807:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789706112 00000100:00100000:3.0:1787826300.321885:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2620 00000100:00100000:3.0:1787826300.321895:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84195:x1874668789706112:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.322012:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84195:x1874668789706112:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 119us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.322020:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2620 00000100:00100000:1.0:1787826300.322170:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789706240 00000100:00100000:1.0:1787826300.322175:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789706240 00000100:00100000:1.0:1787826300.322211:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789706496 00000100:00100000:1.0:1787826300.322214:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789706496 00000100:00100000:1.0:1787826300.322245:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111179 00000100:00100000:1.0:1787826300.322252:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84196:x1874668789706240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.322263:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.322285:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a87b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb42 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322328:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322342:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322354:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322460:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a87b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb42 expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322478:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb42 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322488:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:1.0:1787826300.322491:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826300.322494:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826300.322524:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84196:x1874668789706240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 272us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.322530:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111179 00000100:00100000:1.0:1787826300.322550:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111180 00000100:00100000:1.0:1787826300.322557:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84197:x1874668789706496:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.322585:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.322601:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a83c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb2d expref: 67 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322613:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbf41389100) 00010000:00010000:1.0:1787826300.322621:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826300.322636:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322645:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322653:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322664:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322671:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.322678:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324614:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324631:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324637:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324644:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324651:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.324655:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324663:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324677:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826300.324680:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826300.324685:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324691:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a889 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324706:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324712:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324718:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324723:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.324726:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324731:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324743:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x7b9c182b (ffff9bbe12458d00) 00010000:00010000:1.0:1787826300.324745:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826300.324748:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.324753:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a890 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x7b9c182b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.324986:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84197:x1874668789706496:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 2425us (3346us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826300.324995:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111180 00000100:00100000:3.0:1787826300.328442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.328551:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.328655:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789706752 00000100:00100000:1.0:1787826300.328665:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789706752 00000100:00100000:1.0:1787826300.328722:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111181 00000100:00100000:1.0:1787826300.328731:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84196:x1874668789706752:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.328821:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.328837:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.328848:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826300.329000:0:7736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004572636a reply state 00000000dc1e33e2 transno 8590016318 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.329013:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.329021:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:1.0:1787826300.329024:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826300.329027:0:7736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826300.329110:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84196:x1874668789706752:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 380us (676us total) trans 8590016318 rc 0/0 00000100:00100000:1.0:1787826300.329119:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111181 00000100:00100000:3.0:1787826300.330765:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.331283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789707136 00000100:00100000:1.0:1787826300.331292:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789707136 00000100:00100000:1.0:1787826300.331352:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111182 00000100:00100000:1.0:1787826300.331360:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84197:x1874668789707136:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.331376:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.331396:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a89e lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb49 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.331440:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.331454:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.331464:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.331563:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a89e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb49 expref: 70 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.331583:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb49 expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.331598:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:1.0:1787826300.331601:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826300.331604:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826300.331650:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84197:x1874668789707136:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 291us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.331658:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111182 00000100:00100000:2.0:1787826300.333751:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789707008 00000100:00100000:2.0:1787826300.333762:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789707008 00000100:00100000:2.0:1787826300.333952:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2621 00000100:00100000:2.0:1787826300.333963:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84195:x1874668789707008:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.334250:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84195:x1874668789707008:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 289us (5697us total) trans 8590016319 rc 0/0 00000100:00100000:2.0:1787826300.334257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2621 00000100:00100000:3.0:1787826300.334435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.334965:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789707264 00000100:00100000:2.0:1787826300.334971:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789707264 00000100:00100000:2.0:1787826300.335012:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111183 00000100:00100000:2.0:1787826300.335019:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84196:x1874668789707264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.335038:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.335058:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb50 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.335099:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb50 expref: 71 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.335114:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb50 expref: 71 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.335123:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:2.0:1787826300.335126:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.335129:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:2.0:1787826300.335157:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84196:x1874668789707264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 138us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.335163:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111183 00000100:00100000:2.0:1787826300.337110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.337189:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789707520 00000100:00100000:3.0:1787826300.337197:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789707520 00000100:00100000:3.0:1787826300.337247:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111184 00000100:00100000:3.0:1787826300.337256:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84197:x1874668789707520:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.337362:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.337382:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.337392:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826300.337544:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0e9c110 reply state 00000000bb6490ce transno 8590016320 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.337557:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.337564:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:3.0:1787826300.337567:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826300.337570:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826300.337655:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84197:x1874668789707520:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 400us (552us total) trans 8590016320 rc 0/0 00000100:00100000:3.0:1787826300.337663:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111184 00000100:00100000:0.0:1787826300.340478:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.340595:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789707776 00000100:00100000:1.0:1787826300.340603:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789707776 00000100:00100000:1.0:1787826300.340663:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111185 00000100:00100000:1.0:1787826300.340673:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84195:x1874668789707776:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.340796:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84195:x1874668789707776:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 124us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.340804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111185 00000100:00100000:1.0:1787826300.342911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.343026:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789707904 00000100:00100000:0.0:1787826300.343035:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789707904 00000100:00100000:0.0:1787826300.343089:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2622 00000100:00100000:0.0:1787826300.343100:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84196:x1874668789707904:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.343222:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84196:x1874668789707904:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.343229:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2622 00000100:00100000:3.0:1787826300.344585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.344660:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789708032 00000100:00100000:1.0:1787826300.344666:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789708032 00000100:00100000:1.0:1787826300.344721:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111186 00000100:00100000:1.0:1787826300.344730:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84197:x1874668789708032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.344748:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.344768:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb57 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.344837:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb57 expref: 74 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.344891:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb57 expref: 74 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.344901:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:1.0:1787826300.344904:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.344907:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826300.345104:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84197:x1874668789708032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 375us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.345114:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111186 00000100:00100000:1.0:1787826300.347608:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.347652:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.347738:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789708288 00000100:00100000:2.0:1787826300.347746:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789708288 00000100:00100000:2.0:1787826300.347796:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111187 00000100:00100000:2.0:1787826300.347806:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84195:x1874668789708288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.347834:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.347893:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a8c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb5e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.347999:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.348019:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb3b expref: 75 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.348028:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.348060:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb3b expref: 75 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.348073:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb3b expref: 75 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.348086:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778615552:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.348178:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe13482b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.348254:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789708544 00000100:00100000:3.0:1787826300.348486:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789708544 00000100:00100000:3.0:1787826300.348528:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2623 00000100:00100000:3.0:1787826300.348536:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84196:x1874668789708544:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.348563:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.348584:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789708672 00000100:00100000:3.0:1787826300.348587:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789708672 00000100:00100000:3.0:1787826300.348606:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2624 00000100:00100000:3.0:1787826300.348613:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84197:x1874668789708672:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.349047:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84197:x1874668789708672:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 433us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.349056:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2624 00000100:00100000:3.0:1787826300.349179:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84196:x1874668789708544:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 644us (1525us total) trans 8590016321 rc 0/0 00000100:00100000:3.0:1787826300.349186:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2623 00000100:00100000:2.0:1787826300.350053:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778615552:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.350078:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.351269:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.351354:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789708800 00000100:00100000:2.0:1787826300.351361:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789708800 00010000:00010000:2.0:1787826300.351397:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb3b expref: 77 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.351482:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2971 00000100:00100000:2.0:1787826300.351491:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+77:2402:x1874668789708800:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.351505:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.351513:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb3b expref: 77 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.351525:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb3b expref: 77 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.351548:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a874 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb3b expref: 77 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.351564:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:2.0:1787826300.351570:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.351581:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.351588:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.351621:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.351655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.351675:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789709056 00000100:00100000:3.0:1787826300.351679:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789709056 00000100:00100000:3.0:1787826300.351717:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2625 00000100:00100000:3.0:1787826300.351725:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84197:x1874668789709056:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.351881:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.351890:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.351901:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+78:2402:x1874668789708800:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 410us (642us total) trans 0 rc 0/0 00000004:00200000:1.0:1787826300.351906:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x119:0x0]: returning size 0 00000100:00100000:2.0:1787826300.351908:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2971 00000004:00080000:1.0:1787826300.352049:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xbc:0x0], index 1: 0 00000100:00100000:0.0:1787826300.352054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.352165:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84197:x1874668789709056:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 440us (510us total) trans 8590016322 rc 0/0 00000100:00100000:3.0:1787826300.352173:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2625 00010000:00010000:1.0:1787826300.352452:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.352461:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.352466:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.352475:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.352479:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.352487:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.352499:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:1.0:1787826300.352501:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.352505:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.352511:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a8c8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.352552:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a8c1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb5e expref: 77 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.352561:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826300.352563:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826300.352566:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a8c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb5e expref: 77 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.352574:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:1.0:1787826300.352657:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84195:x1874668789708288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4852us (5058us total) trans 8590016323 rc 301/301 00000100:00100000:1.0:1787826300.352665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111187 00000100:00100000:1.0:1787826300.352686:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789709312 00000100:00100000:1.0:1787826300.352690:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789709312 00000100:00100000:2.0:1787826300.354018:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111188 00000100:00100000:2.0:1787826300.354035:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84196:x1874668789709312:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.354118:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84196:x1874668789709312:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 89us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.354126:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111188 00000100:00100000:3.0:1787826300.357049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.357132:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.357163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.357228:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789709824 00000100:00100000:1.0:1787826300.357239:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789709824 00000100:00100000:1.0:1787826300.357304:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789710080 00000100:00100000:1.0:1787826300.357307:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789710080 00000100:00100000:1.0:1787826300.357332:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111189 00000100:00100000:1.0:1787826300.357341:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84196:x1874668789709824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.357368:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.357390:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a8d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb65 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.357529:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.357544:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb50 expref: 78 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.357554:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.357587:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb50 expref: 78 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.357602:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb50 expref: 78 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.357616:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778615680:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.357703:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.357882:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111190 00000100:00100000:3.0:1787826300.357894:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84197:x1874668789710080:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.357949:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84197:x1874668789710080:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 59us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.357957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111190 00000100:00100000:1.0:1787826300.359948:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778615680:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.359978:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.360967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.361075:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789710336 00000100:00100000:0.0:1787826300.361083:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789710336 00000100:00100000:0.0:1787826300.361136:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111191 00000100:00100000:0.0:1787826300.361144:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84197:x1874668789710336:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.361162:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.361183:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349a8e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb6c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.361287:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.361310:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb57 expref: 79 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.361320:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.361352:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb57 expref: 79 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.361364:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb57 expref: 79 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.361377:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08302d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778615808:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.361468:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.361997:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789709568 00000100:00100000:2.0:1787826300.362005:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789709568 00000100:00100000:2.0:1787826300.362051:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2626 00000100:00100000:2.0:1787826300.362059:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84195:x1874668789709568:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.362275:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84195:x1874668789709568:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 217us (5235us total) trans 8590016324 rc 0/0 00000100:00100000:2.0:1787826300.362283:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2626 00000100:00100000:3.0:1787826300.363162:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.363215:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789710464 00000100:00100000:1.0:1787826300.363221:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789710464 00010000:00010000:1.0:1787826300.363249:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb50 expref: 81 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.363286:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2972 00000100:00100000:1.0:1787826300.363295:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2402:x1874668789710464:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826300.363319:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.363326:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb50 expref: 81 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.363338:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb50 expref: 81 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.363359:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349a8ac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb50 expref: 81 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.363375:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:1.0:1787826300.363381:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.363391:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.363399:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.363440:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.363561:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363570:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.363587:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11b:0x0]: returning size 0 00000004:00080000:2.0:1787826300.363716:0:12105:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xbc:0x0], index 0: 0 00010000:00010000:2.0:1787826300.363798:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363806:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363812:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363818:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.363823:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363830:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363844:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:2.0:1787826300.363848:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.363870:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363877:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349a8dd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363916:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a8d6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb65 expref: 81 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363926:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.363928:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826300.363931:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349a8d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb65 expref: 81 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.363940:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:1.0:1787826300.364966:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2402:x1874668789710464:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1664us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.364979:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2972 00000100:00100000:2.0:1787826300.365582:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84196:x1874668789709824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 8239us (8447us total) trans 8590016325 rc 301/301 00000100:00100000:2.0:1787826300.365591:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111189 00000100:00100000:0.0:1787826300.366361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.366459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.366475:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08302d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778615808:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.366502:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.366525:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789710720 00000100:00100000:1.0:1787826300.366530:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789710720 00000100:00100000:2.0:1787826300.366531:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789710592 00000100:00100000:2.0:1787826300.366534:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789710592 00010000:00010000:2.0:1787826300.366559:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb57 expref: 80 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.366621:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111192 00000100:00100000:2.0:1787826300.366621:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2973 00000100:00100000:1.0:1787826300.366630:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84195:x1874668789710720:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.366630:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789710592:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826300.366649:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.366654:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.366659:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb57 expref: 80 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.366664:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a8f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb73 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.366670:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb57 expref: 80 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.366686:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349a8ba lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb57 expref: 81 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.366710:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826300.366715:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.366723:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.366730:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.366732:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a900 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.366740:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a900 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.366748:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a900 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.366750:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1787826300.366785:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x119:0x0]: returning size 0 00000004:00200000:1.0:1787826300.366790:0:45682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1787826300.366791:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789710592:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 163us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.366797:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2973 00000004:00010000:1.0:1787826300.366806:0:45682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a900 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.366833:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a8f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb73 expref: 80 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.366846:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a900 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb73 expref: 79 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.366883:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:1.0:1787826300.366885:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826300.366888:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:1.0:1787826300.366913:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84195:x1874668789710720:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 285us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.366919:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111192 00010000:00010000:2.0:1787826300.367221:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367228:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.367248:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11a:0x0]: returning size 0 00000004:00080000:2.0:1787826300.367384:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xbd:0x0], index 1: 0 00010000:00010000:2.0:1787826300.367481:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367489:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367495:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367501:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.367504:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367511:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367522:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826300.367525:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.367528:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367535:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349a8eb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367572:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349a8e4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb6c expref: 79 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367582:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.367585:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826300.367589:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349a8e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb6c expref: 79 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.367597:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc 0) 00000100:00100000:2.0:1787826300.367813:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84197:x1874668789710336:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 6668us (6849us total) trans 8590016326 rc 301/301 00000100:00100000:2.0:1787826300.367821:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111191 00000100:00100000:0.0:1787826300.369404:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.369533:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.369612:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789711104 00000100:00100000:3.0:1787826300.369620:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789711104 00000100:00100000:3.0:1787826300.369781:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6195 00000100:00100000:3.0:1787826300.369792:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789711104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.369807:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.369826:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb7a expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826300.369869:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826300.369898:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=2938s v=(0 0) 00010000:00010000:3.0:1787826300.369903:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.369918:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb7a expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.369935:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb7a expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.369948:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00000100:00100000:3.0:1787826300.370000:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789711104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 211us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.370007:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6195 00000100:00100000:1.0:1787826300.370680:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789710976 00000100:00100000:1.0:1787826300.370690:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789710976 00000100:00100000:0.0:1787826300.371792:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.372034:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789711360 00000100:00100000:3.0:1787826300.372041:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789711360 00000100:00100000:3.0:1787826300.372093:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2627 00000100:00100000:3.0:1787826300.372103:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84197:x1874668789711360:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.372522:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84197:x1874668789711360:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 420us (734us total) trans 8590016327 rc 0/0 00000100:00100000:1.0:1787826300.372529:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2628 00000100:00100000:3.0:1787826300.372534:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2627 00000100:00100000:1.0:1787826300.372536:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84196:x1874668789710976:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.372650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84196:x1874668789710976:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 114us (3253us total) trans 8590016328 rc 0/0 00000100:00100000:1.0:1787826300.372656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2628 00000100:00100000:0.0:1787826300.372707:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.374165:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.374495:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789711616 00000100:00100000:3.0:1787826300.374504:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789711616 00000100:00100000:0.0:1787826300.374588:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789711744 00000100:00100000:0.0:1787826300.374592:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789711744 00000100:00100000:3.0:1787826300.374594:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111193 00000100:00100000:3.0:1787826300.374603:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84195:x1874668789711616:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.374621:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111194 00000100:00100000:0.0:1787826300.374627:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84196:x1874668789711744:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.374642:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.374664:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a915 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb81 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.374732:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a91c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.374746:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a91c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.374757:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a91c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.374763:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84195:x1874668789711616:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 161us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.374769:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111193 00000004:00200000:0.0:1787826300.374792:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11b:0x0]: returning size 0 00000004:00200000:0.0:1787826300.374797:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826300.374813:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a91c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.374836:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349a915 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb81 expref: 82 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.375172:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a91c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb81 expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.375240:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:0.0:1787826300.375244:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826300.375248:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:0.0:1787826300.375273:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84196:x1874668789711744:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 646us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.375279:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111194 00000100:00100000:2.0:1787826300.375675:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.378207:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789711872 00000100:00100000:3.0:1787826300.378218:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789711872 00000100:00100000:0.0:1787826300.378356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.378370:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111195 00000100:00100000:2.0:1787826300.378381:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84197:x1874668789711872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.378406:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787826300.378434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:2.0:1787826300.378436:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a923 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb88 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.378509:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789712000 00010000:00010000:2.0:1787826300.378512:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a92a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.378513:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789712000 00010000:00010000:2.0:1787826300.378525:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a92a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.378536:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a92a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.378570:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789712128 00000100:00100000:3.0:1787826300.378574:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789712128 00000004:00200000:2.0:1787826300.378578:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11a:0x0]: returning size 0 00000004:00200000:2.0:1787826300.378583:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826300.378603:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a92a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.378611:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6196 00000100:00100000:0.0:1787826300.378619:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84195:x1874668789712000:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.378628:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.378644:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349a923 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb88 expref: 83 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.378647:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb8f expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.378660:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a92a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb88 expref: 82 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.378667:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826300.378670:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826300.378672:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb7a expref: 11 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.378673:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00010000:00010000:0.0:1787826300.378680:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.378683:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.378688:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.378716:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb7a expref: 11 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.378730:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb7a expref: 11 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.378732:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84197:x1874668789711872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 354us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.378739:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111195 00000100:00100000:0.0:1787826300.378742:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778615936:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.378791:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.379170:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6197 00000100:00100000:3.0:1787826300.379190:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789712128:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.379199:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.379212:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb96 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826300.379232:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826300.379243:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=2938s v=(0 0) 00010000:00010000:3.0:1787826300.379246:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.379253:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb96 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.379271:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb96 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.379282:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:3.0:1787826300.379313:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789712128:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 135us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.379319:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6197 00000100:00100000:1.0:1787826300.380591:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778615936:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.380620:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.380647:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:1.0:1787826300.380699:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84195:x1874668789712000:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2073us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.380707:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6196 00000100:00100000:2.0:1787826300.381468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.382156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.382556:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.382723:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789712384 00000100:00100000:2.0:1787826300.382732:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789712384 00000100:00100000:2.0:1787826300.382788:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6198 00000100:00100000:2.0:1787826300.382799:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789712384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.382814:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.382835:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbb9d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826300.383054:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826300.383075:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=2938s v=(0 0) 00010000:00010000:2.0:1787826300.383079:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.383089:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb9d expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.383113:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb9d expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.383125:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826300.383176:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789712384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 379us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.383184:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6198 00000100:00100000:1.0:1787826300.383274:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789712640 00000100:00100000:1.0:1787826300.383278:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789712640 00000100:00100000:1.0:1787826300.383320:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111196 00000100:00100000:1.0:1787826300.383329:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84196:x1874668789712640:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.383388:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84196:x1874668789712640:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 60us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.383394:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111196 00000100:00100000:0.0:1787826300.383494:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789712256 00000100:00100000:0.0:1787826300.383499:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789712256 00010000:00010000:0.0:1787826300.383527:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb7a expref: 12 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.385733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.387062:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2974 00000100:00100000:0.0:1787826300.387082:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789712256:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.387105:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.387132:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb7a expref: 12 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.387153:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb7a expref: 12 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.387175:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b08dbd/0x68019081f349a90e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb7a expref: 12 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.387192:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.387196:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.387204:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.387214:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.387251:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.387266:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb2d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778616064:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826300.387345:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.388003:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789712768 00000100:00100000:1.0:1787826300.388011:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789712768 00000100:00100000:1.0:1787826300.388058:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6199 00000100:00100000:1.0:1787826300.388066:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84196:x1874668789712768:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.388079:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.388094:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbba4 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.388114:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb96 expref: 15 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.388122:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826300.388126:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826300.388130:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 15 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.388153:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb96 expref: 15 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.388166:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb96 expref: 15 pid: 8605 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.388177:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778616192:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.388216:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.392224:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb2d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778616064:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826300.392249:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826300.392309:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789712256:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5235us (10843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.392325:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2974 00000100:00100000:1.0:1787826300.393287:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778616192:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.393319:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 15 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.393340:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7000, rc 0) 00000100:00100000:1.0:1787826300.393390:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+15:84196:x1874668789712768:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5324us (7665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.393398:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6199 00000100:00100000:3.0:1787826300.396207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.396254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.396324:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789713152 00000100:00100000:1.0:1787826300.396334:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789713152 00000100:00100000:1.0:1787826300.396402:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111197 00000100:00100000:1.0:1787826300.396412:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84197:x1874668789713152:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.396551:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84197:x1874668789713152:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 140us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.396560:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111197 00000100:00100000:2.0:1787826300.397084:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789712896 00000100:00100000:2.0:1787826300.397090:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789712896 00010000:00010000:2.0:1787826300.397117:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb96 expref: 15 pid: 8605 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.397152:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2975 00000100:00100000:2.0:1787826300.397160:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40512c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789712896:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.397172:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.397193:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb96 expref: 15 pid: 8605 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.397206:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb96 expref: 15 pid: 8605 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.397227:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349a938 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb96 expref: 15 pid: 8605 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.397249:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.397253:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.397262:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.397272:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.397323:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.397338:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778616320:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826300.397397:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe131b4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.397928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.398168:0:45401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789713280 00000100:00100000:2.0:1787826300.398174:0:45401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789713280 00002000:00100000:2.0:1787826300.398210:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xbc:0x0] (0->157) req@ffff9bbe0dc8e940 x1874668789713280/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/0 e 0 to 0 dl 1787826311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826300.398221:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8e940 with x1874668789713280 ext(0->157) 00002000:00010000:2.0:1787826300.398225:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0dc8e940 00000100:00100000:2.0:1787826300.398254:0:45401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1561 00000100:00100000:2.0:1787826300.398262:0:45401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789713280:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.399203:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.399284:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789713408 00000100:00100000:3.0:1787826300.399290:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789713408 00000100:00100000:3.0:1787826300.399343:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6200 00000100:00100000:3.0:1787826300.399352:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84197:x1874668789713408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.399364:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.399380:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbab expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.399408:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb9d expref: 15 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.399427:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.399433:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.399438:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 15 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.399469:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb9d expref: 15 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.399482:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb9d expref: 15 pid: 8430 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.399495:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778616448:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826300.399560:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.400232:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778616320:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826300.400254:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.400294:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40512c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789712896:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3135us (4098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.400304:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2975 00000100:00100000:2.0:1787826300.401181:0:45401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789713280:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2916us (3250us total) trans 4294968144 rc 0/0 00000100:00100000:2.0:1787826300.401191:0:45401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1561 00002000:00100000:2.0:1787826300.401201:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xbc:0x0] (0->157) req@ffff9bbe0dc8e940 x1874668789713280/t4294968144(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/448 e 0 to 0 dl 1787826311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826300.401211:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8e940 with x1874668789713280 ext(0->157) 00002000:00010000:2.0:1787826300.401217:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0dc8e940 00000100:00100000:0.0:1787826300.401656:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.401727:0:45404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789713536 00000100:00100000:1.0:1787826300.401733:0:45404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789713536 00002000:00100000:1.0:1787826300.401768:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xbc:0x0] (0->157) req@ffff9bbf06fb2940 x1874668789713536/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/0 e 0 to 0 dl 1787826311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826300.401778:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf06fb2940 with x1874668789713536 ext(0->157) 00002000:00010000:1.0:1787826300.401782:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf06fb2940 00000100:00100000:1.0:1787826300.401983:0:45404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1562 00000100:00100000:1.0:1787826300.401993:0:45404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789713536:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.403075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.403163:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778616448:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.403193:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 14 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.403213:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:2.0:1787826300.403262:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84197:x1874668789713408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 3911us (4063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.403271:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6200 00000100:00100000:0.0:1787826300.403551:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789713664 00000100:00100000:0.0:1787826300.403558:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789713664 00010000:00010000:0.0:1787826300.403587:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb9d expref: 14 pid: 8430 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.403620:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2976 00000100:00100000:0.0:1787826300.403629:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789713664:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.403642:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.403660:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb9d expref: 14 pid: 8430 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.403673:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb9d expref: 14 pid: 8430 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.403695:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349a93f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb9d expref: 14 pid: 8430 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.403709:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.403713:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.403721:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 13 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.403738:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 13 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.403770:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 13 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.403784:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778616576:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826300.404545:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.405125:0:45404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789713536:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 3129us (3466us total) trans 4294968162 rc 0/0 00000100:00100000:0.0:1787826300.405134:0:45404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1562 00002000:00100000:0.0:1787826300.405145:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xbc:0x0] (0->157) req@ffff9bbf06fb2940 x1874668789713536/t4294968162(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/448 e 0 to 0 dl 1787826311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826300.405155:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf06fb2940 with x1874668789713536 ext(0->157) 00002000:00010000:0.0:1787826300.405160:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf06fb2940 00000100:00100000:0.0:1787826300.405649:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.405708:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789713792 00000100:00100000:3.0:1787826300.405715:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789713792 00000100:00100000:3.0:1787826300.405764:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111198 00000100:00100000:3.0:1787826300.405772:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84195:x1874668789713792:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787826300.408364:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016328 is committed 00000020:00080000:1.0:1787826300.408427:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0d0626c0 refcount 2 committed 0 result 0 batchid 4294970876 00000020:00080000:1.0:1787826300.408434:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d0629c0 00000020:00080000:1.0:1787826300.408437:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0dde8400 00000020:00080000:1.0:1787826300.408459:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe188b7780 refcount 2 committed 0 result 0 batchid 4294970875 00000020:00080000:1.0:1787826300.408463:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe188b7f00 00000020:00080000:1.0:1787826300.408466:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d0fa800 00000020:00080000:1.0:1787826300.408480:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe16caef00 refcount 2 committed 0 result 0 batchid 4294970874 00000020:00080000:1.0:1787826300.408483:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bdb4b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16cae840 00000020:00080000:1.0:1787826300.408486:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bdb4300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f95dc00 00000020:00080000:1.0:1787826300.408497:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970873 batchid updated 00000100:00100000:3.0:1787826300.408690:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84195:x1874668789713792:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 2913us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.408701:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111198 00000100:00100000:1.0:1787826300.409616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.409677:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789713920 00000100:00100000:3.0:1787826300.409685:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789713920 00002000:00100000:3.0:1787826300.409727:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xbd:0x0] (0->157) req@ffff9bbe0dc8c3c0 x1874668789713920/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/0 e 0 to 0 dl 1787826311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826300.409738:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8c3c0 with x1874668789713920 ext(0->157) 00002000:00010000:3.0:1787826300.409743:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0dc8c3c0 00000100:00100000:3.0:1787826300.409775:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1563 00000100:00100000:3.0:1787826300.409784:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2400:x1874668789713920:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.410437:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778616576:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826300.410459:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.410506:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789713664:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 6879us (7434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.410515:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2976 00000020:00080000:2.0:1787826300.410671:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970876 committed batchid 4294970873 00000020:00080000:2.0:1787826300.410722:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970873 00000100:00100000:3.0:1787826300.411657:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2400:x1874668789713920:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1870us (2041us total) trans 4294968145 rc 0/0 00000100:00100000:3.0:1787826300.411667:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1563 00002000:00100000:3.0:1787826300.411678:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xbd:0x0] (0->157) req@ffff9bbe0dc8c3c0 x1874668789713920/t4294968145(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/448 e 0 to 0 dl 1787826311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826300.411687:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8c3c0 with x1874668789713920 ext(0->157) 00002000:00010000:3.0:1787826300.411693:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0dc8c3c0 00010000:00010000:0.0:1787826300.412397:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412409:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412426:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412437:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.412442:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412450:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412466:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x117:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826300.412469:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.412473:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412480:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349a6c9 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x117:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412502:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412509:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412515:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412520:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.412523:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412529:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412540:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x116:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826300.412543:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.412546:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412551:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349a6de lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x116:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412564:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412570:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412576:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412580:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.412583:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412590:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412597:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x118:0x0].0x0 (ffff9bbe16e56f00) 00010000:00010000:0.0:1787826300.412600:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.412603:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412608:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a6ec lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x118:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412624:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412631:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412636:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412640:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.412643:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412649:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412658:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826300.412660:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826300.412663:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412668:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349a84a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412677:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412683:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412689:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412695:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.412697:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412703:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412709:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:0.0:1787826300.412711:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826300.412714:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412719:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349a897 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412727:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412733:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412738:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412743:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.412746:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412752:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412763:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826300.412765:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826300.412768:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.412775:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a8b3 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.415059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.415137:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789714048 00000100:00100000:2.0:1787826300.415146:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789714048 00000100:00100000:2.0:1787826300.415201:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111199 00000100:00100000:2.0:1787826300.415210:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84196:x1874668789714048:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.415346:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84196:x1874668789714048:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 136us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.415355:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111199 00000100:00100000:1.0:1787826300.417051:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.417093:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.417161:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789714176 00000100:00100000:0.0:1787826300.417170:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789714176 00000100:00100000:0.0:1787826300.417224:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6201 00000100:00100000:0.0:1787826300.417234:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2400:x1874668789714176:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.417333:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789714304 00000100:00100000:2.0:1787826300.417338:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789714304 00000100:00100000:2.0:1787826300.417379:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111200 00000100:00100000:2.0:1787826300.417388:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84197:x1874668789714304:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.417495:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84197:x1874668789714304:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 108us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.417503:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111200 00000100:00100000:3.0:1787826300.417648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.418200:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789714432 00000100:00100000:0.0:1787826300.418206:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789714432 00000100:00100000:0.0:1787826300.418245:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6202 00000100:00100000:0.0:1787826300.418252:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789714432:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787826300.421062:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968162 is committed 00000001:00080000:0.0:1787826300.421080:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968161 is committed 00000100:00100000:1.0:1787826300.423152:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.423242:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789714560 00000100:00100000:3.0:1787826300.423251:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789714560 00000100:00100000:3.0:1787826300.423321:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6203 00000100:00100000:3.0:1787826300.423331:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789714560:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.424151:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789714432:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 5896us (6500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.424162:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6202 00000001:00080000:2.0:1787826300.426653:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968145 is committed 00000001:00080000:2.0:1787826300.426676:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968143 is committed 00000100:00100000:0.0:1787826300.426909:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789714176:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 9672us (9862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.426921:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6201 00000100:00100000:3.0:1787826300.427177:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789714560:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 3847us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.427185:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6203 00000100:00100000:1.0:1787826300.433751:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.433794:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.433835:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.433895:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789714816 00000100:00100000:2.0:1787826300.433905:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789714816 00000100:00100000:2.0:1787826300.433961:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789715072 00000100:00100000:2.0:1787826300.433965:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789715072 00000100:00100000:2.0:1787826300.433981:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789715328 00000100:00100000:2.0:1787826300.433983:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789715328 00000100:00100000:2.0:1787826300.434002:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111201 00000100:00100000:2.0:1787826300.434010:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84196:x1874668789714816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.434063:0:12105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.434089:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a91c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb81 expref: 33 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.434108:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:2.0:1787826300.434114:0:12105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.434142:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.434155:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.434164:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826300.434280:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c32747a reply state 0000000008c8c36f transno 8590016329 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.434293:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.434313:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:2.0:1787826300.434316:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826300.434319:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826300.434401:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111202 00000100:00100000:3.0:1787826300.434412:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84195:x1874668789715072:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.434444:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.434457:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349a900 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x119:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb73 expref: 33 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.434467:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:3.0:1787826300.434470:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826300.434484:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.434492:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.434499:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.434508:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84196:x1874668789714816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 499us (767us total) trans 8590016329 rc 0/0 00000100:00100000:2.0:1787826300.434515:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111201 00000100:00100000:2.0:1787826300.434535:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111203 00000100:00100000:2.0:1787826300.434542:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84197:x1874668789715328:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000004:00010000:3.0:1787826300.434543:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b26ea6d6 reply state 000000002eee3f2b transno 8590016330 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.434552:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.434558:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:2.0:1787826300.434559:0:12105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.434561:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826300.434563:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826300.434570:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349a92a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb88 expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.434579:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826300.434582:0:12105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.434594:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.434599:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84195:x1874668789715072:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 191us (804us total) trans 8590016330 rc 0/0 00010000:00010000:2.0:1787826300.434602:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.434605:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111202 00010000:00010000:2.0:1787826300.434609:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826300.435013:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b03451a reply state 00000000a6eb20fb transno 8590016331 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.435026:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.435032:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826300.435034:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826300.435036:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826300.435127:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84197:x1874668789715328:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 584us (1290us total) trans 8590016331 rc 0/0 00000100:00100000:2.0:1787826300.435134:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111203 00000100:00100000:1.0:1787826300.437263:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.437450:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789715456 00000100:00100000:2.0:1787826300.437458:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789715456 00000100:00100000:3.0:1787826300.437495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.439530:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.441076:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789715584 00000100:00100000:2.0:1787826300.441088:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789715584 00000100:00100000:2.0:1787826300.441145:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789715712 00000100:00100000:2.0:1787826300.441148:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789715712 00000100:00100000:3.0:1787826300.441157:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111204 00000100:00100000:3.0:1787826300.441169:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84195:x1874668789715456:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.441192:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.441213:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbb2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.441270:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb2 expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.441286:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb2 expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.441313:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:3.0:1787826300.441316:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.441320:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826300.441376:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84195:x1874668789715456:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 209us (4121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.441500:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111204 00000100:00100000:2.0:1787826300.441507:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111205 00000100:00100000:2.0:1787826300.441515:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84196:x1874668789715584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.441519:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111206 00000100:00100000:3.0:1787826300.441525:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84197:x1874668789715712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.441529:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.441534:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.441539:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbb9 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.441541:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbc0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.441566:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb9 expref: 38 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.441566:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc0 expref: 38 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.441577:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb9 expref: 38 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.441581:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc0 expref: 38 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.441589:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:3.0:1787826300.441591:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826300.441592:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.441593:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.441594:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00010000:00010000:3.0:1787826300.441595:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:3.0:1787826300.441615:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84197:x1874668789715712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 90us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.441621:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111206 00000100:00100000:2.0:1787826300.446463:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84196:x1874668789715584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4935us (8955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.446475:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111205 00000100:00100000:3.0:1787826300.446773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.446990:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789715840 00000100:00100000:2.0:1787826300.446999:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789715840 00000100:00100000:2.0:1787826300.447082:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6204 00000100:00100000:2.0:1787826300.447091:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789715840:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826300.447245:0:8605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xbc:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826300.447249:0:8605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xbc:0x0] updating lvb mtime from disk: 0 -> 1787826218 00002000:00010000:2.0:1787826300.447251:0:8605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xbc:0x0] updating lvb atime from disk: 0 -> 1787826218 00002000:00010000:2.0:1787826300.447253:0:8605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xbc:0x0] updating lvb ctime from disk: 0 -> 1787826218 00002000:00010000:2.0:1787826300.447255:0:8605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xbc:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826300.447517:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789715840:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 426us (743us total) trans 4294968146 rc 0/0 00000100:00100000:2.0:1787826300.447525:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6204 00000100:00100000:0.0:1787826300.450196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.450231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.450465:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789715968 00000100:00100000:1.0:1787826300.450479:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789715968 00000100:00100000:1.0:1787826300.450531:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789716096 00000100:00100000:1.0:1787826300.450535:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789716096 00000100:00100000:1.0:1787826300.450564:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6205 00000100:00100000:1.0:1787826300.450573:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789715968:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.450721:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6206 00000100:00100000:0.0:1787826300.450730:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789716096:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826300.450736:0:25038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xbd:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826300.450739:0:25038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xbd:0x0] updating lvb mtime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826300.450742:0:25038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xbd:0x0] updating lvb atime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826300.450744:0:25038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xbd:0x0] updating lvb ctime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826300.450746:0:25038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xbd:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826300.450800:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789715968:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 227us (611us total) trans 4294968147 rc 0/0 00000100:00100000:1.0:1787826300.450807:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6205 00002000:00010000:1.0:1787826300.451157:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xbc:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826300.451161:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xbc:0x0] updating lvb mtime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826300.451163:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xbc:0x0] updating lvb atime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826300.451165:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xbc:0x0] updating lvb ctime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826300.451167:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xbc:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826300.451204:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789716096:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 475us (971us total) trans 4294968163 rc 0/0 00000100:00100000:1.0:1787826300.451211:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6206 00000100:00100000:0.0:1787826300.453444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.453614:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789716352 00000100:00100000:1.0:1787826300.453623:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789716352 00000100:00100000:1.0:1787826300.453674:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111207 00000100:00100000:1.0:1787826300.453683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84196:x1874668789716352:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.453743:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.453761:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb42 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.453772:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 4/0,1 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.453818:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb42 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.453833:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb42 expref: 37 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.453847:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778616704:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.453942:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.454084:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.454248:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789716608 00000100:00100000:1.0:1787826300.454253:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789716608 00000100:00100000:1.0:1787826300.454285:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111208 00000100:00100000:1.0:1787826300.454293:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84197:x1874668789716608:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.454322:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.454334:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb49 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.454348:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.454368:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb49 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.454377:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb49 expref: 38 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.454386:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778616832:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.454434:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.457201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.457271:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.457618:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789716864 00000100:00100000:0.0:1787826300.457626:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789716864 00000100:00100000:0.0:1787826300.457678:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111209 00000100:00100000:0.0:1787826300.457687:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84195:x1874668789716864:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.457753:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.457771:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb26 expref: 39 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.457780:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 4/0,1 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.457814:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb26 expref: 39 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.457826:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb26 expref: 39 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.457839:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778616960:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.457942:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.458093:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778616704:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.458116:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.458378:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789716992 00000100:00100000:2.0:1787826300.458384:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789716992 00010000:00010000:2.0:1787826300.458408:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb42 expref: 40 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.458449:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2977 00000100:00100000:2.0:1787826300.458457:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2401:x1874668789716992:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.458468:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.458474:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb42 expref: 40 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.458492:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb42 expref: 40 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.458512:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349a882 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb42 expref: 40 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.458528:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:2.0:1787826300.458532:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.458540:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.458547:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.458576:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.458617:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789716992:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 160us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.458627:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2977 00010000:00010000:1.0:1787826300.458756:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.458764:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.458801:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.458808:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.458815:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.458822:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.458827:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.458834:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.458844:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:1.0:1787826300.458846:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826300.458885:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.458893:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349a97e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.458942:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84196:x1874668789716352:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 5256us (5502us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826300.458951:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111207 00000100:00100000:3.0:1787826300.459806:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.459875:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789717120 00000100:00100000:2.0:1787826300.459881:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789717120 00010000:00010000:2.0:1787826300.459909:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb49 expref: 38 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.459943:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2978 00000100:00100000:2.0:1787826300.459951:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789717120:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.459962:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.459967:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb49 expref: 38 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.459978:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb49 expref: 38 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.459996:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826300.460000:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.460009:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.460017:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.460037:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.460074:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789717120:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 123us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826300.460079:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a8a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb49 expref: 38 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.460084:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2978 00000100:00100000:1.0:1787826300.460092:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778616832:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.460109:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.460118:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.460123:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.460151:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.460158:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.460164:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.460170:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.460173:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.460179:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.460188:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:1.0:1787826300.460190:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826300.460194:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.460199:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a985 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.460234:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84197:x1874668789716608:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 5941us (6151us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826300.460241:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111208 00000100:00100000:1.0:1787826300.460573:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778616960:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.460587:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.462965:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.463006:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.463099:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789717376 00000100:00100000:2.0:1787826300.463107:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789717376 00010000:00010000:2.0:1787826300.463143:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb26 expref: 36 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.463182:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2979 00000100:00100000:2.0:1787826300.463192:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789717376:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.463206:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.463213:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb26 expref: 36 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.463226:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb26 expref: 36 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.463248:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349a835 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x119:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb26 expref: 36 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.463264:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:2.0:1787826300.463270:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.463279:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.463288:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.463327:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.463371:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2402:x1874668789717376:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 181us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.463379:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2979 00010000:00010000:0.0:1787826300.463520:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.463529:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.463567:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.463579:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.463586:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.463592:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.463596:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.463603:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.463613:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826300.463616:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826300.463619:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.463625:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349a98c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.463666:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84195:x1874668789716864:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 5979us (6474us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826300.463675:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111209 00000100:00100000:1.0:1787826300.464619:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789717248 00000100:00100000:1.0:1787826300.464628:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789717248 00000100:00100000:1.0:1787826300.464682:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6207 00000100:00100000:1.0:1787826300.464690:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789717248:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.464726:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.464745:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.464754:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826300.464758:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826300.464763:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.464815:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.464830:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 13 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.464844:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778617088:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.464946:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.465748:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.466252:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789717504 00000100:00100000:2.0:1787826300.466258:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789717504 00000100:00100000:2.0:1787826300.466315:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6208 00000100:00100000:2.0:1787826300.466324:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789717504:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.466357:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.466373:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 12 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.466381:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.466385:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826300.466389:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.466428:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 12 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.466440:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 12 pid: 8605 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.466453:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778617216:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.466517:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe131b4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.468990:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778617216:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.469018:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.470424:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.470475:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778617088:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.470501:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.471006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.471086:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789717632 00000100:00100000:0.0:1787826300.471093:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789717632 00010000:00010000:0.0:1787826300.471129:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 13 pid: 8605 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.471162:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789717760 00000100:00100000:0.0:1787826300.471165:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789717760 00010000:00010000:0.0:1787826300.471178:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 14 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.471178:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2980 00000100:00100000:1.0:1787826300.471187:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789717632:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826300.471201:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826300.471205:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2981 00000100:00100000:0.0:1787826300.471210:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789717760:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.471217:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.471223:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 13 pid: 8605 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471227:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 14 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.471236:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 13 pid: 8605 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471237:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 14 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471258:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349a946 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbba4 expref: 14 pid: 45681 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.471258:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008dda9b0/0x68019081f349a94d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbab expref: 13 pid: 8605 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471274:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826300.471274:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.471279:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826300.471279:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.471285:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.471285:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471296:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.471296:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.471319:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826300.471327:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826300.471491:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789717760:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 279us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.471498:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2981 00010000:00010000:0.0:1787826300.471522:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471530:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471550:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471558:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471566:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471572:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826300.471577:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471585:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471601:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.471609:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349a993 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.472429:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789717632:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1227us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.472440:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2980 00010000:00010000:1.0:1787826300.472473:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.472483:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.472503:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.472511:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.472518:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.472524:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826300.472527:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.472535:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.472547:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.472554:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349a99a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.472603:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789717504:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 6281us (6858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.472611:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6208 00000100:00100000:0.0:1787826300.473477:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789717248:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 8782us (10515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.473487:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6207 00000100:00100000:1.0:1787826300.473530:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.475738:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.475775:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.475835:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789718144 00000100:00100000:1.0:1787826300.475844:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789718144 00000100:00100000:0.0:1787826300.475848:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789717888 00000100:00100000:0.0:1787826300.475870:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789717888 00000100:00100000:0.0:1787826300.475903:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6209 00000100:00100000:0.0:1787826300.475912:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789717888:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.475954:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.475965:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789718400 00000100:00100000:1.0:1787826300.475968:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789718400 00010000:00010000:0.0:1787826300.475974:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.475983:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1787826300.475986:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111210 00010000:00010000:0.0:1787826300.475987:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.475993:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.475993:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84196:x1874668789718144:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.476024:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.476037:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 11 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.476047:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.476052:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778617344:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.476058:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.476068:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.476118:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.476136:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111211 00000100:00100000:0.0:1787826300.476143:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84197:x1874668789718400:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.476174:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.476183:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.476190:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.476222:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.476233:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb9 expref: 36 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.476241:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.476253:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.476263:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc0 expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.476263:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb9 expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.476271:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.476273:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb9 expref: 37 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.476283:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778617472:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.476286:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc0 expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.476309:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4300 going to sleep for 11 seconds 00010000:00010000:0.0:1787826300.478475:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc0 expref: 37 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.478494:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283de00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778617600:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.478744:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.480176:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.480201:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778617344:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.480210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:0.0:1787826300.480224:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.480500:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789718656 00000100:00100000:3.0:1787826300.480508:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789718656 00010000:00010000:3.0:1787826300.480546:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb9 expref: 38 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.480581:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789718528 00000100:00100000:3.0:1787826300.480584:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789718528 00010000:00010000:3.0:1787826300.480599:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 12 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.480639:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2982 00000100:00100000:3.0:1787826300.480649:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40512450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789718656:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.480662:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.480669:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb9 expref: 38 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.480681:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb9 expref: 38 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.480704:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:3.0:1787826300.480709:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.480718:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.480727:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.480745:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.480802:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40512450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789718656:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 143us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.480810:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2982 00000100:00100000:3.0:1787826300.481114:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2983 00010000:00010000:1.0:1787826300.481196:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349a970 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb9 expref: 37 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.481216:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778617472:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.481236:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.481262:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.481269:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826300.481373:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016332 00000100:00100000:3.0:1787826300.481441:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789718528:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.481453:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.481473:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 12 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.481486:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 12 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.481503:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005552d7ba/0x68019081f349a931 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbb8f expref: 12 pid: 8433 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.481516:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826300.481520:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826300.481524:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.481533:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.481553:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:1.0:1787826300.481575:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016334 00000100:00100000:3.0:1787826300.481580:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789718528:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 456us (1366us total) trans 0 rc 0/0 00000001:00080000:1.0:1787826300.481807:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016335 00000100:00100000:0.0:1787826300.481877:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.481925:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778617728:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787826300.481968:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826300.481992:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.482087:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283de00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778617600:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.482104:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.482233:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789718784 00000100:00100000:2.0:1787826300.482239:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789718784 00010000:00010000:2.0:1787826300.482262:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc0 expref: 40 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.482303:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2984 00000100:00100000:2.0:1787826300.482313:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2401:x1874668789718784:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.482323:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.482328:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc0 expref: 40 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.482339:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc0 expref: 40 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.482355:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349a977 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc0 expref: 40 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.482367:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826300.482371:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.482380:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.482387:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.482409:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.482459:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789718784:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 148us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.482467:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2984 00010000:00010000:2.0:1787826300.482488:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.482495:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826300.482562:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016333 00000001:00080000:2.0:1787826300.482674:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016337 00000001:00080000:2.0:1787826300.482710:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016338 00000100:00100000:2.0:1787826300.482763:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778617856:0@lo:1000:mdt00_007.0 00000100:00100000:2.0:1787826300.482809:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.482835:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff71a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.483195:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778617728 00000100:00100000:1.0:1787826300.483201:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778617728 00000100:00100000:1.0:1787826300.483231:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778617856 00000100:00100000:1.0:1787826300.483234:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778617856 00000100:00100000:1.0:1787826300.483257:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310 00000100:00100000:1.0:1787826300.483265:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778617728:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787826300.483352:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778617728:12345-0@lo:1000:mdt00_006.0 Request processed in 88us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.483359:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310 00000100:00100000:1.0:1787826300.483375:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311 00000100:00100000:1.0:1787826300.483380:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778617856:12345-0@lo:1000:mdt00_007.0 00000100:00100000:1.0:1787826300.483440:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778617856:12345-0@lo:1000:mdt00_007.0 Request processed in 60us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.483446:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311 00000100:00100000:1.0:1787826300.483477:0:25756:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968161 gen 2 00000004:00080000:1.0:1787826300.483482:0:25756:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968160 committed transno 4294968161 00000004:00080000:1.0:1787826300.483497:0:25756:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968161 committed transno 4294968161 00000100:00100000:1.0:1787826300.483509:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778617728:0@lo:1000:mdt00_006.0 00000001:00080000:1.0:1787826300.483619:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016336 00000100:00100000:1.0:1787826300.483776:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778617984:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787826300.483876:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826300.484127:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.484300:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2983 00000100:00100000:0.0:1787826300.484349:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778617984 00000100:00100000:0.0:1787826300.484354:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778617984 00000100:00100000:0.0:1787826300.484391:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3312 00000100:00100000:0.0:1787826300.484399:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778617984:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1787826300.484521:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778617984:12345-0@lo:1000:mdt00_006.0 Request processed in 123us (644us total) trans 4294968164 rc 0/0 00000100:00100000:0.0:1787826300.484528:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3312 00000100:00100000:0.0:1787826300.484564:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778617984:0@lo:1000:mdt00_006.0 00000001:00080000:0.0:1787826300.484620:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016340 00010000:00010000:0.0:1787826300.484657:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484667:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484673:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484679:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.484684:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484691:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484706:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:0.0:1787826300.484709:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.484714:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484720:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349a9b6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484742:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f34990e9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484749:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f34990e9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484755:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f34990e9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484760:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.484763:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f34990e9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484769:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f34990e9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484782:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe7:0x0].0x0 (ffff9bbe0bd66b00) 00010000:00010000:0.0:1787826300.484784:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.484787:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f34990e9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484801:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f34990e9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484822:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484833:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484842:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484849:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.484879:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485225:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485231:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.485233:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485240:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485250:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe7:0x0].0x0 (ffff9bbe0bd66b00) 00010000:00010000:0.0:1787826300.485252:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.485256:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485262:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349a9c4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485274:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485280:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485286:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485291:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.485355:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485364:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485373:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe7:0x0].0x0 (ffff9bbe0bd66b00) 00010000:00010000:0.0:1787826300.485376:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826300.485379:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.485385:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349a9a8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.485562:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84196:x1874668789718144:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 9566us (9829us total) trans 8590016341 rc 0/0 00000100:00100000:0.0:1787826300.485570:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111210 00000020:00080000:0.0:1787826300.485574:0:25756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00010000:00010000:2.0:1787826300.485700:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.485716:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.485738:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.485746:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.485753:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.485759:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826300.485763:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.485770:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.485783:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.485801:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349a9a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.486374:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789717888:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 10461us (12842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.486383:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6209 00000100:00100000:2.0:1787826300.486434:0:25759:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968143 gen 2 00000004:00080000:2.0:1787826300.486440:0:25759:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968143 committed transno 4294968143 00000100:00100000:2.0:1787826300.486457:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778617856:0@lo:1000:mdt00_007.0 00000001:00080000:2.0:1787826300.486563:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016339 00000100:00100000:2.0:1787826300.486615:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778618112:0@lo:1000:mdt00_007.0 00000100:00100000:2.0:1787826300.486668:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.486694:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.486981:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778618112 00000100:00100000:2.0:1787826300.486987:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778618112 00000100:00100000:2.0:1787826300.487025:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3313 00000100:00100000:2.0:1787826300.487032:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25759:x1874668778618112:12345-0@lo:1000:mdt00_007.0 00000100:00100000:2.0:1787826300.487130:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25759:x1874668778618112:12345-0@lo:1000:mdt00_007.0 Request processed in 99us (462us total) trans 4294968148 rc 0/0 00000100:00100000:2.0:1787826300.487137:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3313 00000100:00100000:2.0:1787826300.487163:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778618112:0@lo:1000:mdt00_007.0 00000001:00080000:2.0:1787826300.487214:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016342 00010000:00010000:2.0:1787826300.487233:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487241:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487253:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487258:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.487262:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487269:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487281:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826300.487283:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.487287:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487292:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349a9bd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487323:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f34990f0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487330:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f34990f0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487336:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f34990f0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487340:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceae00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.487343:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f34990f0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487353:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f34990f0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487360:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe8:0x0].0x0 (ffff9bbe0bd66700) 00010000:00010000:2.0:1787826300.487363:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.487366:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f34990f0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487371:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f34990f0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487389:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487400:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487408:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487423:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487430:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487436:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487441:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.487444:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487450:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487457:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe8:0x0].0x0 (ffff9bbe0bd66700) 00010000:00010000:2.0:1787826300.487459:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.487462:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487468:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9cb lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487477:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487483:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487489:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487493:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.487496:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487501:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487507:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe8:0x0].0x0 (ffff9bbe0bd66700) 00010000:00010000:2.0:1787826300.487509:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826300.487512:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.487521:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349a9af lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.488241:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+44:84197:x1874668789718400:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 12092us (12459us total) trans 8590016343 rc 0/0 00000100:00100000:2.0:1787826300.488251:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111211 00000020:00080000:2.0:1787826300.488256:0:25759:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826300.491440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.492272:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.492312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.492388:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789719552 00000100:00100000:3.0:1787826300.492396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789719552 00000100:00100000:3.0:1787826300.492463:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111212 00000100:00100000:3.0:1787826300.492474:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+44:84195:x1874668789719552:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.492557:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.492573:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.492584:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.492750:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.492762:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb2 expref: 45 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.492770:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.492801:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb2 expref: 45 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.492815:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb2 expref: 45 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.492828:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778618240:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826300.493104:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.495497:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789719168 00000100:00100000:0.0:1787826300.495510:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789719168 00000100:00100000:0.0:1787826300.495606:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789719296 00000100:00100000:0.0:1787826300.495610:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789719296 00000100:00100000:2.0:1787826300.495783:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2629 00000100:00100000:2.0:1787826300.495795:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+47:84196:x1874668789719168:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826300.496120:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x11b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826300.496154:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016345 00010000:00010000:2.0:1787826300.496186:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496201:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496213:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496222:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496228:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496235:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496359:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826300.496465:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84196:x1874668789719168:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 671us (5032us total) trans 8590016346 rc 0/0 00000100:00100000:2.0:1787826300.496473:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2629 00000020:00080000:2.0:1787826300.496478:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826300.496496:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2630 00000100:00100000:2.0:1787826300.496504:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84197:x1874668789719296:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826300.496602:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x11a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826300.496617:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016347 00010000:00010000:2.0:1787826300.496652:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496662:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496670:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496676:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496682:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.496689:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.497704:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778618240:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.497727:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.497771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.498085:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789719680 00000100:00100000:0.0:1787826300.498092:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789719680 00010000:00010000:0.0:1787826300.498119:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb2 expref: 51 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.498146:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2985 00000100:00100000:0.0:1787826300.498154:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+51:2402:x1874668789719680:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.498166:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.498172:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb2 expref: 51 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.498183:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb2 expref: 51 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.498202:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349a969 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbb2 expref: 51 pid: 23845 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.498217:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826300.498222:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.498231:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.498238:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.498257:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826300.498358:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2402:x1874668789719680:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 143us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.498367:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2985 00010000:00010000:1.0:1787826300.498440:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826300.498448:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.498456:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826300.498460:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.498468:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.498477:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:1.0:1787826300.498479:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826300.498482:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.498488:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349a9e0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.498497:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826300.498501:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.498506:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826300.498508:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.498514:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.498520:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:1.0:1787826300.498522:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826300.498524:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 3/0,0 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.498533:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826300.498534:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826300.498536:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826300.499366:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.499380:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826300.499489:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016344 00000001:00080000:3.0:1787826300.499601:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016349 00000001:00080000:3.0:1787826300.499750:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016350 00000100:00100000:3.0:1787826300.500045:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778618368:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787826300.500426:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826300.500500:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7300 going to sleep for 11 seconds 00010000:00010000:2.0:1787826300.500573:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787826300.500583:0:23877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349a9e7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.500686:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+52:84197:x1874668789719296:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 4180us (8370us total) trans 8590016348 rc 0/0 00000100:00100000:2.0:1787826300.500696:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2630 00000020:00080000:2.0:1787826300.500701:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826300.501189:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826300.501394:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778618368 00000100:00100000:0.0:1787826300.501402:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778618368 00000100:00100000:0.0:1787826300.501489:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3314 00000100:00100000:0.0:1787826300.501499:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778618368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826300.501603:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778618368:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.501610:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3314 00000100:00100000:1.0:1787826300.501679:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778618368:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787826300.501820:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016351 00000100:00100000:1.0:1787826300.501914:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778618496:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787826300.501949:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826300.502320:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.502441:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778618496 00000100:00100000:3.0:1787826300.502447:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778618496 00000100:00100000:3.0:1787826300.502487:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3315 00000100:00100000:3.0:1787826300.502494:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778618496:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787826300.502598:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6515:x1874668778618496:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (648us total) trans 4294968149 rc 0/0 00000100:00100000:3.0:1787826300.502605:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3315 00000100:00100000:3.0:1787826300.502650:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778618496:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787826300.502708:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016352 00010000:00010000:3.0:1787826300.502734:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502744:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502756:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502762:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.502766:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502774:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502789:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:3.0:1787826300.502793:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.502798:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502805:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349a9d9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502837:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f34990e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502844:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f34990e2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502870:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f34990e2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.502875:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.502878:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f34990e2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503053:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f34990e2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503063:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe6:0x0].0x0 (ffff9bbe0bd66400) 00010000:00010000:3.0:1787826300.503066:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.503069:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f34990e2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503075:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f34990e2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503096:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503107:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503117:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503124:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503130:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503136:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503141:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.503144:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503150:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503157:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe6:0x0].0x0 (ffff9bbe0bd66400) 00010000:00010000:3.0:1787826300.503159:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826300.503162:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503168:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349a9ee lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503175:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503181:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503186:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503191:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.503194:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503200:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503207:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe6:0x0].0x0 (ffff9bbe0bd66400) 00010000:00010000:3.0:1787826300.503209:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826300.503211:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.503221:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349a9d2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.503345:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84195:x1874668789719552:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 10870us (11072us total) trans 8590016353 rc 0/0 00000100:00100000:3.0:1787826300.503355:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111212 00000020:00080000:3.0:1787826300.503359:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1787826300.503461:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826300.503466:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826300.503582:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9682 count 103 00000040:00080000:3.0:1787826300.503588:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826300.503710:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778618624:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826300.503756:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.507799:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.508017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.508038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.508182:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778618624:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826300.508550:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789719936 00000100:00100000:0.0:1787826300.508558:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789719936 00000100:00100000:1.0:1787826300.508677:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2631 00000100:00100000:1.0:1787826300.508688:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84195:x1874668789719936:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787826300.509096:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x119:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826300.509125:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016354 00010000:00010000:1.0:1787826300.509158:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.509175:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.509186:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.509194:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.509200:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.509206:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.509222:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826300.509369:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84195:x1874668789719936:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 680us (1579us total) trans 8590016355 rc 0/0 00000100:00100000:1.0:1787826300.509379:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2631 00000020:00080000:1.0:1787826300.509384:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826300.510044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.510350:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789720064 00000100:00100000:3.0:1787826300.510358:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789720064 00000100:00100000:3.0:1787826300.510406:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789720192 00000100:00100000:3.0:1787826300.510410:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789720192 00000100:00100000:3.0:1787826300.510440:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789720320 00000100:00100000:3.0:1787826300.510443:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789720320 00000100:00100000:3.0:1787826300.510463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111213 00000100:00100000:3.0:1787826300.510470:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84200:x1874668789720064:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826300.510495:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe9:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826300.510581:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84200:x1874668789720064:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 110us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.510588:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111213 00000100:00100000:3.0:1787826300.510604:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111214 00000100:00100000:3.0:1787826300.510611:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84201:x1874668789720192:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826300.510623:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xea:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826300.510728:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111215 00000100:00100000:2.0:1787826300.510737:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84202:x1874668789720320:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826300.510754:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xeb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826300.510806:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84202:x1874668789720320:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 71us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.510823:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111215 00010000:00010000:2.0:1787826300.511005:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826300.511013:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.511022:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826300.511025:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.511033:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.511049:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:2.0:1787826300.511052:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826300.511057:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.511063:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349a9f5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x119:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.511077:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826300.511079:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826300.511081:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826300.511163:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84201:x1874668789720192:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 552us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.511171:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111214 00000100:00100000:1.0:1787826300.514230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.514318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.514448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.514503:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789720448 00000100:00100000:0.0:1787826300.514513:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789720448 00000100:00100000:0.0:1787826300.514566:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789720576 00000100:00100000:0.0:1787826300.514569:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789720576 00000100:00100000:0.0:1787826300.514591:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111216 00000100:00100000:0.0:1787826300.514599:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84202:x1874668789720448:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.514682:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514703:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514714:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514729:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514737:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514744:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514770:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 3/1,0 mode: --/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514778:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514785:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826300.514832:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xeb:0x0]: returning size 158 00000004:00200000:0.0:1787826300.514837:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826300.514848:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514895:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514906:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514912:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514918:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514925:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.514929:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514935:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514947:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826300.514950:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.514955:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514961:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349a9fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514975:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514981:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514987:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.514992:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.514995:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515001:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515008:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x71cb4932 (ffff9bbf0f565a00) 00010000:00010000:0.0:1787826300.515010:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.515013:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515019:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aa03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x71cb4932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515034:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515039:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515045:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515049:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.515052:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515057:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515067:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xeb:0x0].0x0 (ffff9bbe0bd66300) 00010000:00010000:0.0:1787826300.515069:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.515072:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 2/0,0 mode: --/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515077:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349aa0a lrc: 0/0,0 mode: --/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.515145:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84202:x1874668789720448:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 546us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.515152:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111216 00000100:00100000:0.0:1787826300.515174:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111217 00000100:00100000:0.0:1787826300.515181:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84201:x1874668789720576:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.515207:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515216:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515224:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515236:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515243:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515250:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515266:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515274:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515280:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826300.515315:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xea:0x0]: returning size 158 00000004:00200000:0.0:1787826300.515319:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826300.515326:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515334:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515339:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515345:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515351:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515357:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.515360:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515366:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515375:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826300.515377:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.515380:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515387:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349aa11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515397:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515403:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515409:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515426:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.515429:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515435:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515443:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xbd52bedd (ffff9bbf0f565500) 00010000:00010000:0.0:1787826300.515445:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.515448:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515454:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aa18 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbd52bedd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515471:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515478:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515484:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515488:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.515491:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515497:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515503:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xea:0x0].0x0 (ffff9bbe0bd66e00) 00010000:00010000:0.0:1787826300.515505:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.515508:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.515514:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aa1f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.515545:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84201:x1874668789720576:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 364us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.515552:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111217 00000100:00100000:2.0:1787826300.516557:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789720704 00000100:00100000:2.0:1787826300.516567:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789720704 00000100:00100000:0.0:1787826300.516628:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111218 00000100:00100000:0.0:1787826300.516649:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84200:x1874668789720704:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.516702:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.516716:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.516726:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.516741:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.516749:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.516755:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.516775:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.516783:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.516789:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826300.517056:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe9:0x0]: returning size 158 00000004:00200000:0.0:1787826300.517061:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826300.517072:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517082:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517090:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517096:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517102:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.517106:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517112:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517125:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826300.517127:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.517131:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517136:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349aa26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517151:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517157:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517164:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517168:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.517172:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517178:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517185:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x82d6ce1b (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826300.517187:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.517190:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517195:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349aa2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x82d6ce1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517210:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517215:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517220:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517224:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.517226:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517232:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517238:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe9:0x0].0x0 (ffff9bbe0bd66000) 00010000:00010000:0.0:1787826300.517240:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.517243:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.517247:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349aa34 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.517378:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84200:x1874668789720704:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 730us (2927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.517386:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111218 00000100:00100000:3.0:1787826300.518218:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.518655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.519208:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789720960 00000100:00100000:2.0:1787826300.519217:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789720960 00000100:00100000:2.0:1787826300.519257:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789721216 00000100:00100000:2.0:1787826300.519260:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789721216 00000100:00100000:2.0:1787826300.519288:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111219 00000100:00100000:2.0:1787826300.519307:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84202:x1874668789720960:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.519324:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.519343:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349aa3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbc7 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519449:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519462:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519472:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.519481:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xeb:0x0]: returning size 158 00010000:00010000:2.0:1787826300.519558:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519565:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519570:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519576:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.519579:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519587:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519598:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xeb:0x0].0x0 (ffff9bbe0bd66300) 00010000:00010000:2.0:1787826300.519601:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826300.519604:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519610:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aa42 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xeb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519765:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349aa3b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc7 expref: 58 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519776:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826300.519778:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826300.519782:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349aa3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbc7 expref: 58 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.519793:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:2.0:1787826300.520001:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84202:x1874668789720960:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 703us (1783us total) trans 8590016356 rc 301/301 00000100:00100000:2.0:1787826300.520009:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111219 00000100:00100000:2.0:1787826300.520031:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111220 00000100:00100000:2.0:1787826300.520039:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84201:x1874668789721216:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.520049:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.520058:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349aa50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbce expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520107:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520116:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520124:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.520131:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xea:0x0]: returning size 158 00010000:00010000:2.0:1787826300.520164:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520170:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520176:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520180:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.520184:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520190:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520198:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xea:0x0].0x0 (ffff9bbe0bd66e00) 00010000:00010000:2.0:1787826300.520200:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826300.520204:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520209:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa57 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520231:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349aa50 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbce expref: 58 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520239:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826300.520242:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826300.520245:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349aa50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbce expref: 58 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.520253:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826300.520275:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84201:x1874668789721216:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 237us (1622us total) trans 8590016357 rc 301/301 00000100:00100000:2.0:1787826300.520282:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111220 00000100:00100000:0.0:1787826300.525957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.526095:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789721472 00000100:00100000:1.0:1787826300.526105:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789721472 00000100:00100000:1.0:1787826300.526159:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111221 00000100:00100000:1.0:1787826300.526169:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84200:x1874668789721472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.526188:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.526208:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbd5 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526321:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526336:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526347:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.526358:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe9:0x0]: returning size 158 00010000:00010000:1.0:1787826300.526444:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526456:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526463:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526469:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.526473:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526480:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526491:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe9:0x0].0x0 (ffff9bbe0bd66000) 00010000:00010000:1.0:1787826300.526494:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826300.526498:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526505:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526544:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa65 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbd5 expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526554:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826300.526557:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826300.526561:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbd5 expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.526569:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826300.526642:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84200:x1874668789721472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 466us (685us total) trans 8590016358 rc 301/301 00000100:00100000:1.0:1787826300.526650:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111221 00000100:00100000:0.0:1787826300.530739:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.531009:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789721600 00000100:00100000:3.0:1787826300.531020:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789721600 00000100:00100000:3.0:1787826300.531081:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111222 00000100:00100000:3.0:1787826300.531091:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84202:x1874668789721600:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826300.531128:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xeb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826300.531236:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84202:x1874668789721600:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 147us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.531244:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111222 00000100:00100000:0.0:1787826300.535612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.535660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.535798:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789721856 00000100:00100000:3.0:1787826300.535807:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789721856 00000100:00100000:3.0:1787826300.535897:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789721728 00000100:00100000:3.0:1787826300.535900:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789721728 00000100:00100000:3.0:1787826300.535927:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111223 00000100:00100000:3.0:1787826300.535936:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84201:x1874668789721856:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826300.535965:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xea:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826300.536073:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84201:x1874668789721856:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 138us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.536080:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111223 00000100:00100000:3.0:1787826300.536098:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111224 00000100:00100000:3.0:1787826300.536105:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84200:x1874668789721728:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826300.536119:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xe9:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826300.536160:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84200:x1874668789721728:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 55us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.536172:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111224 00000100:00100000:1.0:1787826300.538351:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.538447:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789722112 00000100:00100000:2.0:1787826300.538455:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789722112 00000100:00100000:2.0:1787826300.538515:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111225 00000100:00100000:2.0:1787826300.538525:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84202:x1874668789722112:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.538545:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.538566:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349aa7a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbdc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.539217:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.539234:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.539246:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.539255:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11c:0x0]: returning size 0 00010000:00010000:2.0:1787826300.539302:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349aa7a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbdc expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.539319:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbdc expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.539328:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826300.539331:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826300.539334:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826300.539388:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84202:x1874668789722112:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 865us (1046us total) trans 8590016359 rc 0/0 00000100:00100000:2.0:1787826300.539396:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111225 00000100:00100000:0.0:1787826300.543501:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.543599:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789722368 00000100:00100000:1.0:1787826300.543609:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789722368 00000100:00100000:1.0:1787826300.543739:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111226 00000100:00100000:1.0:1787826300.543751:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84202:x1874668789722368:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.544102:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.544131:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aa81 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbdc expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544151:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826300.544161:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826300.544184:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544197:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544207:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544221:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544229:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544236:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544286:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544294:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544413:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544429:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544435:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.544439:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544447:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544455:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826300.544458:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826300.544462:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544468:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aa8f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544479:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544485:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544491:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544496:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.544498:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544504:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544510:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xbd6ce6c (ffff9bbe12458400) 00010000:00010000:1.0:1787826300.544512:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826300.544515:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.544520:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aa96 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xbd6ce6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.544595:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84202:x1874668789722368:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 847us (1103us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826300.544603:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111226 00000100:00100000:1.0:1787826300.550153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.550246:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.550370:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789722496 00000100:00100000:3.0:1787826300.550381:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789722496 00000100:00100000:3.0:1787826300.550450:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789722752 00000100:00100000:3.0:1787826300.550454:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789722752 00000100:00100000:3.0:1787826300.550486:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111227 00000100:00100000:3.0:1787826300.550497:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84202:x1874668789722496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.550517:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.550540:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349aa9d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbe3 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.550579:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.550593:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.550606:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.550737:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111228 00000100:00100000:1.0:1787826300.550747:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84201:x1874668789722752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.550755:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.550766:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349aaab lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.551243:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aab2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.551254:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aab2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.551263:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aab2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.551273:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11d:0x0]: returning size 0 00010000:00010000:1.0:1787826300.551318:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349aaab lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbea expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.551336:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aab2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbea expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.551345:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe12458100) 00010000:00010000:1.0:1787826300.551347:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826300.551350:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:1.0:1787826300.551408:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84201:x1874668789722752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 664us (1162us total) trans 8590016360 rc 0/0 00000100:00100000:1.0:1787826300.551433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111228 00010000:00010000:3.0:1787826300.551667:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349aa9d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbe3 expref: 63 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.551682:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbe3 expref: 62 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.551690:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:3.0:1787826300.551693:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826300.551695:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00000100:00100000:3.0:1787826300.551733:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84202:x1874668789722496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1238us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.551740:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111227 00000100:00100000:1.0:1787826300.556398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.556498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.556756:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789723008 00000100:00100000:2.0:1787826300.556766:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789723008 00000100:00100000:2.0:1787826300.557124:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789723264 00000100:00100000:2.0:1787826300.557129:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789723264 00000100:00100000:1.0:1787826300.557227:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111229 00000100:00100000:1.0:1787826300.557237:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84201:x1874668789723008:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.557290:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.557314:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aab2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbea expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557332:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe12458100) 00010000:00010000:1.0:1787826300.557343:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826300.557364:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557377:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557386:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557397:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557403:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557409:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557461:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557468:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557474:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557481:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557487:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.557491:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557497:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557505:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826300.557508:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826300.557512:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557518:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349aac0 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557528:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557533:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557539:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557544:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.557546:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557551:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557561:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xdd6e74ab (ffff9bbe12458400) 00010000:00010000:1.0:1787826300.557563:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826300.557565:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.557571:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aac7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xdd6e74ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.558175:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111230 00000100:00100000:0.0:1787826300.558189:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84202:x1874668789723264:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.558245:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.558255:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.558263:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826300.558394:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb04c3bc reply state 00000000658ed0a3 transno 8590016361 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.558406:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.558430:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:0.0:1787826300.558432:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787826300.558434:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826300.558552:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84201:x1874668789723008:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1315us (2162us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826300.558560:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111229 00000100:00100000:0.0:1787826300.563132:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84202:x1874668789723264:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 4935us (6621us total) trans 8590016361 rc 0/0 00000100:00100000:0.0:1787826300.563146:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111230 00000100:00100000:0.0:1787826300.565184:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.565257:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.565488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.565723:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789723520 00000100:00100000:3.0:1787826300.565732:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789723520 00000100:00100000:2.0:1787826300.565880:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789723648 00000100:00100000:2.0:1787826300.565885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789723648 00000100:00100000:2.0:1787826300.565917:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111231 00000100:00100000:2.0:1787826300.565926:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84200:x1874668789723520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.565947:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.565968:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349aad5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbf1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.566389:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349aadc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.566405:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349aadc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.566429:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349aadc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.566439:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11e:0x0]: returning size 0 00010000:00010000:2.0:1787826300.566483:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349aad5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf1 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.566500:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349aadc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf1 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.566508:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826300.566510:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826300.566514:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:2.0:1787826300.566572:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84200:x1874668789723520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 647us (1395us total) trans 8590016362 rc 0/0 00000100:00100000:2.0:1787826300.566583:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111231 00000100:00100000:2.0:1787826300.566604:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111232 00000100:00100000:2.0:1787826300.566611:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84202:x1874668789723648:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.566621:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.566629:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.566785:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf8 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.566805:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf8 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.566814:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:2.0:1787826300.566816:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.566819:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2e00, rc 0) 00000100:00100000:2.0:1787826300.566840:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84202:x1874668789723648:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 230us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.566846:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111232 00000100:00100000:2.0:1787826300.567483:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789723776 00000100:00100000:2.0:1787826300.567492:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789723776 00000100:00100000:2.0:1787826300.567538:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111233 00000100:00100000:2.0:1787826300.567546:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84201:x1874668789723776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.567557:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.567572:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aaf1 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbbff expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.567595:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.567603:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.567611:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.567881:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349aaf1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbff expref: 68 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.567897:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbff expref: 67 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.567904:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826300.567906:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826300.567908:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:2.0:1787826300.567956:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84201:x1874668789723776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 411us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.567963:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111233 00000100:00100000:0.0:1787826300.569808:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.569916:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.570014:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789724160 00000100:00100000:1.0:1787826300.570023:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789724160 00000100:00100000:1.0:1787826300.570078:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111234 00000100:00100000:1.0:1787826300.570087:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84201:x1874668789724160:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.570165:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.570180:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.570191:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826300.570324:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a531c371 reply state 000000007cacc3b6 transno 8590016363 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.570337:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.570345:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:1.0:1787826300.570348:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826300.570352:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826300.570452:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84201:x1874668789724160:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 366us (535us total) trans 8590016363 rc 0/0 00000100:00100000:1.0:1787826300.570459:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111234 00000100:00100000:2.0:1787826300.570898:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789723904 00000100:00100000:2.0:1787826300.570904:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789723904 00000100:00100000:2.0:1787826300.570943:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2632 00000100:00100000:2.0:1787826300.570951:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84202:x1874668789723904:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.571015:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84202:x1874668789723904:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 65us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.571026:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2632 00000100:00100000:0.0:1787826300.572902:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.572944:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789724288 00000100:00100000:2.0:1787826300.572952:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789724288 00000100:00100000:2.0:1787826300.573009:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111235 00000100:00100000:2.0:1787826300.573019:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84201:x1874668789724288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.573038:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.573058:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc06 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.573107:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc06 expref: 70 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.573121:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc06 expref: 70 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.573130:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826300.573133:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.573136:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826300.573191:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84201:x1874668789724288:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 173us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.573198:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111235 00000100:00100000:0.0:1787826300.573703:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.573764:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789724544 00000100:00100000:2.0:1787826300.573769:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789724544 00000100:00100000:2.0:1787826300.573957:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2633 00000100:00100000:2.0:1787826300.573967:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84202:x1874668789724544:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.574157:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84202:x1874668789724544:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 191us (454us total) trans 8590016364 rc 0/0 00000100:00100000:2.0:1787826300.574165:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2633 00000100:00100000:3.0:1787826300.575379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.577220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.577293:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789724928 00000100:00100000:2.0:1787826300.577302:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789724928 00000100:00100000:2.0:1787826300.577353:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111236 00000100:00100000:2.0:1787826300.577362:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84202:x1874668789724928:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.577481:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84202:x1874668789724928:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 120us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.577489:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111236 00000100:00100000:3.0:1787826300.577531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.577742:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789725184 00000100:00100000:2.0:1787826300.577747:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789725184 00000100:00100000:2.0:1787826300.577780:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111237 00000100:00100000:2.0:1787826300.577787:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84200:x1874668789725184:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.578147:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.578174:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349aadc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf1 expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578191:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826300.578200:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.578221:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578233:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578243:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578260:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578266:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578273:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578329:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578336:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578343:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578349:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.578353:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578362:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578371:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.578374:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.578378:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578384:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab0d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578394:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578401:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578406:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578411:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.578426:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578433:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578441:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x351fcda8 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826300.578444:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.578447:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.578454:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab14 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x351fcda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.578509:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84200:x1874668789725184:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 721us (978us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826300.578514:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111237 00000100:00100000:1.0:1787826300.579163:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789724672 00000100:00100000:1.0:1787826300.579170:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789724672 00000100:00100000:1.0:1787826300.579207:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2634 00000100:00100000:1.0:1787826300.579215:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84201:x1874668789724672:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.579288:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84201:x1874668789724672:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 73us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.579295:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2634 00000100:00100000:3.0:1787826300.579449:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.580759:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789725440 00000100:00100000:1.0:1787826300.580770:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789725440 00000100:00100000:1.0:1787826300.580950:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111238 00000100:00100000:1.0:1787826300.580960:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84202:x1874668789725440:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.580976:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.580995:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab1b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc0d expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.581092:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.581106:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf8 expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.581118:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.581148:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf8 expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.581162:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf8 expref: 71 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.581175:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778618752:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.581256:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.581495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.593257:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.593400:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789725824 00000100:00100000:3.0:1787826300.593410:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789725824 00000100:00100000:3.0:1787826300.593478:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2635 00000100:00100000:3.0:1787826300.593489:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84201:x1874668789725824:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.593726:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84201:x1874668789725824:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 238us (479us total) trans 8590016365 rc 0/0 00000100:00100000:3.0:1787826300.593733:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2635 00000100:00100000:2.0:1787826300.597529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.597618:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789725952 00000100:00100000:3.0:1787826300.597627:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789725952 00010000:00010000:3.0:1787826300.597668:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf8 expref: 73 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.597709:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2986 00000100:00100000:3.0:1787826300.597719:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:2402:x1874668789725952:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.597736:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.597743:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf8 expref: 73 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.597757:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf8 expref: 73 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.597779:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:3.0:1787826300.597785:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.597820:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.597828:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.597848:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.597926:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:2402:x1874668789725952:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 208us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.597934:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2986 00000100:00100000:0.0:1787826300.597979:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789725568 00000100:00100000:0.0:1787826300.597985:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789725568 00000100:00100000:0.0:1787826300.598032:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111239 00000100:00100000:0.0:1787826300.598039:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84200:x1874668789725568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.598055:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.598073:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ab29 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc14 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.598103:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.598112:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.598125:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.598231:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ab29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc14 expref: 75 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.598249:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc14 expref: 74 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.598257:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826300.598260:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826300.598262:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:0.0:1787826300.598301:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84200:x1874668789725568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 257us (16801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.598308:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111239 00010000:00010000:1.0:1787826300.598623:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349aaea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbf8 expref: 73 pid: 6517 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.598637:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778618752:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.598655:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.598662:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.598668:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.598681:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11c:0x0]: returning size 0 00000004:00080000:1.0:1787826300.598827:0:25759:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xbd:0x0], index 0: 0 00010000:00010000:1.0:1787826300.598941:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.598950:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.598957:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.598963:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.598968:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.598975:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.598986:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:1.0:1787826300.598989:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.598992:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.598999:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ab22 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.599038:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab1b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc0d expref: 73 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.599047:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826300.599050:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826300.599053:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab1b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc0d expref: 73 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.599063:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826300.599102:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84202:x1874668789725440:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 18144us (19654us total) trans 8590016366 rc 301/301 00000100:00100000:1.0:1787826300.599108:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111238 00000100:00100000:2.0:1787826300.599287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.599630:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789726208 00000100:00100000:1.0:1787826300.599636:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789726208 00000100:00100000:1.0:1787826300.599676:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111240 00000100:00100000:1.0:1787826300.599684:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84201:x1874668789726208:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.599917:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84201:x1874668789726208:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 232us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.599925:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111240 00000100:00100000:2.0:1787826300.604598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.604732:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789726464 00000100:00100000:1.0:1787826300.604743:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789726464 00000100:00100000:1.0:1787826300.604804:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2636 00000100:00100000:1.0:1787826300.604824:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84202:x1874668789726464:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.605130:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84202:x1874668789726464:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 317us (540us total) trans 8590016367 rc 0/0 00000100:00100000:1.0:1787826300.605138:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2636 00000100:00100000:3.0:1787826300.607231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.607467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789726720 00000100:00100000:0.0:1787826300.607476:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789726720 00000100:00100000:0.0:1787826300.607533:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111241 00000100:00100000:0.0:1787826300.607543:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84200:x1874668789726720:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.607625:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.607642:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.607653:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826300.607798:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e801968 reply state 0000000025fe74d9 transno 8590016368 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.607821:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.607829:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826300.607832:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787826300.607836:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826300.607956:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84200:x1874668789726720:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 414us (732us total) trans 8590016368 rc 0/0 00000100:00100000:0.0:1787826300.607963:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111241 00000100:00100000:0.0:1787826300.609916:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.609955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.610022:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789726976 00000100:00100000:3.0:1787826300.610030:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789726976 00000100:00100000:2.0:1787826300.610045:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789727104 00000100:00100000:2.0:1787826300.610049:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789727104 00000100:00100000:3.0:1787826300.610079:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111242 00000100:00100000:2.0:1787826300.610084:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111243 00000100:00100000:3.0:1787826300.610088:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84202:x1874668789726976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.610090:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84201:x1874668789727104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.610106:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.610106:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.610123:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab45 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc1b expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.610124:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ab4c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc22 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.610180:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349ab53 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.610193:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.610198:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.610203:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.610208:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc06 expref: 78 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.610216:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826300.610224:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11c:0x0]: returning size 0 00000004:00200000:3.0:1787826300.610227:0:45682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826300.610243:0:45682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.610246:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc06 expref: 78 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.610258:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc06 expref: 79 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.610265:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ab4c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc22 expref: 79 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.610271:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778618880:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.610281:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349ab53 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc22 expref: 78 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.610289:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:3.0:1787826300.610291:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826300.610305:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826300.610330:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84202:x1874668789726976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 244us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.610337:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.610337:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111242 00000100:00100000:3.0:1787826300.610965:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.611041:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789727232 00000100:00100000:1.0:1787826300.611047:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789727232 00000100:00100000:1.0:1787826300.611083:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111244 00000100:00100000:1.0:1787826300.611092:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84200:x1874668789727232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.611105:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.611119:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc29 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.611154:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc29 expref: 79 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.611166:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc29 expref: 79 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.611175:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:1.0:1787826300.611179:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.611182:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826300.611218:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84200:x1874668789727232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 128us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.611224:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111244 00000100:00100000:3.0:1787826300.617152:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.617187:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778618880:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826300.617193:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:2.0:1787826300.617213:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.617273:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789727360 00000100:00100000:0.0:1787826300.617279:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789727360 00000100:00100000:0.0:1787826300.617332:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6210 00000100:00100000:0.0:1787826300.617342:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789727360:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.617359:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.617375:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc30 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826300.617397:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826300.617425:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=2938s v=(0 0) 00010000:00010000:0.0:1787826300.617431:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.617440:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc30 expref: 13 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.617462:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc30 expref: 13 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.617475:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3c00, rc 0) 00000100:00100000:0.0:1787826300.617535:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789727360:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 194us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.617543:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6210 00000100:00100000:1.0:1787826300.617616:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789727488 00000100:00100000:1.0:1787826300.617622:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789727488 00010000:00010000:1.0:1787826300.617644:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc06 expref: 79 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.617678:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2987 00000100:00100000:1.0:1787826300.617685:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2401:x1874668789727488:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826300.617695:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.617701:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc06 expref: 79 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.617714:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc06 expref: 79 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.617733:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ab06 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc06 expref: 79 pid: 7736 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.617749:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:1.0:1787826300.617754:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.617763:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.617770:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.617788:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826300.617810:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+78:2401:x1874668789727488:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 125us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.617817:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2987 00010000:00010000:2.0:1787826300.617952:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.617960:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.617977:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11d:0x0]: returning size 0 00000004:00080000:2.0:1787826300.618124:0:23845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xbe:0x0], index 1: 0 00010000:00010000:2.0:1787826300.618218:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.618227:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.618233:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.618239:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.618243:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.618250:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.618259:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826300.618262:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.618265:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.618275:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ab5a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.618317:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab45 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc1b expref: 78 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.618327:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.618329:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826300.618333:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349ab45 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc1b expref: 78 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.618342:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826300.618366:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84201:x1874668789727104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 8276us (8411us total) trans 8590016369 rc 301/301 00000100:00100000:2.0:1787826300.618373:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111243 00000100:00100000:0.0:1787826300.621669:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.621711:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.621774:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789727872 00000100:00100000:2.0:1787826300.621782:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789727872 00000100:00100000:2.0:1787826300.621842:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111245 00000100:00100000:2.0:1787826300.621884:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84202:x1874668789727872:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.621986:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84202:x1874668789727872:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 135us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.621993:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111245 00000100:00100000:3.0:1787826300.622356:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789727616 00000100:00100000:3.0:1787826300.622362:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789727616 00000100:00100000:3.0:1787826300.622399:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2637 00000100:00100000:3.0:1787826300.622407:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84200:x1874668789727616:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.622494:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84200:x1874668789727616:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 87us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.622501:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2637 00000100:00100000:0.0:1787826300.629061:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.629142:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.629221:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789728512 00000100:00100000:2.0:1787826300.629231:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789728512 00000100:00100000:2.0:1787826300.629290:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2638 00000100:00100000:2.0:1787826300.629310:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84200:x1874668789728512:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.629542:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84200:x1874668789728512:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 234us (398us total) trans 8590016370 rc 0/0 00000100:00100000:2.0:1787826300.629551:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2638 00000100:00100000:1.0:1787826300.632006:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789728256 00000100:00100000:1.0:1787826300.632019:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789728256 00000100:00100000:1.0:1787826300.632141:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6211 00000100:00100000:1.0:1787826300.632153:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84202:x1874668789728256:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.632169:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.632187:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc37 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.632215:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc30 expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.632225:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826300.632229:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826300.632235:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.632266:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc30 expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.632280:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc30 expref: 14 pid: 8432 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.632307:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778619008:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.632394:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.638621:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.639250:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789728128 00000100:00100000:2.0:1787826300.639260:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789728128 00000100:00100000:2.0:1787826300.639322:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2639 00000100:00100000:2.0:1787826300.639331:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84201:x1874668789728128:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.639641:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84201:x1874668789728128:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 308us (1027us total) trans 8590016371 rc 0/0 00000100:00100000:2.0:1787826300.639649:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2639 00000100:00100000:1.0:1787826300.641411:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.642350:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789728768 00000100:00100000:0.0:1787826300.642359:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789728768 00000100:00100000:0.0:1787826300.642429:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111246 00000100:00100000:0.0:1787826300.642439:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84200:x1874668789728768:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.642536:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84200:x1874668789728768:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 98us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.642543:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111246 00000100:00100000:0.0:1787826300.644056:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778619008:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826300.644057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:0.0:1787826300.644091:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.644110:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:0.0:1787826300.644151:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84202:x1874668789728256:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 12000us (15101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.644159:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6211 00000100:00100000:1.0:1787826300.644958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.645035:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789729024 00000100:00100000:0.0:1787826300.645042:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789729024 00000100:00100000:0.0:1787826300.645120:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111247 00000100:00100000:0.0:1787826300.645129:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84201:x1874668789729024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.645148:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.645166:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349ab7d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc3e expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.645227:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ab84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.645240:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ab84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.645250:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ab84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826300.645291:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11d:0x0]: returning size 0 00000004:00200000:0.0:1787826300.645295:0:45682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826300.645313:0:45682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ab84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.645339:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349ab7d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc3e expref: 81 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.645356:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ab84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc3e expref: 80 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.645370:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:0.0:1787826300.645374:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826300.645377:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826300.645429:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84201:x1874668789729024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 301us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.645436:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111247 00000100:00100000:2.0:1787826300.645500:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789728896 00000100:00100000:2.0:1787826300.645505:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789728896 00010000:00010000:2.0:1787826300.645529:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc30 expref: 14 pid: 8432 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.645557:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2988 00000100:00100000:2.0:1787826300.645566:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789728896:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826300.645576:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.645595:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc30 expref: 14 pid: 8432 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.645608:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc30 expref: 14 pid: 8432 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.645627:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349ab68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc30 expref: 14 pid: 8432 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.645640:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.645645:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.645653:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.645664:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.645717:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.645730:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778619136:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826300.645784:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.651282:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.651332:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778619136:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826300.651359:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826300.651365:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789729280 00000100:00100000:1.0:1787826300.651373:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789729280 00000100:00100000:1.0:1787826300.651439:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111248 00000100:00100000:1.0:1787826300.651449:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84200:x1874668789729280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.651467:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.651486:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ab8b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc45 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.651606:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.651621:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc29 expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.651634:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.651662:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc29 expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.651675:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc29 expref: 81 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.651688:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa97c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778619264:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826300.653849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.653942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.654523:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789728896:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 8953us (10465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.654538:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2988 00000100:00100000:0.0:1787826300.654579:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789729408 00000100:00100000:0.0:1787826300.654587:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789729408 00000100:00100000:0.0:1787826300.654625:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6212 00000100:00100000:0.0:1787826300.654634:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789729408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.654650:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.654668:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc4c expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826300.655190:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826300.655213:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=2938s v=(0 0) 00010000:00010000:0.0:1787826300.655217:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.655227:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc4c expref: 11 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.655251:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc4c expref: 11 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.655264:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2200, rc 0) 00000100:00100000:0.0:1787826300.655300:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789729408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 667us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.655307:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6212 00000100:00100000:0.0:1787826300.655330:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789729536 00000100:00100000:0.0:1787826300.655334:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789729536 00002000:00100000:0.0:1787826300.655361:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xbd:0x0] (0->157) req@ffff9bbe0d7a2d00 x1874668789729536/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/0 e 0 to 0 dl 1787826311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826300.655370:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0d7a2d00 with x1874668789729536 ext(0->157) 00002000:00010000:0.0:1787826300.655375:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0d7a2d00 00000100:00100000:0.0:1787826300.655396:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1564 00000100:00100000:0.0:1787826300.655403:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789729536:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.656459:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789729536:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1052us (2513us total) trans 4294968165 rc 0/0 00000100:00100000:0.0:1787826300.656470:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1564 00002000:00100000:0.0:1787826300.656479:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xbd:0x0] (0->157) req@ffff9bbe0d7a2d00 x1874668789729536/t4294968165(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/448 e 0 to 0 dl 1787826311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826300.656488:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0d7a2d00 with x1874668789729536 ext(0->157) 00002000:00010000:0.0:1787826300.656494:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0d7a2d00 00000100:00100000:1.0:1787826300.659478:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.661555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.661737:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789729664 00000100:00100000:1.0:1787826300.661746:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789729664 00000100:00100000:1.0:1787826300.661807:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111249 00000100:00100000:1.0:1787826300.661818:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84202:x1874668789729664:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787826300.664531:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016371 is committed 00000020:00080000:3.0:1787826300.664576:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0f53d840 refcount 2 committed 0 result 0 batchid 4294970879 00000020:00080000:3.0:1787826300.664582:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f53df00 00000020:00080000:3.0:1787826300.664586:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d246400 00000020:00080000:1.0:1787826300.664627:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970873 00010000:00010000:0.0:1787826300.664689:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664701:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664710:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664716:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.664722:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664730:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664748:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11b:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:0.0:1787826300.664752:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.664757:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664764:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349a954 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664791:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664798:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664805:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664815:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.664818:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664824:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664832:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x119:0x0].0x0 (ffff9bbe0a9bfa00) 00010000:00010000:0.0:1787826300.664835:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.664838:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664844:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349a95b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x119:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664899:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664907:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664913:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664917:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.664920:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664925:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664938:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11a:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826300.664940:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.664943:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664949:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349a962 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664962:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664969:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664975:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664981:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.664984:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664990:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.664998:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:0.0:1787826300.665001:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826300.665004:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665010:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349aace lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665026:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665032:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665038:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665043:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.665046:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665052:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665060:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:0.0:1787826300.665062:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826300.665065:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665071:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349aaff lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665082:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665088:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665094:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665101:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.665103:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665109:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665116:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826300.665119:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826300.665122:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.665138:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ab3e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787826300.666561:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe131b4d80 refcount 2 committed 0 result 0 batchid 4294970878 00000020:00080000:3.0:1787826300.666571:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe131b4780 00000020:00080000:3.0:1787826300.666574:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c166600 00000020:00080000:3.0:1787826300.666587:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0f53d780 refcount 2 committed 0 result 0 batchid 4294970877 00000020:00080000:3.0:1787826300.666591:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bcc3300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f53d000 00000020:00080000:3.0:1787826300.666594:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bcc3700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f95c200 00000020:00080000:3.0:1787826300.666611:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970876 batchid updated 00000020:00080000:1.0:1787826300.666689:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970879 committed batchid 4294970876 00000020:00080000:1.0:1787826300.666762:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970876 00000100:00100000:1.0:1787826300.666921:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84202:x1874668789729664:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 5099us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.666932:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111249 00000100:00100000:3.0:1787826300.667363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.667489:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.667566:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789729920 00000100:00100000:1.0:1787826300.667574:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789729920 00000100:00100000:1.0:1787826300.667621:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111250 00000100:00100000:1.0:1787826300.667630:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84201:x1874668789729920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.667702:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84201:x1874668789729920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 73us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.667709:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111250 00000100:00100000:3.0:1787826300.667804:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789730048 00000100:00100000:3.0:1787826300.667809:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789730048 00010000:00010000:3.0:1787826300.667836:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc29 expref: 33 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.667883:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2989 00000100:00100000:3.0:1787826300.667891:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40513450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668789730048:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.667901:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.667908:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc29 expref: 33 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.667922:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc29 expref: 33 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.667943:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826300.667948:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.667957:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.667966:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.667985:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.668020:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40513450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668789730048:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 130us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.668069:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2989 00010000:00010000:3.0:1787826300.668977:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ab61 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc29 expref: 32 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.668995:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa97c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778619264:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.669014:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.669110:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.669117:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826300.669140:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11e:0x0]: returning size 0 00000100:00100000:0.0:1787826300.669357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.669431:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789730176 00000100:00100000:1.0:1787826300.669437:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789730176 00000100:00100000:1.0:1787826300.669475:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6213 00000100:00100000:1.0:1787826300.669483:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789730176:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1787826300.672641:0:25756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xbe:0x0], index 0: 0 00000100:00100000:0.0:1787826300.673356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.674031:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789730304 00000100:00100000:3.0:1787826300.674041:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789730304 00000100:00100000:3.0:1787826300.674102:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6214 00000100:00100000:3.0:1787826300.674113:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84201:x1874668789730304:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.674130:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.674148:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc53 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674188:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc4c expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674204:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.674208:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.674213:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 12 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674254:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc4c expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674269:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc4c expref: 12 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826300.674284:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968165 is committed 00000100:00100000:3.0:1787826300.674284:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778619392:192.168.203.9@tcp:104: 00000001:00080000:0.0:1787826300.674310:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968164 is committed 00000100:00100000:3.0:1787826300.674363:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56600 going to sleep for 11 seconds 00010000:00010000:3.0:1787826300.674477:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674487:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674494:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674500:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.674505:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674514:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674529:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826300.674532:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.674537:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674542:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ab92 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674590:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ab8b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc45 expref: 32 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674644:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826300.674647:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826300.674651:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ab8b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc45 expref: 32 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.674661:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:3.0:1787826300.674692:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84200:x1874668789729280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 23244us (23420us total) trans 8590016372 rc 301/301 00000100:00100000:3.0:1787826300.674700:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111248 00000100:00100000:1.0:1787826300.675006:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789730176:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 5522us (5648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.675015:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6213 00000100:00100000:0.0:1787826300.679038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.679341:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789730432 00000100:00100000:3.0:1787826300.679350:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789730432 00010000:00010000:3.0:1787826300.679394:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc4c expref: 13 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.679438:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2990 00000100:00100000:3.0:1787826300.679450:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789730432:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.679470:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.679492:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc4c expref: 13 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.679506:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc4c expref: 13 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.679529:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.679534:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.679542:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 13 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.679551:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 13 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.679585:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 13 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.679733:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a1a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778619520:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826300.680748:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.682252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.682289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.682994:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789730688 00000100:00100000:3.0:1787826300.683004:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789730688 00000100:00100000:3.0:1787826300.683058:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2640 00000100:00100000:3.0:1787826300.683068:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84200:x1874668789730688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.683460:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349ab99 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc4c expref: 13 pid: 45681 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.683479:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778619392:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826300.683510:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 12 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.683524:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:0.0:1787826300.683542:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789730944 00000100:00100000:0.0:1787826300.683546:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789730944 00000100:00100000:0.0:1787826300.683580:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111251 00000100:00100000:1.0:1787826300.683581:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:84201:x1874668789730304:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9472us (10232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.683587:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84202:x1874668789730944:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.683590:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6214 00010000:00010000:0.0:1787826300.683615:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.683639:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349ab53 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc22 expref: 32 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.683657:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:0.0:1787826300.683662:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826300.683688:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.683700:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.683708:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826300.683793:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eccb096d reply state 00000000df891c91 transno 8590016373 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.683804:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.683811:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:0.0:1787826300.683813:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826300.683815:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826300.683883:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84202:x1874668789730944:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 296us (1592us total) trans 8590016373 rc 0/0 00000100:00100000:0.0:1787826300.683889:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111251 00000100:00100000:3.0:1787826300.685143:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84200:x1874668789730688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 2070us (2891us total) trans 8590016374 rc 0/0 00000100:00100000:3.0:1787826300.685154:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2640 00000100:00100000:3.0:1787826300.686352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.686493:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789731072 00000100:00100000:2.0:1787826300.686502:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789731072 00000100:00100000:2.0:1787826300.686554:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111252 00000100:00100000:2.0:1787826300.686563:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84202:x1874668789731072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.686579:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.686597:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc5a expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.686659:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc5a expref: 34 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.686674:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc5a expref: 34 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.686692:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:2.0:1787826300.686694:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.686698:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:1.0:1787826300.686709:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a1a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778619520:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826300.686728:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826300.686733:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84202:x1874668789731072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 172us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.686739:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111252 00000100:00100000:1.0:1787826300.686747:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789730432:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 7302us (7721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.686755:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2990 00000100:00100000:0.0:1787826300.695558:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.695601:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.696788:0:25758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789731200 00000100:00100000:3.0:1787826300.696800:0:25758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789731200 00002000:00100000:3.0:1787826300.696874:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xbe:0x0] (0->157) req@ffff9bbf412752c0 x1874668789731200/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/0 e 0 to 0 dl 1787826311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826300.696887:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf412752c0 with x1874668789731200 ext(0->157) 00002000:00010000:3.0:1787826300.696893:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf412752c0 00000100:00100000:3.0:1787826300.696923:0:25758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1565 00000100:00100000:3.0:1787826300.696937:0:25758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789731200:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.696946:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.696975:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789731456 00000100:00100000:0.0:1787826300.696980:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789731456 00000100:00100000:0.0:1787826300.697014:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6215 00000100:00100000:0.0:1787826300.697024:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789731456:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826300.697151:0:45681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xbd:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826300.697155:0:45681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xbd:0x0] updating lvb mtime from disk: 0 -> 1787826219 00002000:00010000:0.0:1787826300.697158:0:45681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xbd:0x0] updating lvb atime from disk: 0 -> 1787826219 00002000:00010000:0.0:1787826300.697161:0:45681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xbd:0x0] updating lvb ctime from disk: 0 -> 1787826219 00002000:00010000:0.0:1787826300.697163:0:45681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xbd:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826300.697216:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789731456:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 193us (276us total) trans 4294968166 rc 0/0 00000100:00100000:0.0:1787826300.697224:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6215 00000100:00100000:3.0:1787826300.697322:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789731328 00000100:00100000:3.0:1787826300.697327:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789731328 00000100:00100000:3.0:1787826300.697367:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111253 00000100:00100000:3.0:1787826300.697376:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84200:x1874668789731328:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.697392:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.697409:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349abbc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc61 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.697480:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349abc3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.697493:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349abc3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.697509:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349abc3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826300.697542:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11e:0x0]: returning size 0 00000004:00200000:3.0:1787826300.697546:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826300.697561:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349abc3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.697585:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349abbc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc61 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.697600:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349abc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc61 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.697608:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826300.697611:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826300.697614:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826300.697638:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84200:x1874668789731328:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 263us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.697645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111253 00000100:00100000:3.0:1787826300.698226:0:25758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789731200:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1293us (2675us total) trans 4294968150 rc 0/0 00000100:00100000:3.0:1787826300.698243:0:25758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1565 00002000:00100000:3.0:1787826300.698252:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xbe:0x0] (0->157) req@ffff9bbf412752c0 x1874668789731200/t4294968150(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/448 e 0 to 0 dl 1787826311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826300.698261:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf412752c0 with x1874668789731200 ext(0->157) 00002000:00010000:3.0:1787826300.698266:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf412752c0 00000100:00100000:0.0:1787826300.699963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.700085:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789731584 00000100:00100000:3.0:1787826300.700092:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789731584 00000100:00100000:3.0:1787826300.700133:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6216 00000100:00100000:3.0:1787826300.700142:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789731584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.700156:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.700175:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc68 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826300.700381:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826300.700397:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=2938s v=(0 0) 00010000:00010000:3.0:1787826300.700401:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.700410:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc68 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.700439:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc68 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.700450:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826300.700503:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2400:x1874668789731584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 361us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.700510:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6216 00000100:00100000:0.0:1787826300.702446:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.702679:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.704726:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789731840 00000100:00100000:2.0:1787826300.704739:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789731840 00000100:00100000:2.0:1787826300.704785:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789731968 00000100:00100000:2.0:1787826300.704788:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789731968 00000100:00100000:2.0:1787826300.704809:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111254 00000100:00100000:2.0:1787826300.704818:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84202:x1874668789731840:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.704897:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.704915:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbe3 expref: 36 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.704925:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.704960:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbe3 expref: 36 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.704974:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbe3 expref: 36 pid: 45682 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.704995:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb5bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778619648:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.705069:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0ff713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.706814:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111255 00000100:00100000:2.0:1787826300.706829:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84201:x1874668789731968:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.706962:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84201:x1874668789731968:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 136us (4282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.706969:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111255 00000100:00100000:0.0:1787826300.707828:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.711448:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789732224 00000100:00100000:2.0:1787826300.711462:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789732224 00000100:00100000:2.0:1787826300.711515:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111256 00000100:00100000:2.0:1787826300.711525:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84200:x1874668789732224:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.711633:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84200:x1874668789732224:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 109us (3807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.711640:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111256 00000100:00100000:1.0:1787826300.711823:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.711879:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.711951:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb5bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778619648:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.711975:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.712073:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789732480 00000100:00100000:0.0:1787826300.712078:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789732480 00000100:00100000:3.0:1787826300.712100:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789732352 00000100:00100000:3.0:1787826300.712104:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789732352 00010000:00010000:3.0:1787826300.712126:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbe3 expref: 36 pid: 45682 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.712162:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2991 00000100:00100000:3.0:1787826300.712171:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789732352:12345-192.168.203.9@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787826300.712270:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6217 00000100:00100000:0.0:1787826300.712279:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789732480:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.712334:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.712343:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbe3 expref: 36 pid: 45682 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.712355:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbe3 expref: 36 pid: 45682 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.712376:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349aaa4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbe3 expref: 36 pid: 45682 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.712390:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:3.0:1787826300.712395:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.712404:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.712411:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.712751:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.712789:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2401:x1874668789732352:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 619us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.712797:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2991 00010000:00010000:1.0:1787826300.716246:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.716260:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.716298:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.716304:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.716311:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.716317:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.716321:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.716328:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.716344:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:1.0:1787826300.716347:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826300.716352:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.716357:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abd1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.716447:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84202:x1874668789731840:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 11626us (14004us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826300.716457:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111254 00000001:00080000:3.0:1787826300.721976:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968150 is committed 00000001:00080000:3.0:1787826300.721996:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968149 is committed 00000100:00100000:1.0:1787826300.725093:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789732480:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 12804us (13201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.725108:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6217 00000100:00100000:3.0:1787826300.727620:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.727995:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789732608 00000100:00100000:1.0:1787826300.728006:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789732608 00000100:00100000:1.0:1787826300.728059:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6218 00000100:00100000:1.0:1787826300.728068:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84200:x1874668789732608:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.728087:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.728103:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc6f expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.728135:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc68 expref: 15 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.728144:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826300.728148:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826300.728153:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 15 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.728206:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc68 expref: 15 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.728224:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc68 expref: 15 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.728237:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778619776:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.728324:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.730636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.730729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.730898:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789732992 00000100:00100000:2.0:1787826300.730907:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789732992 00000100:00100000:2.0:1787826300.730954:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111257 00000100:00100000:2.0:1787826300.730963:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84201:x1874668789732992:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.731012:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.731039:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ab84 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc3e expref: 34 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.731055:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826300.731060:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.731088:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.731101:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.731110:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826300.731217:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000065cb150 reply state 000000006afff822 transno 8590016375 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.731229:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.731236:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826300.731238:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826300.731241:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826300.731326:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84201:x1874668789732992:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 363us (596us total) trans 8590016375 rc 0/0 00000100:00100000:2.0:1787826300.731333:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111257 00000100:00100000:1.0:1787826300.731411:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789732736 00000100:00100000:1.0:1787826300.731431:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789732736 00000100:00100000:1.0:1787826300.731467:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6219 00000100:00100000:1.0:1787826300.731475:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2400:x1874668789732736:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.731500:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.731515:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.731524:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826300.731529:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826300.731534:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.731562:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.731575:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 16 pid: 25038 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.731590:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778619904:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.731640:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.739806:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.739847:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789733120 00000100:00100000:3.0:1787826300.739910:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789733120 00000100:00100000:1.0:1787826300.739983:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111258 00000100:00100000:1.0:1787826300.739995:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84201:x1874668789733120:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.740018:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.740038:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc76 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.740099:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc76 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.740115:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc76 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.740134:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:1.0:1787826300.740137:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.740140:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826300.740204:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84201:x1874668789733120:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 207us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.740211:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111258 00000100:00100000:2.0:1787826300.741602:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778619776:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826300.741632:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 16 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.741660:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:2.0:1787826300.741706:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+16:84200:x1874668789732608:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 13639us (14094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.741714:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6218 00000100:00100000:1.0:1787826300.748771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.748800:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.748821:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.748939:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778619904:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.748962:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.749107:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789733248 00000100:00100000:3.0:1787826300.749114:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789733248 00000100:00100000:3.0:1787826300.749178:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6220 00000100:00100000:3.0:1787826300.749188:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789733248:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826300.749693:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xbe:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826300.749698:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xbe:0x0] updating lvb mtime from disk: 0 -> 1787826219 00002000:00010000:3.0:1787826300.749701:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xbe:0x0] updating lvb atime from disk: 0 -> 1787826219 00002000:00010000:3.0:1787826300.749703:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xbe:0x0] updating lvb ctime from disk: 0 -> 1787826219 00002000:00010000:3.0:1787826300.749705:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xbe:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826300.749792:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789733248:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 605us (1030us total) trans 4294968151 rc 0/0 00000100:00100000:3.0:1787826300.749801:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6220 00000100:00100000:3.0:1787826300.749826:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789733504 00000100:00100000:3.0:1787826300.749829:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789733504 00010000:00010000:3.0:1787826300.749847:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 16 pid: 25038 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.749898:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789733376 00000100:00100000:3.0:1787826300.749901:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789733376 00010000:00010000:3.0:1787826300.749915:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc68 expref: 17 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.749944:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2992 00000100:00100000:3.0:1787826300.749951:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2400:x1874668789733504:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.749962:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.749976:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 17 pid: 25038 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.749987:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 17 pid: 25038 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750007:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349ab76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc37 expref: 17 pid: 25038 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750022:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826300.750026:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826300.750032:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750041:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750064:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.750084:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2400:x1874668789733504:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 133us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.750090:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2992 00000100:00100000:3.0:1787826300.750103:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2993 00000100:00100000:3.0:1787826300.750109:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2400:x1874668789733376:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.750117:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.750126:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc68 expref: 15 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750137:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc68 expref: 15 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750150:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349abca lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc68 expref: 15 pid: 8433 timeout: 3038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750159:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.750162:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.750169:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750176:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750204:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.750219:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a1a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778620032:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826300.750351:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56180 going to sleep for 11 seconds 00010000:00010000:3.0:1787826300.750380:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750388:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750406:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750426:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750434:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750441:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826300.750445:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750454:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750465:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.750473:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349abe6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.750516:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2400:x1874668789732736:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 19042us (19887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.750523:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6219 00000100:00100000:1.0:1787826300.768253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.768292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.768672:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a1a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778620032:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826300.768697:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.768810:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789733376:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 18699us (19986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.768820:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2993 00000100:00100000:1.0:1787826300.768956:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.768980:0:45405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789734144 00000100:00100000:1.0:1787826300.768986:0:45405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789734144 00002000:00100000:1.0:1787826300.769035:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xbe:0x0] (0->157) req@ffff9bbf0f7bb0c0 x1874668789734144/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/0 e 0 to 0 dl 1787826311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826300.769047:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf0f7bb0c0 with x1874668789734144 ext(0->157) 00002000:00010000:1.0:1787826300.769052:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf0f7bb0c0 00000100:00100000:1.0:1787826300.769078:0:45405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1566 00000100:00100000:1.0:1787826300.769544:0:45405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789734144:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.769576:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789733760 00000100:00100000:2.0:1787826300.769582:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789733760 00000100:00100000:2.0:1787826300.769628:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789734016 00000100:00100000:2.0:1787826300.769632:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789734016 00000100:00100000:2.0:1787826300.769656:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111259 00000100:00100000:2.0:1787826300.769664:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84201:x1874668789733760:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.769714:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.769730:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbff expref: 37 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.769740:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.769772:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbff expref: 37 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.769786:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbff expref: 37 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.769800:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb5bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778620160:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.769889:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf40437780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.769910:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111260 00000100:00100000:2.0:1787826300.769920:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84202:x1874668789734016:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.769965:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 3/0,1 mode: --/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.769975:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.769986:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.770104:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.770114:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc5a expref: 38 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.770121:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.770140:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc5a expref: 38 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.770149:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc5a expref: 38 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.770159:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778620288:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.770383:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf404376c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.772932:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.772964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.772977:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb5bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778620160:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.773008:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.773036:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789734272 00000100:00100000:3.0:1787826300.773042:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789734272 00010000:00010000:3.0:1787826300.773075:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbff expref: 39 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.773107:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789734400 00000100:00100000:3.0:1787826300.773110:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789734400 00010000:00010000:3.0:1787826300.773125:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc5a expref: 40 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.773148:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2994 00000100:00100000:3.0:1787826300.773156:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2401:x1874668789734272:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.773172:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.773180:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbff expref: 40 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773192:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbff expref: 40 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.773213:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2995 00010000:00010000:3.0:1787826300.773218:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349aaf8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbbff expref: 40 pid: 25759 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.773228:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789734400:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.773236:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826300.773242:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.773249:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.773253:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.773258:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc5a expref: 39 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773265:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.773284:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc5a expref: 39 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773289:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826300.773300:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:0.0:1787826300.773306:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.773313:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.773320:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.773332:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.773363:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789734272:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 206us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.773373:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2994 00010000:00010000:3.0:1787826300.773423:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773431:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773469:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773482:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773489:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773495:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.773500:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773507:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773516:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826300.773519:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787826300.773523:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.773530:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349abf4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.773542:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789734400:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 317us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.773550:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2995 00000100:00100000:3.0:1787826300.773586:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84201:x1874668789733760:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 3921us (5341us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787826300.773595:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111259 00010000:00010000:0.0:1787826300.773925:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349abb5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc5a expref: 36 pid: 45683 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.773938:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778620288:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.773951:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.773958:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.773964:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826300.774048:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016376 00000001:00080000:0.0:1787826300.774142:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016377 00000001:00080000:0.0:1787826300.774168:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016378 00000100:00100000:0.0:1787826300.774378:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e808f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778620416:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826300.774429:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826300.774453:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.774529:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778620416 00000100:00100000:3.0:1787826300.774535:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778620416 00000100:00100000:3.0:1787826300.774578:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3316 00000100:00100000:3.0:1787826300.774586:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778620416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787826300.774662:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778620416:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.774668:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3316 00000100:00100000:3.0:1787826300.774694:0:6515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968164 gen 2 00000004:00080000:3.0:1787826300.774700:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968164 committed transno 4294968164 00000100:00100000:3.0:1787826300.774716:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e808f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778620416:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787826300.775095:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016379 00000100:00100000:0.0:1787826300.776966:0:45405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789734144:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 7871us (8002us total) trans 4294968167 rc 0/0 00000100:00100000:0.0:1787826300.776980:0:45405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1566 00002000:00100000:0.0:1787826300.776992:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xbe:0x0] (0->157) req@ffff9bbf0f7bb0c0 x1874668789734144/t4294968167(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:656/0 lens 648/448 e 0 to 0 dl 1787826311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826300.777003:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf0f7bb0c0 with x1874668789734144 ext(0->157) 00002000:00010000:0.0:1787826300.777009:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf0f7bb0c0 00000100:00100000:2.0:1787826300.778666:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778620544:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787826300.778737:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.778767:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf404379c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.778999:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778620544 00000100:00100000:1.0:1787826300.779007:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778620544 00000100:00100000:1.0:1787826300.779063:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3317 00000100:00100000:1.0:1787826300.779073:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778620544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787826300.779281:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778620544:12345-0@lo:1000:mdt00_000.0 Request processed in 209us (556us total) trans 4294968168 rc 0/0 00000100:00100000:1.0:1787826300.779289:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3317 00000100:00100000:2.0:1787826300.782053:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778620544:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787826300.782175:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016380 00010000:00010000:2.0:1787826300.782218:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782229:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782236:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782242:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.782246:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782254:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782269:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:2.0:1787826300.782272:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.782277:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782284:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac02 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782319:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f3499105 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782466:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f3499105 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782474:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f3499105 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782479:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.782482:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f3499105 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782489:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f3499105 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782498:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xeb:0x0].0x0 (ffff9bbe0bd66300) 00010000:00010000:2.0:1787826300.782501:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.782504:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f3499105 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782510:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f3499105 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782531:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782542:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782550:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782558:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782564:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782570:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782575:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.782578:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782583:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782589:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xeb:0x0].0x0 (ffff9bbe0bd66300) 00010000:00010000:2.0:1787826300.782592:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.782594:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782599:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac09 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xeb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782607:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782613:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782618:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782623:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.782627:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782632:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782643:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xeb:0x0].0x0 (ffff9bbe0bd66300) 00010000:00010000:2.0:1787826300.782646:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826300.782648:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 2/0,0 mode: --/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.782654:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349abfb lrc: 0/0,0 mode: --/PW res: [0x200000403:0xeb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.782800:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+40:84202:x1874668789734016:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 12880us (14505us total) trans 8590016381 rc 0/0 00000100:00100000:2.0:1787826300.782810:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111260 00000020:00080000:2.0:1787826300.782816:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826300.783184:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.783715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.784705:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789734656 00000100:00100000:2.0:1787826300.784709:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789734528 00000100:00100000:0.0:1787826300.784714:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789734656 00000100:00100000:2.0:1787826300.784716:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789734528 00000100:00100000:0.0:1787826300.784778:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111261 00000100:00100000:0.0:1787826300.784788:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+40:84200:x1874668789734656:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.784832:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6221 00000100:00100000:2.0:1787826300.784842:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789734528:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.784891:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.784912:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.784920:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826300.784925:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826300.784931:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.784943:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+40:84200:x1874668789734656:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 154us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.784950:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111261 00010000:00010000:2.0:1787826300.784967:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.784983:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 10 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.784997:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778620672:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.785053:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf40437480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.790205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.790965:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.791048:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789735040 00000100:00100000:0.0:1787826300.791058:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789735040 00000100:00100000:0.0:1787826300.791114:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6222 00000100:00100000:0.0:1787826300.791124:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789735040:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787826300.793551:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968168 is committed 00000001:00080000:0.0:1787826300.793563:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968167 is committed 00000100:00100000:1.0:1787826300.793723:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789735040:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2595us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.793733:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6222 00000100:00100000:2.0:1787826300.794291:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789734912 00000100:00100000:2.0:1787826300.794308:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789734912 00000100:00100000:2.0:1787826300.794361:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2641 00000100:00100000:2.0:1787826300.794371:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+40:84202:x1874668789734912:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826300.794620:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x11c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826300.794652:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016382 00010000:00010000:2.0:1787826300.794684:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.794700:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.794711:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.794720:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.794727:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.794732:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.794754:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826300.794829:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+42:84202:x1874668789734912:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 458us (4631us total) trans 8590016383 rc 0/0 00000100:00100000:2.0:1787826300.794836:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2641 00000020:00080000:2.0:1787826300.794840:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826300.795091:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826300.795098:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.795106:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826300.795110:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.795119:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.795132:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:1.0:1787826300.795135:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826300.795139:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.795146:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ac17 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.795160:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826300.795162:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826300.795164:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826300.801640:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826300.802314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.802396:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778620672:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.802431:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.802482:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789735168 00000100:00100000:0.0:1787826300.802489:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789735168 00010000:00010000:0.0:1787826300.802521:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 11 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.802556:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2996 00000100:00100000:0.0:1787826300.802566:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40512050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789735168:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.802579:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.802599:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 11 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.802611:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 11 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.802632:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349aba0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc53 expref: 11 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.802646:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.802650:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.802655:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.802670:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.802698:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.802729:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.802741:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.802751:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40512050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789735168:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 186us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.802760:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2996 00010000:00010000:2.0:1787826300.802763:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.802773:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.802781:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.802788:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826300.802793:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.802803:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.802815:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.802823:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349ac10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.803233:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789734528:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 18391us (20048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.803251:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6221 00000100:00100000:1.0:1787826300.805542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.805620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.805893:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789735424 00000100:00100000:0.0:1787826300.805902:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789735424 00000100:00100000:0.0:1787826300.805946:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789735680 00000100:00100000:0.0:1787826300.805950:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789735680 00000100:00100000:0.0:1787826300.805981:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111262 00000100:00100000:0.0:1787826300.805991:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84200:x1874668789735424:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.806004:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111263 00000100:00100000:3.0:1787826300.806017:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84201:x1874668789735680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.806081:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 3/0,1 mode: --/PW res: [0x200000403:0xea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.806096:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.806108:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.806133:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.806154:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349abc3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc61 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.806169:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826300.806174:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826300.806196:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.806206:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.806215:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.806265:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.806278:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc76 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826300.806285:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca96b8ac reply state 00000000dec32418 transno 8590016385 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.806301:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.806305:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.806334:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc76 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.806349:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc76 expref: 44 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.806376:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778620800:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.806390:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826300.806393:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826300.806396:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826300.806468:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+45:84200:x1874668789735424:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 477us (934us total) trans 8590016385 rc 0/0 00000100:00100000:0.0:1787826300.806476:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111262 00000100:00100000:3.0:1787826300.806477:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.809348:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.809488:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778620800:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.809516:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.809661:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789735808 00000100:00100000:0.0:1787826300.809668:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789735808 00000100:00100000:0.0:1787826300.809757:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111264 00000100:00100000:0.0:1787826300.809767:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+45:84200:x1874668789735808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.809787:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.809815:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc7d expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.809893:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc7d expref: 46 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.809907:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc7d expref: 46 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.809930:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826300.809934:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.809938:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:0.0:1787826300.809987:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84200:x1874668789735808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 220us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.809993:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111264 00000100:00100000:1.0:1787826300.813156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.813525:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.813610:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789735936 00000100:00100000:2.0:1787826300.813619:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789735936 00000100:00100000:2.0:1787826300.813681:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6223 00000100:00100000:2.0:1787826300.813691:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789735936:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826300.813910:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xbe:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826300.813914:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xbe:0x0] updating lvb mtime from disk: 0 -> 1787826219 00002000:00010000:2.0:1787826300.813917:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xbe:0x0] updating lvb atime from disk: 0 -> 1787826219 00002000:00010000:2.0:1787826300.813919:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xbe:0x0] updating lvb ctime from disk: 0 -> 1787826219 00002000:00010000:2.0:1787826300.813920:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xbe:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826300.813980:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789735936:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 291us (833us total) trans 4294968169 rc 0/0 00000100:00100000:2.0:1787826300.813987:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6223 00000100:00100000:3.0:1787826300.814290:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789736064 00000100:00100000:3.0:1787826300.815078:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789736064 00010000:00010000:3.0:1787826300.815113:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc76 expref: 46 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.815140:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2997 00000100:00100000:3.0:1787826300.815148:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+46:2399:x1874668789736064:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.815162:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.815168:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc76 expref: 46 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.815186:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc76 expref: 46 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.815207:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349abed lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc76 expref: 46 pid: 6516 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.815220:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826300.815226:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.815235:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.815244:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.815274:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.815317:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+45:2399:x1874668789736064:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 170us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.815324:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2997 00010000:00010000:2.0:1787826300.815372:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.815385:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826300.815475:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016384 00000001:00080000:2.0:1787826300.815566:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016386 00000001:00080000:2.0:1787826300.815594:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016387 00000100:00100000:2.0:1787826300.815654:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778620928:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826300.815917:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.815947:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.816097:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778620928 00000100:00100000:3.0:1787826300.816102:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778620928 00000100:00100000:3.0:1787826300.816136:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3318 00000100:00100000:3.0:1787826300.816142:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778620928:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787826300.816210:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778620928:12345-0@lo:1000:mdt00_005.0 Request processed in 68us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.816217:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3318 00000100:00100000:2.0:1787826300.816299:0:23845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968149 gen 2 00000004:00080000:2.0:1787826300.816304:0:23845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968148 committed transno 4294968149 00000004:00080000:2.0:1787826300.816320:0:23845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968149 committed transno 4294968149 00000100:00100000:2.0:1787826300.816333:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778620928:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1787826300.816429:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016388 00000100:00100000:2.0:1787826300.816464:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778621056:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826300.816487:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.816510:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf40437480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.817904:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.818042:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789736320 00000100:00100000:3.0:1787826300.818048:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789736320 00000100:00100000:3.0:1787826300.818091:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111265 00000100:00100000:3.0:1787826300.818099:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84200:x1874668789736320:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.818147:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.818163:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc14 expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.818173:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 4/0,1 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.818197:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc14 expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.818209:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc14 expref: 49 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.818221:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778621184:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826300.818275:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.820564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.820625:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778621184:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.820648:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.820672:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789736448 00000100:00100000:3.0:1787826300.820677:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789736448 00010000:00010000:3.0:1787826300.820704:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc14 expref: 50 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.820772:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2998 00000100:00100000:3.0:1787826300.820780:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2402:x1874668789736448:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.820792:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.820799:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc14 expref: 50 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.820811:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc14 expref: 50 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.820838:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349ab30 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc14 expref: 50 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.820871:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826300.820876:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.820885:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.820892:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.820910:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.820947:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2402:x1874668789736448:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 169us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.820954:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2998 00010000:00010000:3.0:1787826300.821280:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.821335:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.821372:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.821379:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.821387:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.821392:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.821396:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.821403:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.821411:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826300.821423:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787826300.821426:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.821432:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ac3a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.821511:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84200:x1874668789736320:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 3412us (3611us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787826300.821519:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111265 00000100:00100000:0.0:1787826300.821809:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778621056 00000100:00100000:0.0:1787826300.821815:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778621056 00000100:00100000:0.0:1787826300.821958:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3319 00000100:00100000:0.0:1787826300.821965:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778621056:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826300.822152:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:23845:x1874668778621056:12345-0@lo:1000:mdt00_005.0 Request processed in 186us (5663us total) trans 4294968152 rc 0/0 00000100:00100000:0.0:1787826300.822159:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3319 00000100:00100000:3.0:1787826300.822218:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778621056:0@lo:1000:mdt00_005.0 00000001:00080000:3.0:1787826300.822292:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016389 00010000:00010000:3.0:1787826300.822322:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822338:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822345:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822350:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.822353:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822360:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822369:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826300.822372:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.822375:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822381:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ac2c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822401:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f34990fe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822407:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f34990fe lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822429:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f34990fe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822434:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.822437:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f34990fe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822443:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f34990fe lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822451:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xea:0x0].0x0 (ffff9bbe0bd66e00) 00010000:00010000:3.0:1787826300.822453:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.822456:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f34990fe lrc: 2/0,0 mode: --/EX res: [0x200000403:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822462:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f34990fe lrc: 0/0,0 mode: --/EX res: [0x200000403:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822482:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822491:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822499:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822506:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822512:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822517:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822522:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.822524:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822530:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822538:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xea:0x0].0x0 (ffff9bbe0bd66e00) 00010000:00010000:3.0:1787826300.822541:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826300.822543:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822549:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ac41 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822558:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xea:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822564:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xea:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822570:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xea:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822575:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.822578:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xea:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822587:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xea:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822596:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xea:0x0].0x0 (ffff9bbe0bd66e00) 00010000:00010000:3.0:1787826300.822598:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826300.822601:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 2/0,0 mode: --/PW res: [0x200000403:0xea:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.822606:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac1e lrc: 0/0,0 mode: --/PW res: [0x200000403:0xea:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.822782:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84201:x1874668789735680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 16768us (17160us total) trans 8590016390 rc 0/0 00000100:00100000:3.0:1787826300.822790:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111263 00000020:00080000:3.0:1787826300.822794:0:23845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826300.824044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.824150:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789736576 00000100:00100000:0.0:1787826300.824157:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789736576 00000100:00100000:0.0:1787826300.824242:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6224 00000100:00100000:0.0:1787826300.824252:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789736576:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.824287:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.824314:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 13 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.824324:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826300.824329:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826300.824334:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.824367:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 13 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.824377:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 13 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.824388:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778621312:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.824461:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.825165:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.825240:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789736832 00000100:00100000:3.0:1787826300.825245:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789736832 00000100:00100000:3.0:1787826300.825285:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2642 00000100:00100000:3.0:1787826300.825303:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84201:x1874668789736832:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787826300.825528:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x11d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826300.825559:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016391 00010000:00010000:3.0:1787826300.825595:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.825609:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.825631:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.825640:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.825647:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.825653:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.825674:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826300.825801:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826300.825808:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.825816:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826300.825828:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.825836:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.825878:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:1.0:1787826300.825881:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826300.825886:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 1/0,0 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.825892:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ac4f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.825905:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826300.825907:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826300.825908:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826300.826021:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84201:x1874668789736832:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 727us (856us total) trans 8590016392 rc 0/0 00000100:00100000:3.0:1787826300.826030:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2642 00000020:00080000:3.0:1787826300.826035:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826300.826500:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778621312:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.826520:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.826540:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.826599:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789736960 00000100:00100000:3.0:1787826300.826605:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789736960 00010000:00010000:3.0:1787826300.826677:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 14 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.826709:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2999 00000100:00100000:3.0:1787826300.826718:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789736960:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.826740:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.826758:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 14 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.826770:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 14 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.826794:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0694f9e/0x68019081f349abd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc6f expref: 14 pid: 19335 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.826807:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826300.826811:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826300.826823:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.826833:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.826880:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.826886:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826300.826889:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.826907:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.826915:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.826916:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789736960:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 200us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.826923:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2999 00010000:00010000:0.0:1787826300.826928:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.826935:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826300.826938:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.826947:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.826957:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.826964:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349ac48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.827004:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789736576:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 2754us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.827012:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6224 00000100:00100000:1.0:1787826300.829637:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.829720:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789737216 00000100:00100000:0.0:1787826300.829729:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789737216 00000100:00100000:0.0:1787826300.829813:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111266 00000100:00100000:0.0:1787826300.829824:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84200:x1874668789737216:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.829939:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.829954:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.829964:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.830110:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.830121:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc7d expref: 51 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.830130:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.830160:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc7d expref: 51 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.830174:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc7d expref: 51 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.830188:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778621440:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.830320:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.833076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.833569:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778621440:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826300.833594:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.833701:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789737344 00000100:00100000:1.0:1787826300.833707:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789737344 00010000:00010000:1.0:1787826300.833750:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc7d expref: 52 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.833792:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3000 00000100:00100000:1.0:1787826300.833800:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+52:2402:x1874668789737344:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826300.833815:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.833822:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc7d expref: 52 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.833834:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc7d expref: 52 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.833887:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349ac33 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc7d expref: 52 pid: 25756 timeout: 3038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.833902:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:1.0:1787826300.833907:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.833916:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.833923:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.833941:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.833972:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.833980:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.833994:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+51:2402:x1874668789737344:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 194us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.834001:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3000 00000001:00080000:2.0:1787826300.834075:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016393 00000001:00080000:2.0:1787826300.834186:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016394 00000001:00080000:2.0:1787826300.834227:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016395 00000100:00100000:2.0:1787826300.834345:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778621568:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826300.834382:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.834406:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe13482840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.834428:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778621568 00000100:00100000:1.0:1787826300.834433:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778621568 00000100:00100000:1.0:1787826300.834507:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3320 00000100:00100000:1.0:1787826300.834515:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778621568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787826300.834589:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778621568:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.834596:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3320 00000100:00100000:0.0:1787826300.834657:0:6517:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968168 gen 2 00000004:00080000:0.0:1787826300.834663:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968168 committed transno 4294968168 00000100:00100000:0.0:1787826300.834679:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778621568:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787826300.834787:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016396 00000100:00100000:0.0:1787826300.834825:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778621696:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787826300.834883:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826300.835249:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826300.835281:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778621696 00000100:00100000:2.0:1787826300.835286:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778621696 00000100:00100000:2.0:1787826300.835353:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3321 00000100:00100000:2.0:1787826300.835361:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778621696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826300.835463:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778621696:12345-0@lo:1000:mdt00_002.0 Request processed in 103us (610us total) trans 4294968170 rc 0/0 00000100:00100000:2.0:1787826300.835470:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3321 00000100:00100000:0.0:1787826300.835582:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778621696:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787826300.835635:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016397 00010000:00010000:0.0:1787826300.835653:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835659:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835664:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835667:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.835670:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835675:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835683:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826300.835685:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.835688:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835701:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ac5d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835731:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f34990f7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835738:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f34990f7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835747:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f34990f7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835752:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.835755:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f34990f7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835761:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f34990f7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835769:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe9:0x0].0x0 (ffff9bbe0bd66000) 00010000:00010000:0.0:1787826300.835772:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826300.835775:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f34990f7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835780:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f34990f7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835799:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835808:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835816:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835824:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835829:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835835:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835840:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.835843:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835882:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835891:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe9:0x0].0x0 (ffff9bbe0bd66000) 00010000:00010000:0.0:1787826300.835893:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.835896:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835902:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ac64 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835911:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835917:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835923:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835929:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.835932:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835937:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835944:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe9:0x0].0x0 (ffff9bbe0bd66000) 00010000:00010000:0.0:1787826300.835946:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826300.835949:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.835954:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349ac56 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.836062:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84200:x1874668789737216:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 6235us (6428us total) trans 8590016398 rc 0/0 00000100:00100000:0.0:1787826300.836070:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111266 00000020:00080000:0.0:1787826300.836073:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1787826300.836248:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826300.836254:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826300.836485:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9685 count 103 00000040:00080000:3.0:1787826300.836492:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826300.836601:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778621824:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826300.836660:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15babb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.838797:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.839117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.839151:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.839175:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789737728 00000100:00100000:1.0:1787826300.839182:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789737728 00000100:00100000:0.0:1787826300.839205:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789737856 00000100:00100000:0.0:1787826300.839208:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789737856 00000100:00100000:1.0:1787826300.839239:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111267 00000100:00100000:1.0:1787826300.839297:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84210:x1874668789737728:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826300.839332:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xec:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826300.839445:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84210:x1874668789737728:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 152us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.839941:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789737600 00000100:00100000:2.0:1787826300.839946:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789737600 00000100:00100000:2.0:1787826300.839980:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2643 00000100:00100000:2.0:1787826300.839987:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84200:x1874668789737600:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826300.840383:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x11e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826300.840426:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016399 00010000:00010000:2.0:1787826300.840518:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.840534:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.840545:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.840554:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.840561:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.840582:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111268 00000100:00100000:0.0:1787826300.840598:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84211:x1874668789737856:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826300.840615:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xed:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826300.840646:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111267 00000100:00100000:0.0:1787826300.840680:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84211:x1874668789737856:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 90us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.840687:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111268 00010000:00010000:2.0:1787826300.840713:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.840768:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826300.840833:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84200:x1874668789737600:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 844us (2041us total) trans 8590016400 rc 0/0 00000100:00100000:2.0:1787826300.840839:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2643 00000020:00080000:2.0:1787826300.840843:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826300.840993:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826300.841002:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.841008:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826300.841012:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.841020:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.841033:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:3.0:1787826300.841036:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1787826300.841038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826300.841040:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 1/0,0 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.841046:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349ac6b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.841058:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826300.841060:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826300.841061:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826300.841684:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778621824:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826300.841781:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789737984 00000100:00100000:0.0:1787826300.841788:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789737984 00000100:00100000:0.0:1787826300.841901:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111269 00000100:00100000:0.0:1787826300.841910:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84212:x1874668789737984:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826300.841930:0:25756:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xee:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826300.842013:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84212:x1874668789737984:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 104us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.842019:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111269 00000100:00100000:2.0:1787826300.848907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.848949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.848973:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789738112 00000100:00100000:2.0:1787826300.848981:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789738112 00000100:00100000:2.0:1787826300.849024:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789738240 00000100:00100000:2.0:1787826300.849027:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789738240 00000100:00100000:2.0:1787826300.849046:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111270 00000100:00100000:2.0:1787826300.849054:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84211:x1874668789738112:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.849121:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849137:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849149:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849162:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849173:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849179:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849203:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849211:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849216:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.849257:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xed:0x0]: returning size 158 00000004:00200000:2.0:1787826300.849262:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826300.849273:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849284:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849289:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849311:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849317:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.849321:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849329:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849341:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826300.849344:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.849347:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849353:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ac72 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849363:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849369:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849374:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849379:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.849382:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849388:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849395:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x9dc63fd5 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826300.849397:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.849400:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849410:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ac79 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9dc63fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849432:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849438:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849442:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849447:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.849450:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849455:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849462:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xed:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:2.0:1787826300.849464:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.849467:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849473:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ac80 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.849546:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84211:x1874668789738112:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 492us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.849554:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111270 00000100:00100000:2.0:1787826300.849573:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111271 00000100:00100000:2.0:1787826300.849580:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84212:x1874668789738240:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.849604:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849613:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849620:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849631:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849638:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849644:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849658:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849665:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849671:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.849690:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xee:0x0]: returning size 158 00000004:00200000:2.0:1787826300.849692:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826300.849698:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849706:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849712:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849718:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849734:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.849737:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849743:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849751:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826300.849753:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.849756:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849762:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ac87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849771:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849777:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849782:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849788:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.849790:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849796:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849802:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x9308dcbf (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826300.849804:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.849806:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849811:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ac8e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9308dcbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849822:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849827:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849833:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849838:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.849840:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849846:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849884:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xee:0x0].0x0 (ffff9bbe0bd66600) 00010000:00010000:2.0:1787826300.849886:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.849889:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.849895:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ac95 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.849925:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84212:x1874668789738240:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 345us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.849932:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111271 00000100:00100000:3.0:1787826300.860213:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.860302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.860467:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789738368 00000100:00100000:0.0:1787826300.860477:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789738368 00000100:00100000:0.0:1787826300.860538:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789738752 00000100:00100000:0.0:1787826300.860542:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789738752 00000100:00100000:0.0:1787826300.860568:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111272 00000100:00100000:0.0:1787826300.860579:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84210:x1874668789738368:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.860590:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111273 00000100:00100000:3.0:1787826300.860598:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84212:x1874668789738752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.860607:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.860627:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc84 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860638:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860653:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860663:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860677:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860684:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860693:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860713:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860715:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860721:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860727:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826300.860751:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xec:0x0]: returning size 158 00000004:00200000:0.0:1787826300.860755:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826300.860766:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860779:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860785:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860791:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860796:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860802:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.860816:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860825:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860837:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826300.860840:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826300.860842:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860845:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860871:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349aca3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860872:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860884:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860890:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860895:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860900:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.860902:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860908:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860915:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb665b56a (ffff9bbf0f565700) 00010000:00010000:0.0:1787826300.860917:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.860920:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860931:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349acaa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb665b56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860945:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860951:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860957:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860962:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.860964:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860970:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860977:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xec:0x0].0x0 (ffff9bbe0bd66100) 00010000:00010000:0.0:1787826300.860980:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826300.860983:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.860988:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acb1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826300.861006:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xee:0x0]: returning size 158 00000100:00100000:0.0:1787826300.861062:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84210:x1874668789738368:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 485us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.861070:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111272 00010000:00010000:3.0:1787826300.861080:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.861087:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.861093:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.861099:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.861102:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.861108:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.861116:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xee:0x0].0x0 (ffff9bbe0bd66600) 00010000:00010000:3.0:1787826300.861118:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826300.861121:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.861126:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349acb8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.861158:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac9c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc84 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.861168:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826300.861170:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826300.861173:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ac9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc84 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.861181:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826300.861203:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84212:x1874668789738752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 607us (901us total) trans 8590016401 rc 301/301 00000100:00100000:3.0:1787826300.861210:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111273 00000100:00100000:0.0:1787826300.862748:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.863972:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789738880 00000100:00100000:3.0:1787826300.863982:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789738880 00000100:00100000:3.0:1787826300.864041:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111274 00000100:00100000:3.0:1787826300.864051:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84211:x1874668789738880:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.864068:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.864085:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349acc6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc8b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864180:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 3/1,0 mode: --/PR res: [0x200000403:0xed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864194:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864204:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826300.864214:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xed:0x0]: returning size 158 00010000:00010000:3.0:1787826300.864278:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864285:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864292:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864298:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826300.864301:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864309:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xed:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864319:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xed:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:3.0:1787826300.864322:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826300.864326:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 2/0,0 mode: --/PR res: [0x200000403:0xed:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864333:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349accd lrc: 0/0,0 mode: --/PR res: [0x200000403:0xed:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864367:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349acc6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc8b expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864377:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826300.864380:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826300.864384:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349acc6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc8b expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.864393:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00000100:00100000:3.0:1787826300.864461:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84211:x1874668789738880:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 411us (1719us total) trans 8590016402 rc 301/301 00000100:00100000:3.0:1787826300.864468:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111274 00000100:00100000:2.0:1787826300.873592:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.873651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.873678:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789739008 00000100:00100000:2.0:1787826300.873687:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789739008 00000100:00100000:2.0:1787826300.873755:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789739264 00000100:00100000:2.0:1787826300.873759:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789739264 00000100:00100000:2.0:1787826300.873781:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111275 00000100:00100000:2.0:1787826300.873791:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84212:x1874668789739008:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.873816:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111276 00000004:00000080:2.0:1787826300.873823:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xee:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826300.873825:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84210:x1874668789739264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.873837:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.873880:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acdb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.873965:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.873980:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.873992:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826300.874003:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xec:0x0]: returning size 158 00010000:00010000:0.0:1787826300.874084:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.874092:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.874099:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.874105:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826300.874109:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.874117:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.874128:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xec:0x0].0x0 (ffff9bbe0bd66100) 00010000:00010000:0.0:1787826300.874131:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826300.874135:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.874141:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ace2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.874177:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acdb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc92 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.874179:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84212:x1874668789739008:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 390us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.874187:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111275 00010000:00010000:0.0:1787826300.874188:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826300.874190:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826300.874194:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349acdb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc92 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.874202:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826300.874228:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84210:x1874668789739264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 405us (576us total) trans 8590016403 rc 301/301 00000100:00100000:0.0:1787826300.874234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111276 00000100:00100000:2.0:1787826300.876524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.876613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.876651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.876670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.876710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.876714:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789739520 00000100:00100000:0.0:1787826300.876723:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789739520 00000100:00080000:2.0:1787826300.876759:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826300.876776:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789739776 00000100:00100000:0.0:1787826300.876779:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789739776 00000100:00100000:0.0:1787826300.876824:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789739648 00000100:00100000:0.0:1787826300.876827:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789739648 00000100:00100000:0.0:1787826300.876871:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4964 00000100:00100000:0.0:1787826300.876881:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a106d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789739520:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826300.876949:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a106d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789739520:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 70us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.876956:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4964 00000100:00100000:0.0:1787826300.876974:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4965 00000100:00100000:0.0:1787826300.876981:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789739776:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826300.877006:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789739776:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00080000:2.0:1787826300.877008:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826300.877012:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826300.877013:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4965 00000100:00100000:0.0:1787826300.877026:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4966 00000100:00100000:0.0:1787826300.877032:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789739648:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826300.877069:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789739648:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.877075:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4966 00000100:00100000:1.0:1787826300.877098:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789740032 00000100:00100000:1.0:1787826300.877102:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789740032 00000100:00100000:1.0:1787826300.877147:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789739904 00000100:00100000:1.0:1787826300.877150:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789739904 00000100:00100000:1.0:1787826300.877171:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3427 00000100:00100000:1.0:1787826300.877178:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789740032:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826300.877205:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789740032:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.877211:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3427 00000100:00100000:1.0:1787826300.877224:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3428 00000100:00100000:1.0:1787826300.877231:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789739904:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826300.877255:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789739904:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.877260:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3428 00000100:00080000:0.0:1787826300.877932:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826300.877937:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826300.884846:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.884925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.884954:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789739392 00000100:00100000:3.0:1787826300.884964:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789739392 00000100:00100000:3.0:1787826300.885022:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 771 00000100:00100000:3.0:1787826300.885032:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf03f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789739392:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826300.885098:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf03f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789739392:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.885106:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 771 00000100:00100000:1.0:1787826300.885383:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789740160 00000100:00100000:1.0:1787826300.885389:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789740160 00000100:00100000:1.0:1787826300.885436:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111277 00000100:00100000:1.0:1787826300.885443:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84211:x1874668789740160:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826300.885469:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xed:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826300.885548:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84211:x1874668789740160:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 105us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.885556:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111277 00000100:00100000:3.0:1787826300.888968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.889004:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789740288 00000100:00100000:3.0:1787826300.889012:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789740288 00000100:00100000:3.0:1787826300.889060:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111278 00000100:00100000:3.0:1787826300.889070:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84210:x1874668789740288:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826300.889097:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xec:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826300.889202:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84210:x1874668789740288:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 133us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.889209:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111278 00000100:00100000:3.0:1787826300.890702:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.890890:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789740544 00000100:00100000:2.0:1787826300.890898:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789740544 00000100:00100000:2.0:1787826300.890946:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111279 00000100:00100000:2.0:1787826300.890956:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84212:x1874668789740544:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.890976:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.890997:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349acf0 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbc99 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.891453:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349acf7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.891467:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349acf7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.891480:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349acf7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.891489:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11f:0x0]: returning size 0 00010000:00010000:2.0:1787826300.891533:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349acf0 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc99 expref: 63 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.891549:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349acf7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc99 expref: 62 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.891558:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826300.891561:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826300.891565:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826300.891618:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84212:x1874668789740544:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 664us (929us total) trans 8590016404 rc 0/0 00000100:00100000:2.0:1787826300.891625:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111279 00000100:00100000:2.0:1787826300.894149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.894479:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789740800 00000100:00100000:1.0:1787826300.894488:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789740800 00000100:00100000:2.0:1787826300.894793:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111280 00000100:00100000:2.0:1787826300.894805:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84212:x1874668789740800:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.895047:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826300.895072:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349acf7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbc99 expref: 62 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895088:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826300.895097:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.895117:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895129:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895139:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895151:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895158:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895164:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895211:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895218:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895225:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895231:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.895235:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895243:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895251:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.895253:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.895257:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895262:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ad05 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895269:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895274:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895279:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895284:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.895287:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895291:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895296:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x880e97d8 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826300.895298:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.895301:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.895307:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ad0c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x880e97d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.895432:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84212:x1874668789740800:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 629us (1292us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826300.895439:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111280 00000100:00100000:3.0:1787826300.898358:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.898602:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789740928 00000100:00100000:2.0:1787826300.898612:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789740928 00000100:00100000:2.0:1787826300.898713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111281 00000100:00100000:2.0:1787826300.898724:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84212:x1874668789740928:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.898743:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.898765:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad13 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbca0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.898798:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.898815:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.898826:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.898951:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad13 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca0 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.898971:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca0 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.898980:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826300.898982:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826300.898985:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:2.0:1787826300.899039:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84212:x1874668789740928:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 316us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.899046:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111281 00000100:00100000:3.0:1787826300.899128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.899426:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789741184 00000100:00100000:0.0:1787826300.899431:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789741184 00000100:00100000:2.0:1787826300.899465:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111282 00000100:00100000:2.0:1787826300.899473:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84211:x1874668789741184:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.899483:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.899494:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad21 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbca7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.899917:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ad28 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.899931:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ad28 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.899939:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ad28 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.899949:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x120:0x0]: returning size 0 00010000:00010000:2.0:1787826300.899991:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad21 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca7 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.900004:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ad28 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca7 expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.900011:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826300.900013:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826300.900016:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:2.0:1787826300.900056:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84211:x1874668789741184:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 584us (929us total) trans 8590016405 rc 0/0 00000100:00100000:2.0:1787826300.900063:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111282 00000100:00100000:1.0:1787826300.901497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.902609:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789741440 00000100:00100000:3.0:1787826300.902634:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789741440 00000100:00100000:3.0:1787826300.902693:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111283 00000100:00100000:3.0:1787826300.902704:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84212:x1874668789741440:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.902780:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.902795:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.902814:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826300.902964:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018a0fb7c reply state 0000000093229ea3 transno 8590016406 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.902976:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.902983:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:3.0:1787826300.902986:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826300.902989:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826300.903061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.903076:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84212:x1874668789741440:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 375us (1586us total) trans 8590016406 rc 0/0 00000100:00100000:3.0:1787826300.903083:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111283 00000100:00100000:3.0:1787826300.903098:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789741696 00000100:00100000:3.0:1787826300.903101:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789741696 00000100:00100000:3.0:1787826300.903124:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111284 00000100:00100000:3.0:1787826300.903131:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84210:x1874668789741696:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.903143:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.903154:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad3d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcae expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.903427:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ad44 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.903437:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ad44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.903443:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ad44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826300.903456:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x121:0x0]: returning size 0 00010000:00010000:3.0:1787826300.903496:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad3d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcae expref: 69 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.904016:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ad44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcae expref: 68 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.904024:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbe0a9bf300) 00010000:00010000:3.0:1787826300.904026:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826300.904028:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826300.904068:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84210:x1874668789741696:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 937us (1007us total) trans 8590016407 rc 0/0 00000100:00100000:3.0:1787826300.904076:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111284 00000100:00100000:1.0:1787826300.906044:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.906097:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789741824 00000100:00100000:2.0:1787826300.906106:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789741824 00000100:00100000:1.0:1787826300.906114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.906155:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789742080 00000100:00100000:2.0:1787826300.906158:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789742080 00000100:00100000:1.0:1787826300.906165:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111285 00000100:00100000:1.0:1787826300.906175:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84212:x1874668789741824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.906188:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111286 00000100:00100000:2.0:1787826300.906193:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84211:x1874668789742080:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.906196:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.906214:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcb5 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906250:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.906257:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcb5 expref: 70 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906267:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ad28 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca7 expref: 70 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.906268:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcb5 expref: 70 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.906278:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826300.906280:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826300.906281:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.906284:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7400, rc 0) 00010000:00010000:2.0:1787826300.906287:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.906300:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906308:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906316:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.906328:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84212:x1874668789741824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 155us (292us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826300.906328:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906336:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.906339:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111285 00010000:00010000:2.0:1787826300.906342:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906380:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906387:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906394:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906399:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.906403:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906411:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906430:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.906432:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.906436:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906442:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ad59 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906452:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906457:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906464:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906469:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.906471:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906478:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906485:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xbfccb8e9 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826300.906487:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.906490:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.906496:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad60 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xbfccb8e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.906689:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84211:x1874668789742080:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 494us (573us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826300.906705:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111286 00000100:00100000:1.0:1787826300.909000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.909070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.909137:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789742208 00000100:00100000:3.0:1787826300.909146:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789742208 00000100:00100000:3.0:1787826300.909190:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789742464 00000100:00100000:3.0:1787826300.909193:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789742464 00000100:00100000:3.0:1787826300.909227:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111287 00000100:00100000:3.0:1787826300.909236:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84211:x1874668789742208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.909254:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.909275:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ad67 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcbc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.909276:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111288 00000100:00100000:2.0:1787826300.909284:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84210:x1874668789742464:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.909306:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.909319:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909320:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.909335:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909336:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ad44 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcae expref: 70 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909350:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbe0a9bf300) 00010000:00010000:2.0:1787826300.909358:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826300.909372:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909380:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909387:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909397:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909403:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909423:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.909434:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349ad67 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcbc expref: 70 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.909447:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcbc expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.909453:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:3.0:1787826300.909455:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826300.909458:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc 0) 00010000:00010000:2.0:1787826300.909459:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909465:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909470:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909476:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.909479:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909486:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909493:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.909495:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.909498:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.909506:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84211:x1874668789742208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 271us (514us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826300.909516:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ad75 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.909516:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111287 00010000:00010000:2.0:1787826300.909525:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909530:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909536:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909541:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.909544:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909551:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909558:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x61bd9211 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826300.909560:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.909563:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.909569:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad7c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x61bd9211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.909614:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84210:x1874668789742464:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 331us (543us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826300.909621:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111288 00000100:00100000:1.0:1787826300.916503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.916580:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.916670:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789742592 00000100:00100000:3.0:1787826300.916679:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789742592 00000100:00100000:3.0:1787826300.916733:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2644 00000100:00100000:3.0:1787826300.916743:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84212:x1874668789742592:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.916874:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84212:x1874668789742592:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 131us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.916882:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2644 00000100:00100000:3.0:1787826300.917275:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.918805:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789742720 00000100:00100000:0.0:1787826300.918921:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789742720 00000100:00100000:0.0:1787826300.918967:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789742976 00000100:00100000:0.0:1787826300.918971:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789742976 00000100:00100000:0.0:1787826300.918994:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111289 00000100:00100000:0.0:1787826300.919004:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84210:x1874668789742720:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.919020:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.919041:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ad83 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcc3 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.919082:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.919095:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.919106:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.919156:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111290 00000100:00100000:2.0:1787826300.919166:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84211:x1874668789742976:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.919207:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ad83 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcc3 expref: 71 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.919212:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.919222:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.919225:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcc3 expref: 70 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.919235:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:2.0:1787826300.919235:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.919238:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826300.919242:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3c00, rc 0) 00000100:00100000:0.0:1787826300.919293:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84210:x1874668789742720:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 291us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.919299:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111289 00000004:00010000:2.0:1787826300.919372:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7e8ac25 reply state 000000001501ce2d transno 8590016408 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.919385:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.919391:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:2.0:1787826300.919394:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826300.919396:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826300.919470:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84211:x1874668789742976:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 306us (2195us total) trans 8590016408 rc 0/0 00000100:00100000:2.0:1787826300.919477:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111290 00000100:00100000:3.0:1787826300.919513:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.919668:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789743232 00000100:00100000:2.0:1787826300.919672:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789743232 00000100:00100000:2.0:1787826300.919697:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2645 00000100:00100000:2.0:1787826300.919704:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84212:x1874668789743232:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.919841:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84212:x1874668789743232:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 137us (944us total) trans 8590016409 rc 0/0 00000100:00100000:2.0:1787826300.919849:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2645 00000100:00100000:3.0:1787826300.924049:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.924171:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789743488 00000100:00100000:2.0:1787826300.924180:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789743488 00000100:00100000:2.0:1787826300.924384:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111291 00000100:00100000:2.0:1787826300.924395:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84210:x1874668789743488:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.924495:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.924513:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.924524:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826300.924659:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb1acbaa reply state 0000000079bd60a0 transno 8590016410 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.924673:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.924680:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:2.0:1787826300.924682:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826300.924686:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826300.924785:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84210:x1874668789743488:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 391us (744us total) trans 8590016410 rc 0/0 00000100:00100000:2.0:1787826300.924794:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111291 00000100:00100000:0.0:1787826300.925691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.925733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789743616 00000100:00100000:3.0:1787826300.925740:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789743616 00000100:00100000:3.0:1787826300.925784:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111292 00000100:00100000:3.0:1787826300.925792:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84211:x1874668789743616:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.925817:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.925833:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.925891:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcca expref: 75 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.925904:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcca expref: 75 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.925912:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:3.0:1787826300.925916:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.925919:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00000100:00100000:3.0:1787826300.925962:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84211:x1874668789743616:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 171us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.925969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111292 00000100:00100000:0.0:1787826300.931959:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.931998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.932023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.932050:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789744128 00000100:00100000:0.0:1787826300.932059:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789744128 00000100:00100000:0.0:1787826300.932105:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2646 00000100:00100000:0.0:1787826300.932115:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84211:x1874668789744128:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.932234:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84211:x1874668789744128:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 120us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.932242:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2646 00000100:00100000:2.0:1787826300.932324:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789743872 00000100:00100000:2.0:1787826300.932329:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789743872 00000100:00100000:2.0:1787826300.932358:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789744000 00000100:00100000:2.0:1787826300.932362:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789744000 00000100:00100000:2.0:1787826300.932383:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111293 00000100:00100000:2.0:1787826300.932390:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84212:x1874668789743872:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.932458:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84212:x1874668789743872:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 68us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.932466:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111293 00000100:00100000:2.0:1787826300.932480:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111294 00000100:00100000:2.0:1787826300.932487:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84210:x1874668789744000:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.932497:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.932518:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcd1 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.932565:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd1 expref: 76 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.932582:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd1 expref: 76 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.932593:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:2.0:1787826300.932596:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.932601:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826300.932622:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84210:x1874668789744000:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 134us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.932628:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111294 00000100:00100000:2.0:1787826300.934936:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.935014:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.935191:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789744512 00000100:00100000:3.0:1787826300.935191:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789744384 00000100:00100000:0.0:1787826300.935200:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789744512 00000100:00100000:3.0:1787826300.935200:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789744384 00000100:00100000:3.0:1787826300.935254:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2647 00000100:00100000:3.0:1787826300.935264:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84211:x1874668789744384:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.935465:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84211:x1874668789744384:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 203us (535us total) trans 8590016411 rc 0/0 00000100:00100000:3.0:1787826300.935472:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2647 00000100:00100000:0.0:1787826300.939423:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2648 00000100:00100000:0.0:1787826300.939443:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84210:x1874668789744512:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.939558:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84210:x1874668789744512:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 123us (4543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.939565:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2648 00000100:00100000:0.0:1787826300.943390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.943493:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789744768 00000100:00100000:3.0:1787826300.943502:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789744768 00000100:00100000:3.0:1787826300.943554:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111295 00000100:00100000:3.0:1787826300.943563:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84212:x1874668789744768:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.943582:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.943601:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349adad lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcd8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.943713:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.943729:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcb5 expref: 78 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.943738:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.943772:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcb5 expref: 78 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.943785:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcb5 expref: 78 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.943799:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10038f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778621952:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826300.943895:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15bab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.947385:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.947435:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.947437:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789745024 00000100:00100000:1.0:1787826300.947446:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789745024 00000100:00100000:3.0:1787826300.947487:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.947498:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111296 00000100:00100000:1.0:1787826300.947506:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84211:x1874668789745024:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826300.947528:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10038f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778621952:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826300.947552:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.947615:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84211:x1874668789745024:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 108us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.947623:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111296 00000100:00100000:1.0:1787826300.947651:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789745408 00000100:00100000:1.0:1787826300.947655:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789745408 00010000:00010000:1.0:1787826300.947672:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcb5 expref: 79 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.947694:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3001 00000100:00100000:1.0:1787826300.947700:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2402:x1874668789745408:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826300.947711:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.947717:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcb5 expref: 79 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.947728:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcb5 expref: 79 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.947755:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349ad52 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcb5 expref: 79 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.947767:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:1.0:1787826300.947772:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.947782:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.947790:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.947811:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826300.947833:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+78:2402:x1874668789745408:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 132us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.947839:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3001 00000100:00100000:0.0:1787826300.947942:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789745280 00000100:00100000:0.0:1787826300.947947:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789745280 00000100:00100000:0.0:1787826300.947979:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2649 00000100:00100000:0.0:1787826300.947989:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84210:x1874668789745280:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.948150:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84210:x1874668789745280:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 163us (714us total) trans 8590016412 rc 0/0 00000100:00100000:0.0:1787826300.948157:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2649 00010000:00010000:3.0:1787826300.950924:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.950940:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826300.950962:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11f:0x0]: returning size 0 00000100:00100000:0.0:1787826300.951341:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.951423:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.951479:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789745664 00000100:00100000:3.0:1787826300.951486:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789745664 00000100:00100000:3.0:1787826300.951559:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789745920 00000100:00100000:3.0:1787826300.951562:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789745920 00000004:00080000:2.0:1787826300.951726:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xbf:0x0], index 1: 0 00010000:00010000:2.0:1787826300.951827:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.951837:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.951843:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.951917:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826300.951922:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.951929:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.951944:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826300.951947:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826300.951952:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.951958:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349adb4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.952007:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349adad lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd8 expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.952018:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826300.952020:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826300.952023:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349adad lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd8 expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.952033:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606600, rc 0) 00000100:00100000:2.0:1787826300.952089:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84212:x1874668789744768:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 8527us (8709us total) trans 8590016413 rc 301/301 00000100:00100000:2.0:1787826300.952098:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111295 00000100:00100000:2.0:1787826300.952121:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111297 00000100:00100000:2.0:1787826300.952130:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84211:x1874668789745664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826300.952146:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.952160:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349adc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.952244:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.952256:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcca expref: 80 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.952265:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.952296:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcca expref: 80 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.952310:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcca expref: 80 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.952323:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a107c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778622080:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.952375:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.952521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111298 00000100:00100000:0.0:1787826300.952531:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84210:x1874668789745920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.952582:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84210:x1874668789745920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 53us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.952588:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111298 00000100:00100000:3.0:1787826300.955127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.955286:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789746304 00000100:00100000:0.0:1787826300.955306:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789746304 00000100:00100000:0.0:1787826300.955355:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2650 00000100:00100000:0.0:1787826300.955364:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84212:x1874668789746304:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826300.955621:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84212:x1874668789746304:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 256us (505us total) trans 8590016414 rc 0/0 00000100:00100000:0.0:1787826300.955628:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2650 00000100:00100000:3.0:1787826300.957655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.957682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.957832:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a107c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778622080:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826300.957836:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789746432 00000100:00100000:0.0:1787826300.957842:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789746432 00010000:00010000:1.0:1787826300.957874:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.958014:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcca expref: 81 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.958051:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3002 00000100:00100000:0.0:1787826300.958060:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe100392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2401:x1874668789746432:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826300.958073:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826300.958080:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcca expref: 81 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.958092:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcca expref: 81 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.958115:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ad9f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcca expref: 81 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.958133:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:0.0:1787826300.958138:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.958147:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.958155:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.958172:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826300.958346:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.958354:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.958377:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x120:0x0]: returning size 0 00000004:00080000:1.0:1787826300.958526:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xbf:0x0], index 0: 0 00010000:00010000:1.0:1787826300.958617:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.958625:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.958632:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.958637:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.958641:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.958647:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.958656:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:1.0:1787826300.958659:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.958663:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.958668:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349adc9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.958688:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789746560 00000100:00100000:2.0:1787826300.958692:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789746560 00010000:00010000:1.0:1787826300.958727:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349adc2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcdf expref: 82 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.958727:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111299 00000100:00100000:2.0:1787826300.958735:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84210:x1874668789746560:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.958736:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826300.958739:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826300.958742:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349adc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcdf expref: 82 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.958749:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.958755:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00010000:00010000:2.0:1787826300.958762:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349add7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbce6 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.958785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84211:x1874668789745664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 6657us (7450us total) trans 8590016415 rc 301/301 00000100:00100000:1.0:1787826300.958792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111297 00010000:00010000:2.0:1787826300.958830:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 3/0,1 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.958842:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd1 expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.958849:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 4/0,1 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.958892:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd1 expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.958905:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd1 expref: 81 pid: 25759 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.958917:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778622208:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826300.958964:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826300.959111:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe100392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2401:x1874668789746432:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1050us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.959119:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3002 00000100:00100000:0.0:1787826300.965792:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.965874:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789746816 00000100:00100000:1.0:1787826300.965883:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789746816 00000100:00100000:2.0:1787826300.965915:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778622208:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826300.965932:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2651 00010000:00010000:2.0:1787826300.965939:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 3/0,1 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.965941:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84211:x1874668789746816:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.966210:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84211:x1874668789746816:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 268us (425us total) trans 8590016416 rc 0/0 00000100:00100000:1.0:1787826300.966218:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2651 00000100:00100000:0.0:1787826300.968523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.968596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.968625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826300.968662:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789747072 00000100:00100000:1.0:1787826300.968670:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789747072 00010000:00010000:1.0:1787826300.968718:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd1 expref: 82 pid: 25759 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.968750:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3003 00000100:00100000:1.0:1787826300.968760:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40510050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2401:x1874668789747072:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826300.968773:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826300.968781:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd1 expref: 82 pid: 25759 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.968794:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd1 expref: 82 pid: 25759 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.968821:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ada6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcd1 expref: 82 pid: 25759 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.968835:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:1.0:1787826300.968840:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 3/0,1 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.968869:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.968878:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.968901:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826300.968946:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40510050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2401:x1874668789747072:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 187us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.968953:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3003 00010000:00010000:1.0:1787826300.969022:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969030:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.969047:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x121:0x0]: returning size 0 00000004:00080000:1.0:1787826300.969190:0:7736:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc0:0x0], index 1: 0 00010000:00010000:1.0:1787826300.969286:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969294:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969301:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969307:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826300.969310:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969318:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969327:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:1.0:1787826300.969329:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826300.969332:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 2/0,0 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969337:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349adde lrc: 0/0,0 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969379:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349add7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbce6 expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969388:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826300.969390:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826300.969393:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349add7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbce6 expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.969401:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:1.0:1787826300.969439:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84210:x1874668789746560:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 10704us (11755us total) trans 8590016417 rc 301/301 00000100:00100000:1.0:1787826300.969450:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111299 00000100:00100000:1.0:1787826300.973390:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789746944 00000100:00100000:1.0:1787826300.973406:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789746944 00000100:00100000:1.0:1787826300.973469:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789747200 00000100:00100000:1.0:1787826300.973473:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789747200 00000100:00100000:1.0:1787826300.973502:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111300 00000100:00100000:1.0:1787826300.973511:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84212:x1874668789746944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.973535:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.973555:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349adec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbced expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.973620:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349adf3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.973634:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349adf3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.973645:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349adf3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.973685:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11f:0x0]: returning size 0 00000004:00200000:1.0:1787826300.973689:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826300.973717:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349adf3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.973742:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349adec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbced expref: 83 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.973757:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349adf3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbced expref: 82 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.973765:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:1.0:1787826300.973768:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826300.973771:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826300.973834:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84212:x1874668789746944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 324us (5319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.973841:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111300 00000100:00100000:1.0:1787826300.973881:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111301 00000100:00100000:1.0:1787826300.973890:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84211:x1874668789747200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826300.973898:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.973907:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349adfa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcf4 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.973937:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349ae01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.973946:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349ae01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.973954:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349ae01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826300.973973:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x120:0x0]: returning size 0 00000004:00200000:1.0:1787826300.973976:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826300.973984:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349ae01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.974002:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349adfa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcf4 expref: 83 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.974015:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349ae01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcf4 expref: 82 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.974021:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:1.0:1787826300.974024:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826300.974026:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826300.974048:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84211:x1874668789747200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 160us (5422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.974054:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111301 00000100:00100000:0.0:1787826300.977080:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.977200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.977469:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789747584 00000100:00100000:3.0:1787826300.977478:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789747584 00000100:00100000:3.0:1787826300.977524:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6225 00000100:00100000:3.0:1787826300.977534:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789747584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.977551:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.977570:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbcfb expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826300.977594:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826300.977611:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=2939s v=(0 0) 00010000:00010000:3.0:1787826300.977615:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.977624:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcfb expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.977641:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcfb expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.977654:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826300.977703:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789747584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 171us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.977710:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6225 00000100:00100000:0.0:1787826300.977785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826300.978028:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789747712 00000100:00100000:3.0:1787826300.978033:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789747712 00000100:00100000:1.0:1787826300.981451:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789747456 00000100:00100000:1.0:1787826300.981465:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789747456 00000100:00100000:1.0:1787826300.981512:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2652 00000100:00100000:1.0:1787826300.981522:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84210:x1874668789747456:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826300.981791:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84210:x1874668789747456:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 269us (4718us total) trans 8590016418 rc 0/0 00000100:00100000:1.0:1787826300.981800:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2652 00000100:00100000:3.0:1787826300.982542:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6226 00000100:00100000:3.0:1787826300.982555:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789747712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826300.982569:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.982589:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd02 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826300.982612:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826300.982628:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=2939s v=(0 0) 00010000:00010000:3.0:1787826300.982632:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826300.982641:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd02 expref: 13 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.982661:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd02 expref: 13 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.982673:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607e00, rc 0) 00000100:00100000:3.0:1787826300.982846:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789747712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 294us (5061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.983010:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6226 00000100:00100000:1.0:1787826300.985443:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.985611:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789747968 00000100:00100000:2.0:1787826300.985620:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789747968 00000100:00100000:2.0:1787826300.985680:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111302 00000100:00100000:2.0:1787826300.985691:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84212:x1874668789747968:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.985798:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84212:x1874668789747968:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 109us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.985805:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111302 00000100:00100000:3.0:1787826300.990400:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826300.991951:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789748096 00000100:00100000:0.0:1787826300.991963:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789748096 00000100:00100000:0.0:1787826300.992012:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111303 00000100:00100000:0.0:1787826300.992021:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84210:x1874668789748096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826300.992042:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.992061:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd09 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.992127:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349ae1d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.992141:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349ae1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.992151:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349ae1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826300.992192:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x121:0x0]: returning size 0 00000004:00200000:0.0:1787826300.992196:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826300.992213:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349ae1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.992238:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae16 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd09 expref: 85 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.992255:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349ae1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd09 expref: 84 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.992264:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:0.0:1787826300.992267:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826300.992270:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2400, rc 0) 00000100:00100000:0.0:1787826300.992345:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+84:84210:x1874668789748096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 324us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.992352:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111303 00000100:00100000:1.0:1787826300.996932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826300.997086:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789748352 00000100:00100000:2.0:1787826300.997094:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789748352 00000100:00100000:2.0:1787826300.997176:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111304 00000100:00100000:2.0:1787826300.997186:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+84:84211:x1874668789748352:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826300.997280:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+84:84211:x1874668789748352:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.997288:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111304 00000100:00100000:3.0:1787826301.005929:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.005976:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789748480 00000100:00100000:1.0:1787826301.005985:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789748480 00000100:00080000:3.0:1787826301.006041:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826301.006053:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6227 00000100:00100000:1.0:1787826301.006064:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789748480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.006081:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.006102:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd10 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826301.006129:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826301.006148:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=2939s v=(0 0) 00010000:00010000:1.0:1787826301.006153:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.006162:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd10 expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.006179:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd10 expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.006191:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7400, rc 0) 00000100:00100000:1.0:1787826301.006250:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789748480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 188us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.006257:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6227 00000100:00100000:0.0:1787826301.006332:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.006384:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789748608 00000100:00100000:1.0:1787826301.006389:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789748608 00000100:00100000:1.0:1787826301.006433:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6228 00000100:00100000:1.0:1787826301.006440:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84211:x1874668789748608:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.006448:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.006459:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd17 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.006478:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd02 expref: 14 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.006492:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.006495:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.006500:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 4/0,0 mode: --/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 14 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.006529:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd02 expref: 14 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.006543:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd02 expref: 14 pid: 25038 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.006557:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778622336:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826301.006613:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062180 going to sleep for 11 seconds 00000100:00080000:1.0:1787826301.006629:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826301.014204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.014319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.014349:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789748992 00000100:00100000:1.0:1787826301.014357:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789748992 00000100:00100000:1.0:1787826301.014405:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111305 00000100:00100000:1.0:1787826301.014428:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf4054f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+84:84210:x1874668789748992:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.014527:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf4054f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+84:84210:x1874668789748992:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.014535:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111305 00000100:00100000:0.0:1787826301.015940:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778622336:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.015975:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 3/0,0 mode: --/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 14 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.015995:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:0.0:1787826301.016038:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84211:x1874668789748608:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9597us (9705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.016047:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6228 00000100:00100000:0.0:1787826301.016068:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789748736 00000100:00100000:0.0:1787826301.016073:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789748736 00000100:00100000:2.0:1787826301.016442:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6229 00000100:00100000:2.0:1787826301.016455:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84212:x1874668789748736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.016469:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.016486:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd1e expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.016511:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcfb expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.016521:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.016526:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.016532:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 12 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.016564:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcfb expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.016578:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcfb expref: 12 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.016593:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778622464:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826301.016649:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.019209:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.019285:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789749120 00000100:00100000:1.0:1787826301.019303:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789749120 00010000:00010000:1.0:1787826301.019342:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd02 expref: 14 pid: 25038 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.019383:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3004 00000100:00100000:1.0:1787826301.019393:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789749120:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826301.019408:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.019443:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd02 expref: 14 pid: 25038 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.019458:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd02 expref: 14 pid: 25038 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.019480:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f1bea0/0x68019081f349ae0f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd02 expref: 14 pid: 25038 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.019495:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.019500:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.019509:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.019521:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.019557:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.019578:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b9a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778622592:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826301.019651:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.037627:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.037662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.037714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.037722:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789749376 00000100:00100000:0.0:1787826301.037730:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789749376 00010000:00010000:0.0:1787826301.037766:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcfb expref: 13 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.037820:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3005 00000100:00100000:0.0:1787826301.037830:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789749376:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826301.037843:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.037882:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcfb expref: 13 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.037897:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcfb expref: 13 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.037923:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.037928:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.037939:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.037949:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.037975:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae08 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcfb expref: 13 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.037984:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.037987:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778622464:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826301.037997:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778622720:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826301.038010:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 12 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.038020:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:0.0:1787826301.038083:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.038251:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789749248 00000100:00100000:1.0:1787826301.038256:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789749248 00000100:00100000:1.0:1787826301.038322:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6230 00000100:00100000:1.0:1787826301.038330:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a106940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84210:x1874668789749248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.038342:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.038355:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd25 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.038374:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd10 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.038382:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.038385:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.038390:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.038405:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84212:x1874668789748736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 21954us (24210us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826301.038419:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd10 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.038422:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6229 00010000:00010000:1.0:1787826301.038432:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd10 expref: 14 pid: 8433 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.038448:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778622848:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826301.038477:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.038501:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b9a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778622592:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826301.038513:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826301.038532:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789749120:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 19141us (19332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.038539:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3004 00000100:00100000:1.0:1787826301.038563:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789749504 00000100:00100000:1.0:1787826301.038567:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789749504 00002000:00100000:1.0:1787826301.038592:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xbf:0x0] (0->157) req@ffff9bbe0a104780 x1874668789749504/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/0 e 0 to 0 dl 1787826312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826301.038602:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a104780 with x1874668789749504 ext(0->157) 00002000:00010000:1.0:1787826301.038607:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a104780 00000100:00100000:1.0:1787826301.038627:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1567 00000100:00100000:1.0:1787826301.038634:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789749504:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.042141:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789749504:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 3497us (4417us total) trans 4294968171 rc 0/0 00000100:00100000:1.0:1787826301.042155:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1567 00002000:00100000:1.0:1787826301.042168:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xbf:0x0] (0->157) req@ffff9bbe0a104780 x1874668789749504/t4294968171(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/448 e 0 to 0 dl 1787826312 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826301.042178:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a104780 with x1874668789749504 ext(0->157) 00002000:00010000:1.0:1787826301.042184:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a104780 00000100:00100000:2.0:1787826301.048993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.049116:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778622720:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826301.049141:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826301.049195:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789749376:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 11365us (11531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.049206:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3005 00000100:00100000:1.0:1787826301.049317:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778622848:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826301.049341:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 12 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.049361:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:1.0:1787826301.049385:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a106940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:84210:x1874668789749248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 11057us (11769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.049393:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6230 00000100:00100000:2.0:1787826301.050048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.050075:0:45397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789749760 00000100:00100000:2.0:1787826301.050082:0:45397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789749760 00002000:00100000:2.0:1787826301.050123:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xbf:0x0] (0->157) req@ffff9bbe0a106d00 x1874668789749760/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/0 e 0 to 0 dl 1787826312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826301.050135:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a106d00 with x1874668789749760 ext(0->157) 00002000:00010000:2.0:1787826301.050140:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a106d00 00000100:00100000:2.0:1787826301.050162:0:45397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1568 00000100:00100000:2.0:1787826301.050171:0:45397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a106d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789749760:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.054486:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789749632 00000100:00100000:2.0:1787826301.054500:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789749632 00010000:00010000:2.0:1787826301.054552:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd10 expref: 15 pid: 8433 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.054586:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3006 00000100:00100000:2.0:1787826301.054594:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789749632:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826301.054609:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.054629:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd10 expref: 15 pid: 8433 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.054642:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd10 expref: 15 pid: 8433 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.054664:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c17aa6f2/0x68019081f349ae24 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd10 expref: 15 pid: 8433 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.054681:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.054685:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.054705:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.054716:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.054749:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.054762:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a1061c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778622976:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826301.054839:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.056725:0:45397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a106d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789749760:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 6545us (6670us total) trans 4294968153 rc 0/0 00000100:00100000:1.0:1787826301.056738:0:45397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1568 00002000:00100000:1.0:1787826301.056750:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xbf:0x0] (0->157) req@ffff9bbe0a106d00 x1874668789749760/t4294968153(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/448 e 0 to 0 dl 1787826312 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826301.056760:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a106d00 with x1874668789749760 ext(0->157) 00002000:00010000:1.0:1787826301.056766:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a106d00 00000100:00100000:2.0:1787826301.058273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.059355:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.059445:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789749888 00000100:00100000:3.0:1787826301.059452:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789749888 00000100:00100000:3.0:1787826301.059508:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789750016 00000100:00100000:3.0:1787826301.059512:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789750016 00000100:00100000:3.0:1787826301.059536:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111306 00000100:00100000:3.0:1787826301.059545:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+85:84211:x1874668789749888:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826301.059605:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111307 00000100:00100000:3.0:1787826301.059613:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+85:84212:x1874668789750016:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826301.059970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.060022:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a1061c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778622976:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826301.060045:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826301.060130:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789749632:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5536us (11147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.060141:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3006 00000100:00100000:1.0:1787826301.060173:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789750144 00000100:00100000:1.0:1787826301.060178:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789750144 00002000:00100000:1.0:1787826301.060208:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc0:0x0] (0->157) req@ffff9bbe1003ad00 x1874668789750144/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/0 e 0 to 0 dl 1787826312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826301.060218:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1003ad00 with x1874668789750144 ext(0->157) 00002000:00010000:1.0:1787826301.060223:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1003ad00 00000100:00100000:1.0:1787826301.060248:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1569 00000100:00100000:1.0:1787826301.060255:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789750144:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.064182:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789750144:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 3914us (4199us total) trans 4294968154 rc 0/0 00000100:00100000:0.0:1787826301.064198:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1569 00002000:00100000:0.0:1787826301.064212:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc0:0x0] (0->157) req@ffff9bbe1003ad00 x1874668789750144/t4294968154(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/448 e 0 to 0 dl 1787826312 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826301.064223:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1003ad00 with x1874668789750144 ext(0->157) 00002000:00010000:0.0:1787826301.064231:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1003ad00 00000001:00080000:3.0:1787826301.066083:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016418 is committed 00000020:00080000:3.0:1787826301.066135:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe1272e840 refcount 2 committed 0 result 0 batchid 4294970882 00000020:00080000:3.0:1787826301.066141:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bccb700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe1272ed80 00000020:00080000:3.0:1787826301.066144:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bccb000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d5fc400 00000020:00080000:1.0:1787826301.066176:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970876 00000020:00080000:3.0:1787826301.066214:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbf404376c0 refcount 2 committed 0 result 0 batchid 4294970881 00000020:00080000:3.0:1787826301.066218:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5eb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf01254f00 00000020:00080000:3.0:1787826301.066221:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe124a4400 00000020:00080000:1.0:1787826301.066245:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970876 00000020:00080000:3.0:1787826301.066278:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17d56600 refcount 2 committed 0 result 0 batchid 4294970880 00000020:00080000:3.0:1787826301.066282:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d56180 00000020:00080000:3.0:1787826301.066285:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0de29000 00000020:00080000:1.0:1787826301.066314:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970882 committed batchid 4294970876 00000020:00080000:1.0:1787826301.066374:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970876 00000020:00080000:3.0:1787826301.066741:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970879 batchid updated 00000100:00100000:2.0:1787826301.066914:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84212:x1874668789750016:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 7297us (7558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.066925:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111307 00000100:00100000:1.0:1787826301.066928:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.066951:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789750272 00000100:00100000:2.0:1787826301.066958:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789750272 00000100:00100000:2.0:1787826301.066994:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111308 00000100:00100000:2.0:1787826301.067002:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84210:x1874668789750272:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.067075:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84210:x1874668789750272:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 72us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.067082:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111308 00000100:00100000:3.0:1787826301.067748:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84211:x1874668789749888:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 8202us (9479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.067757:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111306 00010000:00010000:0.0:1787826301.067946:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.067963:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.067970:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.067977:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.067982:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.067990:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068005:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11c:0x0].0x0 (ffff9bbe0a9bf200) 00010000:00010000:0.0:1787826301.068008:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.068013:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068019:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349abae lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068058:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068064:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068069:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068073:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.068077:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068083:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068091:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11d:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:0.0:1787826301.068093:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.068096:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068102:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349abdf lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068116:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068122:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068127:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068131:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.068133:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068138:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068144:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11e:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826301.068146:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.068149:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068154:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ac25 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068167:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068173:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068178:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068183:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.068186:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068192:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068198:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:0.0:1787826301.068200:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826301.068203:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068208:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349ad36 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068231:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068241:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068247:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068252:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.068254:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068260:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068269:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:0.0:1787826301.068271:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826301.068274:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068280:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349ad91 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068762:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068771:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068777:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068782:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.068786:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068792:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.068801:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:0.0:1787826301.069103:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826301.069109:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.069117:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ad98 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.069374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.069450:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.069501:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789750400 00000100:00100000:0.0:1787826301.069508:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789750400 00000100:00100000:0.0:1787826301.069554:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789750528 00000100:00100000:0.0:1787826301.069558:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789750528 00000100:00100000:0.0:1787826301.069581:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6231 00000100:00100000:0.0:1787826301.069590:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789750400:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.069620:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6232 00000100:00100000:2.0:1787826301.069629:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789750528:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.070084:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.070128:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789750656 00000100:00100000:0.0:1787826301.070133:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789750656 00000100:00100000:0.0:1787826301.070167:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6233 00000100:00100000:0.0:1787826301.070174:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789750656:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787826301.071651:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968154 is committed 00000001:00080000:3.0:1787826301.071669:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968152 is committed 00000100:00100000:2.0:1787826301.072066:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789750528:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2433us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.072076:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6232 00000100:00100000:0.0:1787826301.073645:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789750400:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 4048us (4266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.073657:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6231 00000001:00080000:0.0:1787826301.074097:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968171 is committed 00000001:00080000:0.0:1787826301.074107:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968170 is committed 00000100:00100000:1.0:1787826301.074167:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789750656:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 3990us (4082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.074175:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6233 00000100:00100000:3.0:1787826301.079129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.081532:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789750912 00000100:00100000:0.0:1787826301.081547:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789750912 00000100:00100000:0.0:1787826301.081616:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111309 00000100:00100000:0.0:1787826301.081627:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84212:x1874668789750912:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.081685:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.081714:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349adf3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbced expref: 31 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.081730:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:0.0:1787826301.081736:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826301.081768:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.081782:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.081793:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826301.081934:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080a52c9d reply state 00000000dec32418 transno 8590016419 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.081947:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.081954:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:0.0:1787826301.081957:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826301.081960:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826301.082059:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84212:x1874668789750912:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 433us (2940us total) trans 8590016419 rc 0/0 00000100:00100000:0.0:1787826301.082070:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111309 00000100:00100000:1.0:1787826301.082376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.082560:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789751168 00000100:00100000:3.0:1787826301.082567:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789751168 00000100:00100000:3.0:1787826301.082605:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111310 00000100:00100000:3.0:1787826301.082612:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84210:x1874668789751168:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.082638:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.082654:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349ae1d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x121:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd09 expref: 32 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.082669:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:3.0:1787826301.082672:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826301.082691:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.082700:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.082708:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826301.082815:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca96b8ac reply state 0000000079f369d5 transno 8590016420 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.082827:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.082833:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:3.0:1787826301.082836:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826301.082839:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826301.082920:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84210:x1874668789751168:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 308us (544us total) trans 8590016420 rc 0/0 00000100:00100000:3.0:1787826301.082927:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111310 00000100:00100000:1.0:1787826301.090770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.090819:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.090926:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789751296 00000100:00100000:0.0:1787826301.090936:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789751296 00000100:00100000:0.0:1787826301.090983:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789751424 00000100:00100000:0.0:1787826301.090986:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789751424 00000100:00100000:0.0:1787826301.091008:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111311 00000100:00100000:0.0:1787826301.091017:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84212:x1874668789751296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.091041:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.091062:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd2c expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.091119:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd2c expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.091135:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd2c expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.091153:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:0.0:1787826301.091156:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.091160:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3600, rc 0) 00000100:00100000:0.0:1787826301.091216:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84212:x1874668789751296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 199us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.091224:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111311 00000100:00100000:0.0:1787826301.091244:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111312 00000100:00100000:0.0:1787826301.091251:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84210:x1874668789751424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.091258:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.091268:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd33 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.091296:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd33 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.091306:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd33 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.091318:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:0.0:1787826301.091321:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.091323:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc 0) 00000100:00100000:0.0:1787826301.091344:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84210:x1874668789751424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 94us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.091351:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111312 00000100:00100000:1.0:1787826301.096812:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.097013:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789751680 00000100:00100000:2.0:1787826301.097023:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789751680 00000100:00100000:2.0:1787826301.097080:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111313 00000100:00100000:2.0:1787826301.097090:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84211:x1874668789751680:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.097144:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.097172:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349ae01 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x120:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcf4 expref: 35 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.097192:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:2.0:1787826301.097197:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826301.097227:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.097241:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.097250:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826301.097358:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fbae2b0 reply state 0000000057aaa6ea transno 8590016421 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.097371:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.097377:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:2.0:1787826301.097380:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826301.097383:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826301.097492:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84211:x1874668789751680:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 403us (689us total) trans 8590016421 rc 0/0 00000100:00100000:2.0:1787826301.097499:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111313 00000100:00100000:1.0:1787826301.098911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.098945:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.098971:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789751808 00000100:00100000:1.0:1787826301.098979:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789751808 00000100:00100000:1.0:1787826301.099017:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789751936 00000100:00100000:1.0:1787826301.099020:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789751936 00000100:00100000:1.0:1787826301.099041:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6234 00000100:00100000:1.0:1787826301.099049:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789751808:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826301.099183:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xbf:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826301.099187:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xbf:0x0] updating lvb mtime from disk: 0 -> 1787826220 00002000:00010000:1.0:1787826301.099190:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xbf:0x0] updating lvb atime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826301.099193:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xbf:0x0] updating lvb ctime from disk: 0 -> 1787826220 00002000:00010000:1.0:1787826301.099195:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xbf:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826301.099240:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789751808:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 190us (334us total) trans 4294968155 rc 0/0 00000100:00100000:1.0:1787826301.099249:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6234 00000100:00100000:1.0:1787826301.099267:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6235 00000100:00100000:1.0:1787826301.099274:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789751936:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826301.099322:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc0:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826301.099326:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc0:0x0] updating lvb mtime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826301.099328:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc0:0x0] updating lvb atime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826301.099330:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc0:0x0] updating lvb ctime from disk: 0 -> 1787826219 00002000:00010000:1.0:1787826301.099332:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc0:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826301.099354:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789751936:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 81us (409us total) trans 4294968156 rc 0/0 00000100:00100000:1.0:1787826301.099361:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6235 00000100:00100000:0.0:1787826301.115635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.115663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.115691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.115900:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789752064 00000100:00100000:1.0:1787826301.115911:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789752064 00000100:00100000:1.0:1787826301.115961:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789752320 00000100:00100000:1.0:1787826301.115964:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789752320 00000100:00100000:1.0:1787826301.115983:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789752576 00000100:00100000:1.0:1787826301.115986:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789752576 00000100:00100000:1.0:1787826301.116006:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111314 00000100:00100000:1.0:1787826301.116014:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84211:x1874668789752064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.116039:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.116059:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd3a expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116114:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd3a expref: 39 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116133:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd3a expref: 39 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116151:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:1.0:1787826301.116155:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.116158:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6800, rc 0) 00000100:00100000:1.0:1787826301.116211:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84211:x1874668789752064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 197us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.116218:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111314 00000100:00100000:1.0:1787826301.116235:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111315 00000100:00100000:1.0:1787826301.116241:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84210:x1874668789752320:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.116273:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116284:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcc3 expref: 38 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116292:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 4/0,1 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116322:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcc3 expref: 38 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116336:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcc3 expref: 38 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.116355:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db76d00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778623104:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826301.116423:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.116532:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111316 00000100:00100000:1.0:1787826301.116539:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84212:x1874668789752576:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.116563:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116573:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca0 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116580:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116596:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca0 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.116605:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca0 expref: 38 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.116613:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db77480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778623232:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826301.116640:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.120804:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.120876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.124209:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789752704 00000100:00100000:3.0:1787826301.124224:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789752704 00010000:00010000:3.0:1787826301.124266:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcc3 expref: 39 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.124298:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789752832 00000100:00100000:3.0:1787826301.124301:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789752832 00010000:00010000:3.0:1787826301.124317:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca0 expref: 40 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.124337:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3007 00000100:00100000:3.0:1787826301.124346:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789752704:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.124362:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.124369:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcc3 expref: 40 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124383:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcc3 expref: 40 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124426:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:3.0:1787826301.124431:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124441:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124449:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124468:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.124522:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789752704:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 176us (3728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.124530:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3007 00000100:00100000:3.0:1787826301.124547:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3008 00000100:00100000:3.0:1787826301.124619:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789752832:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.124627:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.124633:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca0 expref: 39 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124642:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca0 expref: 39 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124653:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:3.0:1787826301.124657:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124667:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124672:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.124682:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.124701:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789752832:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 148us (3825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.124707:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3008 00010000:00010000:0.0:1787826301.126845:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ad1a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbca0 expref: 38 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.126897:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db77480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778623232:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.126919:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.126929:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.126936:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.126972:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.126979:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.126986:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.126991:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.126995:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127001:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127015:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:0.0:1787826301.127019:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826301.127023:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127030:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349ae71 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.127095:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84212:x1874668789752576:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 10555us (11401us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826301.127104:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111316 00010000:00010000:0.0:1787826301.127157:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349ad8a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x121:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcc3 expref: 36 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.127170:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db76d00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778623104:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.127182:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127189:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127195:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127213:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127220:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127227:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127233:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.127236:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127242:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127252:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:0.0:1787826301.127254:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826301.127259:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.127265:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ae6a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.127296:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84210:x1874668789752320:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 11054us (11632us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826301.127303:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111315 00000100:00100000:3.0:1787826301.127537:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.130587:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789752960 00000100:00100000:0.0:1787826301.130600:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789752960 00000100:00100000:3.0:1787826301.133566:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6236 00000100:00100000:3.0:1787826301.133581:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789752960:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826301.133741:0:25038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xbf:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826301.133745:0:25038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xbf:0x0] updating lvb mtime from disk: 0 -> 1787826219 00002000:00010000:3.0:1787826301.133747:0:25038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xbf:0x0] updating lvb atime from disk: 0 -> 1787826219 00002000:00010000:3.0:1787826301.133750:0:25038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xbf:0x0] updating lvb ctime from disk: 0 -> 1787826219 00002000:00010000:3.0:1787826301.133753:0:25038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xbf:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826301.133825:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789752960:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 247us (6288us total) trans 4294968172 rc 0/0 00000100:00100000:3.0:1787826301.133834:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6236 00000100:00100000:0.0:1787826301.140667:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.140752:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789753088 00000100:00100000:3.0:1787826301.140763:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789753088 00000100:00100000:3.0:1787826301.140825:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6237 00000100:00100000:3.0:1787826301.140836:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789753088:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.140898:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.140921:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 12 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.140931:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.140935:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.140940:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.140973:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 12 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.140989:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 12 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.141005:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778623360:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826301.141088:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.146187:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.146221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.146271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.146610:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789753216 00000100:00100000:0.0:1787826301.146620:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789753216 00000100:00100000:0.0:1787826301.146675:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6238 00000100:00100000:0.0:1787826301.146684:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789753216:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.146736:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.146756:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.146765:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.146769:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826301.146774:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.146807:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.146825:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 13 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.146841:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf412770c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778623488:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826301.146940:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe13482b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.147042:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789753600 00000100:00100000:0.0:1787826301.147046:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789753600 00010000:00010000:0.0:1787826301.147066:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 14 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.147092:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3009 00000100:00100000:0.0:1787826301.147099:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789753600:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826301.147110:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.147132:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 14 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.147145:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 14 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.147166:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826301.147170:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826301.147175:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.147191:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.147207:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826301.147234:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789753600:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 135us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.147241:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3009 00000100:00100000:2.0:1787826301.148630:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789753472 00000100:00100000:2.0:1787826301.148642:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789753472 00000100:00100000:2.0:1787826301.148698:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111317 00000100:00100000:2.0:1787826301.148708:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84211:x1874668789753472:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.148763:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148781:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcbc expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148790:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148819:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcbc expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148832:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcbc expref: 35 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.148845:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778623616:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826301.148929:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53df00 going to sleep for 11 seconds 00010000:00010000:2.0:1787826301.151107:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ae39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd25 expref: 13 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.151131:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778623360:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826301.151152:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.151171:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.151179:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.151210:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.151221:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.151230:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.151238:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826301.151243:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.151254:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.151274:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.151288:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd305f64/0x68019081f349ae78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.151388:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789753088:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 10553us (10730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.151398:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6237 00000100:00100000:0.0:1787826301.156503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.156559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.157442:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf412770c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778623488:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826301.157469:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.157995:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778623616:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826301.158011:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.158490:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789753728 00000100:00100000:3.0:1787826301.158498:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789753728 00010000:00010000:3.0:1787826301.158537:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 12 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.158634:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789753856 00000100:00100000:3.0:1787826301.158638:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789753856 00010000:00010000:3.0:1787826301.158654:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcbc expref: 36 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.158694:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3010 00000100:00100000:3.0:1787826301.158704:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40511050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789753728:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.158721:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.158742:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 12 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.158755:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 12 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.158777:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349ae32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd1e expref: 12 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.158792:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.158797:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.158802:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.158825:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.158870:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826301.158970:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3011 00000100:00100000:2.0:1787826301.158981:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789753856:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826301.158991:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.158997:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcbc expref: 36 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.159008:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcbc expref: 36 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.159023:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ad6e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x120:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbcbc expref: 36 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.159036:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:2.0:1787826301.159040:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.159049:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.159056:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.159073:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.159370:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40511050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789753728:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 666us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.159379:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3010 00010000:00010000:3.0:1787826301.159460:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.159470:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.159493:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.159501:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.159509:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.159517:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826301.159522:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.159530:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.159541:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.159547:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349ae7f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.159968:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2401:x1874668789753856:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 987us (3405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.159977:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3011 00010000:00010000:2.0:1787826301.160004:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.160012:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.160048:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.160055:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.160061:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.160066:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.160070:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.160076:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.160086:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:2.0:1787826301.160089:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826301.160093:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.160099:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ae86 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.160143:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84211:x1874668789753472:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 11437us (13921us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826301.160151:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111317 00000100:00100000:3.0:1787826301.160209:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789753216:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 13525us (14031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.160219:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6238 00000100:00100000:0.0:1787826301.160383:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.164260:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789754112 00000100:00100000:2.0:1787826301.164276:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789754112 00000100:00100000:2.0:1787826301.164443:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111318 00000100:00100000:2.0:1787826301.164454:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84210:x1874668789754112:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.164534:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 3/0,1 mode: --/PW res: [0x200000403:0xec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.164551:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.164562:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.164730:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.164743:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd33 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.164758:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.164792:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd33 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.164807:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd33 expref: 35 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.164821:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778623744:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826301.165287:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.170405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.170463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.170500:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789754496 00000100:00100000:1.0:1787826301.170510:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789754496 00000100:00100000:1.0:1787826301.170570:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111319 00000100:00100000:1.0:1787826301.170580:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84212:x1874668789754496:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.170668:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 3/0,1 mode: --/PW res: [0x200000403:0xee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.170686:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.170697:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.170991:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.171002:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd2c expref: 37 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.171011:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.171041:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd2c expref: 37 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.171057:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd2c expref: 37 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.171072:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778623872:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826301.171142:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.171468:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789754240 00000100:00100000:3.0:1787826301.171474:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789754240 00000100:00100000:3.0:1787826301.171533:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6239 00000100:00100000:3.0:1787826301.171542:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789754240:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.171571:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.171587:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.171595:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.171599:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.171603:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.171626:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.171636:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 13 pid: 8430 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.171647:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778624000:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826301.171679:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.188646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.188680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.188721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.188771:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778623744:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826301.188794:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.188836:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778623872:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826301.188849:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.189206:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789754752 00000100:00100000:0.0:1787826301.189212:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789754752 00010000:00010000:0.0:1787826301.189246:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd2c expref: 38 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.189282:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789754624 00000100:00100000:0.0:1787826301.189285:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789754624 00000100:00100000:2.0:1787826301.189365:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789754880 00000100:00100000:2.0:1787826301.189369:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789754880 00010000:00010000:2.0:1787826301.189388:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 14 pid: 8430 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.189426:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3012 00000100:00100000:2.0:1787826301.189436:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789754752:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826301.189449:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.189456:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd2c expref: 39 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189468:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd2c expref: 39 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189490:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349ae4e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd2c expref: 39 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189507:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826301.189512:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189522:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189530:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189559:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826301.189605:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789754752:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 170us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.189614:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3012 00000100:00100000:2.0:1787826301.189633:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3013 00000100:00100000:2.0:1787826301.189640:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789754880:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826301.189649:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.189669:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 14 pid: 8430 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189679:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 14 pid: 8430 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189695:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826301.189701:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826301.189707:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189717:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.189730:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826301.189750:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789754880:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 110us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.189757:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3013 00010000:00010000:0.0:1787826301.190129:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd33 expref: 37 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.190160:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3014 00000100:00100000:0.0:1787826301.190168:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2402:x1874668789754624:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826301.190176:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.190181:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd33 expref: 37 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.190198:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd33 expref: 37 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.190214:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349ae55 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd33 expref: 37 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.190226:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:0.0:1787826301.190230:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.190239:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.190246:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.190262:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826301.190286:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789754624:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 119us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.190390:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3014 00010000:00010000:1.0:1787826301.190957:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.190967:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826301.191067:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016423 00000001:00080000:1.0:1787826301.191173:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016424 00000001:00080000:1.0:1787826301.191210:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016425 00000100:00100000:1.0:1787826301.191284:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778624128:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1787826301.191347:0:45682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.191376:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe188b7300 going to sleep for 11 seconds 00010000:00010000:1.0:1787826301.191395:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.191402:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826301.191461:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016422 00000001:00080000:1.0:1787826301.191533:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016427 00000001:00080000:1.0:1787826301.191562:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016428 00000100:00100000:1.0:1787826301.191606:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778624256:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787826301.191633:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.191652:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.191670:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778624128 00000100:00100000:1.0:1787826301.191675:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778624128 00000100:00100000:1.0:1787826301.191722:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778624256 00000100:00100000:1.0:1787826301.191725:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778624256 00000100:00100000:1.0:1787826301.191745:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3322 00000100:00100000:1.0:1787826301.191754:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778624128:12345-0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1787826301.191828:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778624128:12345-0@lo:1000:mdt00_008.0 Request processed in 74us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.191836:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3322 00000100:00100000:1.0:1787826301.191878:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3323 00000100:00100000:1.0:1787826301.191886:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778624256:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787826301.191935:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778624256:12345-0@lo:1000:mdt00_005.0 Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.191942:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3323 00000100:00080000:1.0:1787826301.191958:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826301.191989:0:23845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968152 gen 2 00000004:00080000:1.0:1787826301.191995:0:23845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968152 committed transno 4294968152 00000100:00100000:1.0:1787826301.192031:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778624256:0@lo:1000:mdt00_005.0 00000001:00080000:1.0:1787826301.192134:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016429 00000100:00100000:1.0:1787826301.192175:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778624384:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787826301.192200:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.192215:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.192228:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778624384 00000100:00100000:1.0:1787826301.192231:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778624384 00000100:00100000:1.0:1787826301.192256:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3324 00000100:00100000:1.0:1787826301.192263:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778624384:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787826301.192346:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:23845:x1874668778624384:12345-0@lo:1000:mdt00_005.0 Request processed in 82us (144us total) trans 4294968157 rc 0/0 00000100:00100000:1.0:1787826301.192353:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3324 00000100:00100000:1.0:1787826301.192382:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db74000 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778624128:0@lo:1000:mdt00_008.0 00000001:00080000:1.0:1787826301.192460:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016426 00000100:00100000:1.0:1787826301.192493:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb23480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778624512:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1787826301.192517:0:45682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.192531:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.192543:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778624512 00000100:00100000:1.0:1787826301.192546:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778624512 00000100:00100000:1.0:1787826301.192570:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3325 00000100:00100000:1.0:1787826301.192576:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778624512:12345-0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1787826301.192646:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:45682:x1874668778624512:12345-0@lo:1000:mdt00_008.0 Request processed in 69us (127us total) trans 4294968158 rc 0/0 00000100:00100000:1.0:1787826301.192656:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3325 00000100:00100000:1.0:1787826301.192688:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778624384:0@lo:1000:mdt00_005.0 00000001:00080000:1.0:1787826301.192736:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016430 00010000:00010000:1.0:1787826301.192759:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192771:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192779:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192786:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.192792:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192801:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192816:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:1.0:1787826301.192819:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.192824:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192830:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ae94 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192877:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349910c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192885:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349910c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192891:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349910c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192897:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cebe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.192900:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349910c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192907:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349910c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192916:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xec:0x0].0x0 (ffff9bbe0bd66100) 00010000:00010000:1.0:1787826301.192918:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.192921:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349910c lrc: 2/0,0 mode: --/EX res: [0x200000403:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192928:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349910c lrc: 0/0,0 mode: --/EX res: [0x200000403:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192949:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192961:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192970:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192977:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192983:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192990:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.192995:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.192998:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193005:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193012:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xec:0x0].0x0 (ffff9bbe0bd66100) 00010000:00010000:1.0:1787826301.193015:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.193018:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193025:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349aeb0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193033:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xec:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193039:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xec:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193046:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xec:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193051:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.193054:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xec:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193065:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xec:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193072:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xec:0x0].0x0 (ffff9bbe0bd66100) 00010000:00010000:1.0:1787826301.193075:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826301.193078:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 2/0,0 mode: --/PW res: [0x200000403:0xec:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193084:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ae8d lrc: 0/0,0 mode: --/PW res: [0x200000403:0xec:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.193188:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+44:84210:x1874668789754112:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 28736us (32804us total) trans 8590016432 rc 0/0 00000100:00100000:1.0:1787826301.193198:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111318 00000020:00080000:1.0:1787826301.193201:0:23845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826301.193265:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb23480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778624512:0@lo:1000:mdt00_008.0 00000001:00080000:1.0:1787826301.193306:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016431 00010000:00010000:1.0:1787826301.193326:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193333:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193340:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193346:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.193349:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193361:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193370:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:1.0:1787826301.193373:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.193376:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193382:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349aea2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193397:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349911a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193404:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349911a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193425:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349911a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193432:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.193435:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349911a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193441:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349911a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193449:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xee:0x0].0x0 (ffff9bbe0bd66600) 00010000:00010000:1.0:1787826301.193451:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.193455:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349911a lrc: 2/0,0 mode: --/EX res: [0x200000403:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193466:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349911a lrc: 0/0,0 mode: --/EX res: [0x200000403:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193482:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193491:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193498:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193506:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193512:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193518:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193523:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.193525:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193532:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193540:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xee:0x0].0x0 (ffff9bbe0bd66600) 00010000:00010000:1.0:1787826301.193542:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.193545:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193551:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349aeb7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193560:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xee:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193566:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xee:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193573:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xee:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193579:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.193581:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xee:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193587:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xee:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193594:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xee:0x0].0x0 (ffff9bbe0bd66600) 00010000:00010000:1.0:1787826301.193596:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826301.193599:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 2/0,0 mode: --/PW res: [0x200000403:0xee:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.193605:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ae9b lrc: 0/0,0 mode: --/PW res: [0x200000403:0xee:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.193668:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+44:84212:x1874668789754496:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 23088us (23204us total) trans 8590016433 rc 0/0 00000100:00100000:1.0:1787826301.193676:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111319 00000020:00080000:1.0:1787826301.193680:0:45682:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00010000:00010000:3.0:1787826301.194205:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083f9882c/0x68019081f349ae2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd17 expref: 13 pid: 8430 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.194221:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778624000:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826301.194241:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.194253:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.194261:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.194285:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.194307:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.194316:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.194323:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826301.194328:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.194343:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.194358:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.194366:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349aea9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.194494:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789754240:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 22953us (24099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.194503:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6239 00000100:00100000:1.0:1787826301.200594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.200638:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.200716:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789755392 00000100:00100000:0.0:1787826301.200725:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789755392 00000100:00100000:0.0:1787826301.200776:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789755136 00000100:00100000:0.0:1787826301.200780:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789755136 00000100:00100000:0.0:1787826301.200797:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2653 00000100:00100000:0.0:1787826301.200817:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+45:84212:x1874668789755392:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787826301.201078:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x11f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826301.201115:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016434 00010000:00010000:0.0:1787826301.201150:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.201168:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.201181:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.201190:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.201199:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.201205:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.201269:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2654 00000100:00100000:1.0:1787826301.201279:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+47:84210:x1874668789755136:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787826301.201737:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x121:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826301.201754:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016436 00010000:00010000:1.0:1787826301.201780:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.201791:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.201811:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.201820:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.201827:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.201834:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.203406:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1787826301.203581:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84212:x1874668789755392:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 2771us (2990us total) trans 8590016435 rc 0/0 00000100:00100000:0.0:1787826301.203592:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2653 00000020:00080000:0.0:1787826301.203598:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826301.203771:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787826301.203827:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84210:x1874668789755136:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 2548us (3187us total) trans 8590016437 rc 0/0 00000100:00100000:1.0:1787826301.203835:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2654 00000020:00080000:1.0:1787826301.203838:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826301.203969:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826301.203977:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.203989:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826301.203993:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204007:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204025:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:0.0:1787826301.204028:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826301.204034:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 1/0,0 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204040:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aebe lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204053:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826301.204056:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204061:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826301.204064:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204070:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204078:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:0.0:1787826301.204081:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826301.204084:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204089:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349aec5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x121:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204098:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826301.204100:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826301.204102:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826301.206606:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826301.212828:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.212934:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789755648 00000100:00100000:3.0:1787826301.212944:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789755648 00000100:00100000:3.0:1787826301.213006:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111320 00000100:00100000:3.0:1787826301.213016:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84211:x1874668789755648:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.213099:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 3/0,1 mode: --/PW res: [0x200000403:0xed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.213116:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xed:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.213128:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xed:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.213273:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.213286:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd3a expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.213308:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.213343:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd3a expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.213358:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd3a expref: 49 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.213374:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778624640:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826301.213459:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.227549:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.227582:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789755776 00000100:00100000:2.0:1787826301.227590:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789755776 00010000:00010000:2.0:1787826301.227629:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd3a expref: 50 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.227663:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3015 00000100:00100000:2.0:1787826301.227673:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2402:x1874668789755776:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826301.227686:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.227692:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd3a expref: 50 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.227706:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd3a expref: 50 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.227728:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:2.0:1787826301.227734:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.227743:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.227750:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.227769:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826301.227824:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2402:x1874668789755776:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 152us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.227832:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3015 00010000:00010000:3.0:1787826301.228197:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349ae63 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd3a expref: 49 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.228215:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778624640:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826301.228236:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.228246:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.228252:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826301.228364:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016438 00000001:00080000:3.0:1787826301.228483:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016439 00000001:00080000:3.0:1787826301.228521:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016440 00000100:00100000:3.0:1787826301.228594:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778624768:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1787826301.228639:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.228676:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.229741:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778624768 00000100:00100000:2.0:1787826301.229751:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778624768 00000100:00100000:2.0:1787826301.229826:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326 00000100:00100000:2.0:1787826301.229836:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe100383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45683:x1874668778624768:12345-0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1787826301.229962:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe100383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45683:x1874668778624768:12345-0@lo:1000:mdt00_009.0 Request processed in 127us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.229970:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326 00000100:00100000:2.0:1787826301.230010:0:45683:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968170 gen 2 00000004:00080000:2.0:1787826301.230016:0:45683:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968170 committed transno 4294968170 00000100:00100000:2.0:1787826301.230034:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778624768:0@lo:1000:mdt00_009.0 00000001:00080000:2.0:1787826301.230153:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016441 00000100:00100000:2.0:1787826301.230208:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778624896:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1787826301.230241:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826301.230265:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787826301.230453:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826301.230520:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778624896 00000100:00100000:1.0:1787826301.230526:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778624896 00000100:00100000:1.0:1787826301.230554:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3327 00000100:00100000:1.0:1787826301.230561:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:45683:x1874668778624896:12345-0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1787826301.230707:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45683:x1874668778624896:12345-0@lo:1000:mdt00_009.0 Request processed in 145us (464us total) trans 4294968173 rc 0/0 00000100:00100000:1.0:1787826301.230715:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3327 00000040:00080000:2.0:1787826301.235341:0:54902:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826301.235350:0:54902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787826301.237737:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a107480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778624896:0@lo:1000:mdt00_009.0 00000001:00080000:0.0:1787826301.238072:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016442 00010000:00010000:0.0:1787826301.238122:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238133:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238140:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238147:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.238151:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238160:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238176:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:0.0:1787826301.238179:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.238183:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238190:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349aed3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238220:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f3499113 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238228:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f3499113 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238239:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f3499113 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238245:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.238248:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f3499113 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238254:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f3499113 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238262:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xed:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:0.0:1787826301.238265:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.238268:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f3499113 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238274:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f3499113 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238308:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 3/0,1 mode: --/EX res: [0x200000403:0xed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238321:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238331:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238339:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238346:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238352:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238358:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.238361:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238367:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238374:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xed:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:0.0:1787826301.238377:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.238380:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 2/0,0 mode: --/EX res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238386:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349aeda lrc: 0/0,0 mode: --/EX res: [0x200000403:0xed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238396:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xed:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238402:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xed:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238409:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xed:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238425:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.238429:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xed:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238440:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xed:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238448:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xed:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:0.0:1787826301.238451:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826301.238454:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 2/0,0 mode: --/PW res: [0x200000403:0xed:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.238459:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349aecc lrc: 0/0,0 mode: --/PW res: [0x200000403:0xed:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.238604:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84211:x1874668789755648:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 25587us (25783us total) trans 8590016443 rc 0/0 00000100:00100000:0.0:1787826301.238615:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111320 00000020:00080000:0.0:1787826301.238621:0:45683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1787826301.238837:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826301.238842:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826301.238989:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9688 count 103 00000040:00080000:3.0:1787826301.238996:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826301.239114:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778625024:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826301.239167:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2300 going to sleep for 11 seconds 00000040:00080000:2.0:1787826301.242170:0:54902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826301.242183:0:54902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:2.0:1787826301.242293:0:54902:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826301.242359:0:54902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826301.242639:0:54902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826301.242645:0:54902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:2.0:1787826301.242710:0:54902:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826301.242713:0:54902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826301.243509:0:54902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826301.243516:0:54902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:2.0:1787826301.243599:0:54902:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826301.243602:0:54902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826301.244498:0:54902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826301.244507:0:54902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1787826301.247590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.247627:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.247648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.247680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.247723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789756160 00000100:00100000:0.0:1787826301.247732:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789756160 00000100:00100000:0.0:1787826301.247777:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789756288 00000100:00100000:0.0:1787826301.247781:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789756288 00000100:00100000:0.0:1787826301.247825:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789756416 00000100:00100000:0.0:1787826301.247828:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789756416 00000100:00100000:0.0:1787826301.247871:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111321 00000100:00100000:0.0:1787826301.247882:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84215:x1874668789756160:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826301.247916:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf1:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826301.248036:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84215:x1874668789756160:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 156us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.248044:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111321 00000100:00100000:0.0:1787826301.248062:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111322 00000100:00100000:0.0:1787826301.248069:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84214:x1874668789756288:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826301.248084:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf0:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826301.248126:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84214:x1874668789756288:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 57us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.248133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111322 00000100:00100000:0.0:1787826301.248147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111323 00000100:00100000:0.0:1787826301.248153:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84213:x1874668789756416:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826301.248163:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xef:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826301.248202:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84213:x1874668789756416:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 49us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.248208:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111323 00000100:00100000:2.0:1787826301.248347:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789756032 00000100:00100000:2.0:1787826301.248353:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789756032 00000100:00100000:2.0:1787826301.248389:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2655 00000100:00100000:2.0:1787826301.248396:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84211:x1874668789756032:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826301.248612:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x120:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826301.248644:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016444 00010000:00010000:2.0:1787826301.248676:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248692:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248703:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248711:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248721:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248727:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248744:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826301.248795:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84211:x1874668789756032:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 399us (1211us total) trans 8590016445 rc 0/0 00000100:00100000:2.0:1787826301.248803:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2655 00000020:00080000:2.0:1787826301.248806:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787826301.248828:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826301.248834:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248841:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826301.248844:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248873:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248885:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:2.0:1787826301.248888:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826301.248892:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248898:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349aee1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x120:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.248914:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826301.248916:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826301.248918:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826301.251318:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778625024:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787826301.253657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.253697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.253761:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789756544 00000100:00100000:3.0:1787826301.253770:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789756544 00000100:00100000:3.0:1787826301.253830:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789756672 00000100:00100000:3.0:1787826301.253834:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789756672 00000100:00100000:3.0:1787826301.253883:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111324 00000100:00100000:3.0:1787826301.253892:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84215:x1874668789756544:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.253962:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.253980:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.253990:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254006:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254012:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254018:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254045:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254054:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254061:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826301.254103:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf1:0x0]: returning size 158 00000004:00200000:3.0:1787826301.254107:0:45682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826301.254119:0:45682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254130:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254136:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254143:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254152:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.254157:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254164:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254176:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826301.254179:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.254184:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254189:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349aee8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254200:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254206:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254211:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254216:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.254218:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254225:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254236:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77ba5676 (ffff9bbe08124b00) 00010000:00010000:3.0:1787826301.254238:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.254240:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254245:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349aeef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77ba5676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254256:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254262:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254267:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254272:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.254275:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254282:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254304:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf1:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:3.0:1787826301.254307:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.254310:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254317:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349aef6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.254386:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84215:x1874668789756544:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 494us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.254394:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111324 00000100:00100000:3.0:1787826301.254423:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111325 00000100:00100000:3.0:1787826301.254431:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84214:x1874668789756672:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.254456:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254465:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254473:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254485:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254492:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254499:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254515:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254523:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254530:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826301.254551:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf0:0x0]: returning size 158 00000004:00200000:3.0:1787826301.254554:0:45682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826301.254560:0:45682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254570:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254576:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254583:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254588:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.254591:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254598:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254606:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826301.254609:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.254612:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254618:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349aefd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254627:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254638:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254644:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254649:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.254653:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254659:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254667:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4c9792c0 (ffff9bbe08124700) 00010000:00010000:3.0:1787826301.254670:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.254673:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254678:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349af04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c9792c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254688:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254694:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254700:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254705:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.254708:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254715:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254722:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf0:0x0].0x0 (ffff9bbe0bd66c00) 00010000:00010000:3.0:1787826301.254725:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.254728:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.254735:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349af0b lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.254768:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84214:x1874668789756672:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 337us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.254776:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111325 00000100:00100000:1.0:1787826301.259282:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.259419:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789756800 00000100:00100000:0.0:1787826301.259429:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789756800 00000100:00100000:0.0:1787826301.259493:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111326 00000100:00100000:0.0:1787826301.259503:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84213:x1874668789756800:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.259578:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259595:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259607:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259622:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259630:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259637:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259663:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259672:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259678:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.259721:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xef:0x0]: returning size 158 00000004:00200000:0.0:1787826301.259725:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826301.259738:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259751:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259758:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259769:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259777:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259784:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.259788:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.259797:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260003:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826301.260007:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.260012:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260019:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349af12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260033:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260040:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260046:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260052:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.260056:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260062:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260069:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2f6e9179 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826301.260072:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.260075:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260081:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349af19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2f6e9179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260095:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260102:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260109:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260114:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.260118:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260124:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260132:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xef:0x0].0x0 (ffff9bbe0bd66f00) 00010000:00010000:0.0:1787826301.260134:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.260138:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.260144:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349af20 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.260258:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84213:x1874668789756800:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 755us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.260267:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111326 00000100:00100000:3.0:1787826301.262230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.262311:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789757056 00000100:00100000:0.0:1787826301.262321:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789757056 00000100:00100000:0.0:1787826301.262377:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111327 00000100:00100000:0.0:1787826301.262387:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84215:x1874668789757056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.262406:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.262438:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349af27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262535:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262549:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262560:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.262571:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf1:0x0]: returning size 158 00010000:00010000:0.0:1787826301.262643:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262651:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262658:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262664:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.262668:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262675:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262686:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf1:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:0.0:1787826301.262689:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826301.262692:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262699:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349af2e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262736:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349af27 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd41 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262746:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826301.262749:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826301.262753:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349af27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd41 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.262761:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3a00, rc 0) 00000100:00100000:0.0:1787826301.262822:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84215:x1874668789757056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 436us (600us total) trans 8590016446 rc 301/301 00000100:00100000:0.0:1787826301.262832:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111327 00000100:00100000:3.0:1787826301.263447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.263507:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789757312 00000100:00100000:2.0:1787826301.263513:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789757312 00000100:00100000:2.0:1787826301.263559:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111328 00000100:00100000:2.0:1787826301.263567:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84214:x1874668789757312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.263580:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.263593:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd48 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263660:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263671:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263679:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.263687:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf0:0x0]: returning size 158 00010000:00010000:2.0:1787826301.263735:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263742:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263749:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263758:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.263761:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263767:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263775:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf0:0x0].0x0 (ffff9bbe0bd66c00) 00010000:00010000:2.0:1787826301.263778:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826301.263781:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263786:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af43 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263810:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af3c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd48 expref: 58 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263818:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826301.263820:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826301.263823:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd48 expref: 58 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.263830:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826301.263889:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84214:x1874668789757312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 323us (444us total) trans 8590016447 rc 301/301 00000100:00100000:2.0:1787826301.263895:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111328 00000100:00100000:0.0:1787826301.270304:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.270345:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.270369:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.270396:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789757568 00000100:00100000:0.0:1787826301.270404:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789757568 00000100:00100000:0.0:1787826301.270467:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789757696 00000100:00100000:0.0:1787826301.270471:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789757696 00000100:00100000:0.0:1787826301.270488:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789757824 00000100:00100000:0.0:1787826301.270491:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789757824 00000100:00100000:0.0:1787826301.270512:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111329 00000100:00100000:0.0:1787826301.270522:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84213:x1874668789757568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.270545:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.270566:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349af51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd4f expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270674:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270688:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270699:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.270710:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xef:0x0]: returning size 158 00010000:00010000:0.0:1787826301.270785:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270792:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270799:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270805:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.270809:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270816:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270828:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xef:0x0].0x0 (ffff9bbe0bd66f00) 00010000:00010000:0.0:1787826301.270831:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826301.270836:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270843:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349af58 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270908:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349af51 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd4f expref: 61 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270919:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826301.270921:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826301.270926:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349af51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd4f expref: 61 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.270936:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:0.0:1787826301.270991:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84213:x1874668789757568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 470us (703us total) trans 8590016448 rc 301/301 00000100:00100000:0.0:1787826301.271003:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111329 00000100:00100000:0.0:1787826301.271023:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111330 00000100:00100000:0.0:1787826301.271030:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84214:x1874668789757696:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826301.271048:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf0:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826301.271108:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84214:x1874668789757696:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 78us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.271114:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111330 00000100:00100000:0.0:1787826301.271128:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111331 00000100:00100000:0.0:1787826301.271134:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84215:x1874668789757824:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826301.271152:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf1:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826301.271190:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84215:x1874668789757824:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 56us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.271196:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111331 00000100:00100000:0.0:1787826301.290307:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.290341:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.290469:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789758208 00000100:00100000:1.0:1787826301.290480:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789758208 00000100:00100000:1.0:1787826301.290533:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789757952 00000100:00100000:1.0:1787826301.290536:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789757952 00000100:00100000:1.0:1787826301.290557:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111332 00000100:00100000:1.0:1787826301.290566:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84214:x1874668789758208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.290589:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.290609:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349af66 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd56 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291082:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349af6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291098:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349af6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291110:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349af6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826301.291121:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x122:0x0]: returning size 0 00010000:00010000:1.0:1787826301.291167:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349af66 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd56 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291184:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349af6d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd56 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291192:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:1.0:1787826301.291195:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826301.291198:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826301.291259:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84214:x1874668789758208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 693us (972us total) trans 8590016449 rc 0/0 00000100:00100000:1.0:1787826301.291266:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111332 00000100:00100000:1.0:1787826301.291287:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111333 00000100:00100000:1.0:1787826301.291307:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84213:x1874668789757952:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826301.291325:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xef:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826301.291380:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84213:x1874668789757952:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 75us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.291388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111333 00000100:00100000:0.0:1787826301.305542:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.305616:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789758464 00000100:00100000:2.0:1787826301.305626:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789758464 00000100:00100000:2.0:1787826301.305682:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111334 00000100:00100000:2.0:1787826301.305692:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84214:x1874668789758464:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.305747:0:7736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.305773:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349af6d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x122:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd56 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305790:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:2.0:1787826301.305801:0:7736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826301.305822:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305835:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305845:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305898:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305907:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305915:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305962:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305971:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305978:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305986:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.305992:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.305997:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306004:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306013:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826301.306016:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.306020:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306026:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349af7b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306036:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306041:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306046:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306051:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.306054:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306059:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306066:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x257f0039 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826301.306069:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.306072:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.306078:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349af82 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x257f0039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.306161:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84214:x1874668789758464:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 470us (630us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826301.306168:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111334 00000100:00100000:1.0:1787826301.309241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.309355:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789758592 00000100:00100000:2.0:1787826301.309365:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789758592 00000100:00100000:2.0:1787826301.309433:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111335 00000100:00100000:2.0:1787826301.309443:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84214:x1874668789758592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.309467:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.309492:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349af89 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd5d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.309526:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.309540:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.309557:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.309665:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349af89 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd5d expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.309680:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd5d expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.309688:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826301.309691:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826301.309694:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826301.309758:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84214:x1874668789758592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 316us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.309765:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111335 00000100:00100000:3.0:1787826301.310533:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.310601:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789758848 00000100:00100000:1.0:1787826301.310607:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789758848 00000100:00100000:1.0:1787826301.310650:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111336 00000100:00100000:1.0:1787826301.310659:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84215:x1874668789758848:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.310673:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.310688:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349af97 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd64 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.311123:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349af9e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.311134:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349af9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.311144:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349af9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826301.311153:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x123:0x0]: returning size 0 00010000:00010000:1.0:1787826301.311196:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349af97 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd64 expref: 63 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.311210:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349af9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd64 expref: 62 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.311218:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:1.0:1787826301.311221:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826301.311224:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:1.0:1787826301.311263:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84215:x1874668789758848:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 605us (733us total) trans 8590016450 rc 0/0 00000100:00100000:1.0:1787826301.311269:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111336 00000100:00100000:0.0:1787826301.331164:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.331215:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.331275:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789759104 00000100:00100000:2.0:1787826301.331285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789759104 00000100:00100000:2.0:1787826301.331344:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789759360 00000100:00100000:2.0:1787826301.331348:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789759360 00000100:00100000:2.0:1787826301.331368:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111337 00000100:00100000:2.0:1787826301.331378:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84213:x1874668789759104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.331398:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.331429:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afac lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.331905:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349afb3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.331925:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349afb3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.331936:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349afb3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.331946:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x124:0x0]: returning size 0 00010000:00010000:2.0:1787826301.331990:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afac lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd6b expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.332008:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349afb3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd6b expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.332017:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826301.332020:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826301.332024:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826301.332082:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84213:x1874668789759104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 705us (928us total) trans 8590016451 rc 0/0 00000100:00100000:2.0:1787826301.332090:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111337 00000100:00100000:2.0:1787826301.332112:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111338 00000100:00100000:2.0:1787826301.332120:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84214:x1874668789759360:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.332163:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.332174:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.332182:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826301.332259:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb04c3bc reply state 00000000b4fa84ae transno 8590016452 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.332272:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.332279:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826301.332281:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826301.332284:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826301.332324:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84214:x1874668789759360:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 204us (1109us total) trans 8590016452 rc 0/0 00000100:00100000:2.0:1787826301.332331:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111338 00000100:00100000:3.0:1787826301.334331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.334368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.334529:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789759488 00000100:00100000:2.0:1787826301.334538:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789759488 00000100:00100000:2.0:1787826301.334579:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789759744 00000100:00100000:2.0:1787826301.334582:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789759744 00000100:00100000:2.0:1787826301.334601:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111339 00000100:00100000:2.0:1787826301.334609:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84214:x1874668789759488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.334628:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.334646:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd72 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.334696:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd72 expref: 68 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.334710:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd72 expref: 68 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.334723:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826301.334727:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826301.334730:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826301.334775:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84214:x1874668789759488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 166us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.334781:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111339 00000100:00100000:2.0:1787826301.334800:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111340 00000100:00100000:2.0:1787826301.334807:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84215:x1874668789759744:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.334843:0:7736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.334888:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349af9e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd64 expref: 67 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.334903:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:2.0:1787826301.334912:0:7736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826301.334927:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.334936:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.334944:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.334957:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.334963:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.334970:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335007:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335014:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335021:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335028:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335034:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.335038:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335045:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335053:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826301.335056:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.335060:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335065:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afcf lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335076:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335082:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335088:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335093:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.335096:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335101:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335108:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xe480a11f (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826301.335111:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.335113:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.335119:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afd6 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xe480a11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.335158:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84215:x1874668789759744:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 351us (789us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826301.335166:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111340 00000100:00100000:2.0:1787826301.351637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.351675:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.351713:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.351744:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789759872 00000100:00100000:2.0:1787826301.351753:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789759872 00000100:00100000:2.0:1787826301.351794:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789760256 00000100:00100000:2.0:1787826301.351798:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789760256 00000100:00100000:2.0:1787826301.351821:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111341 00000100:00100000:2.0:1787826301.351830:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84215:x1874668789759872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.351864:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.351886:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afdd lrc: 2/0,0 mode: --/PR res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd79 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.351921:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.351935:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.351947:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352051:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349afdd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd79 expref: 69 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352066:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd79 expref: 68 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352074:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826301.352077:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826301.352081:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:2.0:1787826301.352142:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84215:x1874668789759872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 313us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.352149:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111341 00000100:00100000:2.0:1787826301.352167:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111342 00000100:00100000:2.0:1787826301.352174:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84213:x1874668789760256:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.352202:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.352217:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349afb3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd6b expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352228:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826301.352235:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826301.352249:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352258:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352265:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352276:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352284:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352291:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352327:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352335:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352347:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352354:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352361:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.352365:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352373:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352382:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826301.352384:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.352388:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352395:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349afeb lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352405:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352423:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352430:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352436:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.352439:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352446:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352453:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xa9b41b8f (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826301.352455:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.352458:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.352464:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349aff2 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa9b41b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.352510:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84213:x1874668789760256:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 336us (796us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826301.352518:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111342 00000100:00100000:1.0:1787826301.352603:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789760000 00000100:00100000:1.0:1787826301.352608:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789760000 00000100:00100000:1.0:1787826301.352645:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2656 00000100:00100000:1.0:1787826301.352654:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84214:x1874668789760000:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.352705:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84214:x1874668789760000:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 52us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.352713:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2656 00000100:00100000:2.0:1787826301.357882:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.357949:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789760640 00000100:00100000:0.0:1787826301.357958:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789760640 00000100:00100000:0.0:1787826301.358014:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2657 00000100:00100000:0.0:1787826301.358024:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84214:x1874668789760640:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.358236:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84214:x1874668789760640:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 212us (391us total) trans 8590016453 rc 0/0 00000100:00100000:0.0:1787826301.358248:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2657 00000100:00100000:2.0:1787826301.376536:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.376570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.376598:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789760768 00000100:00100000:2.0:1787826301.376606:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789760768 00000100:00100000:2.0:1787826301.376649:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789760896 00000100:00100000:2.0:1787826301.376653:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789760896 00000100:00100000:2.0:1787826301.376671:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111343 00000100:00100000:2.0:1787826301.376681:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84215:x1874668789760768:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.376761:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.376777:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.376789:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826301.376940:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000376e072c reply state 00000000c0d51b73 transno 8590016454 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.376953:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.376959:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826301.376962:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826301.376966:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826301.377056:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84215:x1874668789760768:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 376us (528us total) trans 8590016454 rc 0/0 00000100:00100000:2.0:1787826301.377064:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111343 00000100:00100000:2.0:1787826301.377084:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111344 00000100:00100000:2.0:1787826301.377092:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84213:x1874668789760896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.377101:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.377114:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b000 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd80 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.377137:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.377145:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.377152:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.377219:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b000 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd80 expref: 71 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.377236:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd80 expref: 70 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.377243:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:2.0:1787826301.377246:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826301.377249:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3800, rc 0) 00000100:00100000:2.0:1787826301.377279:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84213:x1874668789760896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 187us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.377286:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111344 00000100:00100000:1.0:1787826301.388019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.388057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.388081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.388109:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789761152 00000100:00100000:1.0:1787826301.388118:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789761152 00000100:00100000:1.0:1787826301.388163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789761408 00000100:00100000:1.0:1787826301.388166:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789761408 00000100:00100000:1.0:1787826301.388182:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789761536 00000100:00100000:1.0:1787826301.388185:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789761536 00000100:00100000:1.0:1787826301.388206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111345 00000100:00100000:1.0:1787826301.388214:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84214:x1874668789761152:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.388314:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84214:x1874668789761152:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 100us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.388322:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111345 00000100:00100000:1.0:1787826301.388340:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111346 00000100:00100000:1.0:1787826301.388347:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84213:x1874668789761408:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.388405:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.388433:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.388443:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826301.388578:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bba24ab reply state 0000000010271c10 transno 8590016455 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.388591:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.388598:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:1.0:1787826301.388602:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826301.388605:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826301.388662:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84213:x1874668789761408:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 314us (604us total) trans 8590016455 rc 0/0 00000100:00100000:1.0:1787826301.388669:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111346 00000100:00100000:1.0:1787826301.388684:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111347 00000100:00100000:1.0:1787826301.388691:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84215:x1874668789761536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.388701:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.388712:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd87 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.388744:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd87 expref: 73 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.388755:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd87 expref: 73 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.388763:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826301.388765:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.388768:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:1.0:1787826301.388789:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84215:x1874668789761536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 99us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.388799:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111347 00000100:00100000:3.0:1787826301.397701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.397737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.397760:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.397843:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789761792 00000100:00100000:2.0:1787826301.397876:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789761792 00000100:00100000:2.0:1787826301.397925:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789762048 00000100:00100000:2.0:1787826301.397928:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789762048 00000100:00100000:2.0:1787826301.397951:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111348 00000100:00100000:2.0:1787826301.397960:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84214:x1874668789761792:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.397980:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.397999:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b01c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd8e expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.398103:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.398119:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd72 expref: 75 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.398133:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.398164:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd72 expref: 75 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.398179:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd72 expref: 75 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.398192:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778625152:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826301.398274:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.398293:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111349 00000100:00100000:2.0:1787826301.398301:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84213:x1874668789762048:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.398311:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.398320:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd95 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.398352:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd95 expref: 76 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.398367:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd95 expref: 76 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.398377:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:2.0:1787826301.398380:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826301.398384:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2e00, rc 0) 00000100:00100000:2.0:1787826301.398425:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84213:x1874668789762048:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 125us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.398433:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111349 00000100:00100000:1.0:1787826301.398656:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789761920 00000100:00100000:1.0:1787826301.398662:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789761920 00000100:00100000:1.0:1787826301.398702:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2658 00000100:00100000:1.0:1787826301.398709:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84215:x1874668789761920:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.398767:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84215:x1874668789761920:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 58us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.398774:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2658 00000100:00100000:3.0:1787826301.404229:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.404319:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.404895:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.407525:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789762304 00000100:00100000:2.0:1787826301.407540:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789762304 00000100:00100000:2.0:1787826301.407587:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789762432 00000100:00100000:2.0:1787826301.407591:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789762432 00000100:00100000:2.0:1787826301.407609:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2659 00000100:00100000:2.0:1787826301.407618:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84215:x1874668789762304:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.410520:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2660 00000100:00100000:1.0:1787826301.410538:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84213:x1874668789762432:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.411981:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778625152:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.412008:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.412263:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84215:x1874668789762304:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 4643us (8039us total) trans 8590016456 rc 0/0 00000100:00100000:2.0:1787826301.412274:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2659 00000100:00100000:2.0:1787826301.412326:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789762560 00000100:00100000:2.0:1787826301.412332:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789762560 00010000:00010000:2.0:1787826301.412363:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd72 expref: 78 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.412400:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3016 00000100:00100000:2.0:1787826301.412418:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:2401:x1874668789762560:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826301.412433:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.412440:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd72 expref: 78 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.412453:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd72 expref: 78 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.412481:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349afc8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd72 expref: 78 pid: 7736 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.412496:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826301.412500:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.412511:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.412519:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.412540:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826301.412625:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84213:x1874668789762432:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 2092us (8305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.412634:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2660 00010000:00010000:0.0:1787826301.412748:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.412756:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.412774:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x122:0x0]: returning size 0 00000004:00080000:0.0:1787826301.412962:0:45682:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc0:0x0], index 0: 0 00010000:00010000:0.0:1787826301.413064:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.413072:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.413080:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.413086:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.413090:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.413098:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.413109:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:0.0:1787826301.413113:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.413117:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.413124:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b023 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.413173:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b01c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd8e expref: 77 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.413184:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826301.413186:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826301.413190:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b01c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd8e expref: 77 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.413201:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:0.0:1787826301.413229:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84214:x1874668789761792:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 15271us (15491us total) trans 8590016457 rc 301/301 00000100:00100000:0.0:1787826301.413237:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111348 00000100:00100000:2.0:1787826301.414122:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:2401:x1874668789762560:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1711us (9224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.414133:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3016 00000100:00100000:3.0:1787826301.415733:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.415800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.415832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.415896:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789763072 00000100:00100000:0.0:1787826301.415905:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789763072 00000100:00100000:0.0:1787826301.415947:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789763328 00000100:00100000:0.0:1787826301.415950:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789763328 00000100:00100000:0.0:1787826301.415966:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2661 00000100:00100000:0.0:1787826301.415975:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe100392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84213:x1874668789763072:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.416280:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789762816 00000100:00100000:2.0:1787826301.416285:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789762816 00000100:00100000:2.0:1787826301.416327:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111350 00000100:00100000:2.0:1787826301.416334:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84215:x1874668789762816:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.416517:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe100392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84213:x1874668789763072:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 541us (715us total) trans 8590016458 rc 0/0 00000100:00100000:0.0:1787826301.416524:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2661 00000100:00100000:0.0:1787826301.416544:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2662 00000100:00100000:0.0:1787826301.416550:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84214:x1874668789763328:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.417212:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84215:x1874668789762816:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 876us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.417221:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111350 00000100:00100000:0.0:1787826301.417634:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84214:x1874668789763328:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1082us (1800us total) trans 8590016459 rc 0/0 00000100:00100000:0.0:1787826301.417644:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2662 00000100:00100000:3.0:1787826301.421090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.421130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.421162:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.421441:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789763584 00000100:00100000:2.0:1787826301.421450:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789763584 00000100:00100000:2.0:1787826301.421504:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789763712 00000100:00100000:2.0:1787826301.421508:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789763712 00000100:00100000:2.0:1787826301.421527:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789763968 00000100:00100000:2.0:1787826301.421530:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789763968 00000100:00100000:2.0:1787826301.421548:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111351 00000100:00100000:2.0:1787826301.421557:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84214:x1874668789763584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.421576:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.421596:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b038 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbda3 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.421656:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b03f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.421671:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b03f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.421684:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b03f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.421736:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x122:0x0]: returning size 0 00000004:00200000:2.0:1787826301.421741:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826301.421758:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b03f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.421782:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b038 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbda3 expref: 81 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.421790:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111352 00000100:00100000:3.0:1787826301.421799:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84215:x1874668789763712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.421801:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b03f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbda3 expref: 80 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.421810:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:2.0:1787826301.421813:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826301.421816:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00010000:00010000:3.0:1787826301.421884:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.421894:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b046 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbd9c expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.421897:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84214:x1874668789763584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 341us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.421904:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111351 00000100:00100000:2.0:1787826301.421921:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111353 00000100:00100000:2.0:1787826301.421927:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84213:x1874668789763968:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.421955:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.421968:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84213:x1874668789763968:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 41us (805us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826301.421968:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd87 expref: 80 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.421975:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111353 00010000:00010000:3.0:1787826301.421977:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.422007:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd87 expref: 79 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.422087:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd87 expref: 79 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.422102:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778625280:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826301.422150:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.426075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.426134:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789764096 00000100:00100000:0.0:1787826301.426143:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789764096 00010000:00010000:0.0:1787826301.426182:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd87 expref: 80 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.426224:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3017 00000100:00100000:0.0:1787826301.426234:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40513850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2399:x1874668789764096:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826301.426252:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.426259:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd87 expref: 80 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.426273:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd87 expref: 80 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.426298:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:0.0:1787826301.426303:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.426312:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.426319:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.426341:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826301.426401:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40513850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2399:x1874668789764096:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 167us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.426417:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3017 00010000:00010000:2.0:1787826301.426705:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b015 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd87 expref: 79 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.426721:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778625280:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826301.426741:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.426750:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.426756:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.426773:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x123:0x0]: returning size 0 00000004:00080000:2.0:1787826301.426954:0:45683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc1:0x0], index 1: 0 00010000:00010000:2.0:1787826301.427052:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.427064:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.427072:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.427078:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.427082:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.427088:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.427100:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826301.427103:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826301.427107:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.427112:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b04d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.427158:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b046 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd9c expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.427168:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826301.427171:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826301.427174:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b046 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd9c expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.427183:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:2.0:1787826301.427227:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84215:x1874668789763712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5430us (6095us total) trans 8590016460 rc 301/301 00000100:00100000:2.0:1787826301.427235:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111352 00000100:00100000:1.0:1787826301.429361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.430321:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789764352 00000100:00100000:3.0:1787826301.430331:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789764352 00000100:00100000:3.0:1787826301.430386:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111354 00000100:00100000:3.0:1787826301.430396:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84213:x1874668789764352:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.430428:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.430448:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b05b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdaa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.430550:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.430566:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd95 expref: 79 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.430576:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.430608:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd95 expref: 79 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.430622:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd95 expref: 79 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.430636:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778625408:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826301.430729:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.432085:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.438505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.438542:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778625408:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826301.438570:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.438629:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789764736 00000100:00100000:0.0:1787826301.438636:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789764736 00000100:00100000:0.0:1787826301.438698:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6240 00000100:00100000:0.0:1787826301.438707:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789764736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.438724:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.438743:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdb1 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826301.438768:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826301.438785:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=2939s v=(0 0) 00010000:00010000:0.0:1787826301.438790:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.438799:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb1 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.438816:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb1 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.438828:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3a00, rc 0) 00000100:00100000:0.0:1787826301.438916:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789764736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 209us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.438923:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6240 00000100:00100000:3.0:1787826301.440609:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.440666:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789764864 00000100:00100000:2.0:1787826301.440674:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789764864 00010000:00010000:2.0:1787826301.440716:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd95 expref: 80 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.440760:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3018 00000100:00100000:2.0:1787826301.440769:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789764864:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826301.440784:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.440791:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd95 expref: 80 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.440803:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd95 expref: 80 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.440827:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b02a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd95 expref: 80 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.440845:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:2.0:1787826301.440955:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.440972:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.440980:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.441005:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826301.441092:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2401:x1874668789764864:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 324us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.441101:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3018 00010000:00010000:3.0:1787826301.441162:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441172:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826301.441190:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x124:0x0]: returning size 0 00000004:00080000:3.0:1787826301.441342:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc1:0x0], index 0: 0 00010000:00010000:3.0:1787826301.441458:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441467:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441474:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441491:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.441495:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441503:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441513:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:3.0:1787826301.441516:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826301.441521:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441527:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b062 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441576:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b05b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdaa expref: 79 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441591:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826301.441593:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826301.441597:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b05b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdaa expref: 79 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.441607:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:1.0:1787826301.441920:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789764608 00000100:00100000:1.0:1787826301.441926:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789764608 00000100:00100000:1.0:1787826301.443535:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2663 00000100:00100000:1.0:1787826301.443549:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84215:x1874668789764608:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.443664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.444050:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84213:x1874668789764352:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 13654us (14696us total) trans 8590016461 rc 301/301 00000100:00100000:3.0:1787826301.444059:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111354 00000100:00100000:3.0:1787826301.444080:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789765120 00000100:00100000:3.0:1787826301.444086:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789765120 00000100:00100000:3.0:1787826301.444123:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111355 00000100:00100000:3.0:1787826301.444132:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84214:x1874668789765120:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826301.444180:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84214:x1874668789765120:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 49us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.444187:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111355 00000100:00100000:1.0:1787826301.449135:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84215:x1874668789764608:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 5575us (17041us total) trans 8590016462 rc 0/0 00000100:00100000:1.0:1787826301.449151:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2663 00000100:00100000:0.0:1787826301.453782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.457579:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.457620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.457792:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789765504 00000100:00100000:3.0:1787826301.457801:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789765504 00000100:00100000:3.0:1787826301.457880:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2664 00000100:00100000:3.0:1787826301.457890:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84213:x1874668789765504:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826301.458171:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84213:x1874668789765504:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 281us (600us total) trans 8590016463 rc 0/0 00000100:00100000:3.0:1787826301.458180:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2664 00000100:00100000:3.0:1787826301.458915:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789765632 00000100:00100000:3.0:1787826301.458922:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789765632 00000100:00100000:3.0:1787826301.458963:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6241 00000100:00100000:3.0:1787826301.458971:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84214:x1874668789765632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.458983:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.459001:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdbf expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.459029:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb1 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.459038:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.459042:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.459048:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.459080:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb1 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.459092:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb1 expref: 14 pid: 8605 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.459105:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778625536:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826301.459173:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.464220:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789765248 00000100:00100000:2.0:1787826301.464235:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789765248 00000100:00100000:2.0:1787826301.464303:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111356 00000100:00100000:2.0:1787826301.464314:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84215:x1874668789765248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.464336:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.464356:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b07e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdb8 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.464435:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b085 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.464451:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b085 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.464463:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b085 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.464516:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x123:0x0]: returning size 0 00000004:00200000:2.0:1787826301.464520:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826301.464538:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b085 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.464564:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b07e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb8 expref: 82 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.464578:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b085 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb8 expref: 81 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.464586:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826301.464589:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826301.464593:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826301.467172:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84215:x1874668789765248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2847us (13387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.467185:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111356 00000100:00100000:1.0:1787826301.471057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.471219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.471247:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789765888 00000100:00100000:1.0:1787826301.471256:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789765888 00010000:00010000:1.0:1787826301.471294:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb1 expref: 15 pid: 8605 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.471331:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3019 00000100:00100000:1.0:1787826301.471340:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789765888:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826301.471355:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.471376:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb1 expref: 15 pid: 8605 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.471390:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb1 expref: 15 pid: 8605 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.471423:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.471427:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.471436:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 15 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.471445:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 15 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.471788:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007db86e44/0x68019081f349b069 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb1 expref: 15 pid: 8605 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.471810:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778625536:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826301.471838:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.471872:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826301.471929:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84214:x1874668789765632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 12958us (14308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.471937:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6241 00000100:00100000:3.0:1787826301.471966:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789765760 00000100:00100000:3.0:1787826301.471970:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789765760 00000100:00100000:3.0:1787826301.471999:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111357 00000100:00100000:3.0:1787826301.472005:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84213:x1874668789765760:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.472020:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.472037:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b08c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdc6 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.472103:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b093 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.472116:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b093 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.472127:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b093 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826301.472170:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x124:0x0]: returning size 0 00000004:00200000:3.0:1787826301.472175:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826301.472192:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b093 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.472218:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b08c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdc6 expref: 83 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.472231:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b093 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdc6 expref: 82 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.472239:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:3.0:1787826301.472243:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826301.472246:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:3.0:1787826301.472269:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84213:x1874668789765760:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 264us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.472276:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111357 00010000:00010000:1.0:1787826301.472454:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 13 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.472471:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a114b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778625664:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826301.472600:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.478215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.478289:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789766016 00000100:00100000:3.0:1787826301.478299:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789766016 00000100:00100000:3.0:1787826301.478390:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6242 00000100:00100000:3.0:1787826301.478400:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789766016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.478426:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.478447:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdcd expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826301.478472:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826301.478496:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=2939s v=(0 0) 00010000:00010000:3.0:1787826301.478500:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.478509:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdcd expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.478528:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdcd expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.478541:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826301.478599:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789766016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 200us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.478606:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6242 00000100:00100000:1.0:1787826301.493128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.493201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.493314:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789766144 00000100:00100000:3.0:1787826301.493323:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789766144 00000100:00100000:3.0:1787826301.493383:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6243 00000100:00100000:3.0:1787826301.493393:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789766144:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.493422:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.493444:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdd4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826301.493468:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826301.493489:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=2939s v=(0 0) 00010000:00010000:3.0:1787826301.493493:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.493503:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdd4 expref: 15 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.493521:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdd4 expref: 15 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.493540:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607a00, rc 0) 00000100:00100000:3.0:1787826301.493595:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789766144:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 203us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.493601:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6243 00000100:00100000:2.0:1787826301.493664:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789766528 00000100:00100000:2.0:1787826301.493673:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789766528 00000100:00100000:2.0:1787826301.493712:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111358 00000100:00100000:2.0:1787826301.493720:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84215:x1874668789766528:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.493783:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84215:x1874668789766528:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 64us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.493790:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111358 00000100:00100000:0.0:1787826301.493905:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a114b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778625664:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826301.493929:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826301.493952:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789765888:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 22613us (22733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.493961:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3019 00000100:00100000:1.0:1787826301.497656:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.497746:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789766272 00000100:00100000:0.0:1787826301.497756:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789766272 00002000:00100000:0.0:1787826301.497802:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xc0:0x0] (0->157) req@ffff9bbf41275a40 x1874668789766272/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/0 e 0 to 0 dl 1787826312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826301.497814:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf41275a40 with x1874668789766272 ext(0->157) 00002000:00010000:0.0:1787826301.497819:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf41275a40 00000100:00100000:0.0:1787826301.497880:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1570 00000100:00100000:0.0:1787826301.497890:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789766272:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.499739:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41275a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789766272:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1841us (2082us total) trans 4294968174 rc 0/0 00000100:00100000:0.0:1787826301.499754:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1570 00002000:00100000:0.0:1787826301.499766:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xc0:0x0] (0->157) req@ffff9bbf41275a40 x1874668789766272/t4294968174(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/448 e 0 to 0 dl 1787826312 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826301.499776:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf41275a40 with x1874668789766272 ext(0->157) 00002000:00010000:0.0:1787826301.499782:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf41275a40 00000100:00100000:1.0:1787826301.508382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.508438:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.508567:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789766912 00000100:00100000:2.0:1787826301.508579:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789766912 00000100:00100000:2.0:1787826301.508643:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6244 00000100:00100000:2.0:1787826301.508653:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84215:x1874668789766912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.508671:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.508690:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbddb expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.508723:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdcd expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.508734:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.508738:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.508743:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 12 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.508776:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdcd expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.508790:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdcd expref: 12 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.508804:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778625792:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826301.508912:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.509435:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789766784 00000100:00100000:0.0:1787826301.509442:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789766784 00000100:00100000:0.0:1787826301.509488:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111359 00000100:00100000:0.0:1787826301.509497:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84213:x1874668789766784:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.509584:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84213:x1874668789766784:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 87us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.509592:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111359 00000100:00100000:2.0:1787826301.511116:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778625792:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826301.511149:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 12 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.511168:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2e00, rc 0) 00000100:00100000:2.0:1787826301.511219:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:84215:x1874668789766912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2567us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.511231:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6244 00000100:00100000:2.0:1787826301.522254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.522290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.522499:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789767168 00000100:00100000:3.0:1787826301.522510:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789767168 00000100:00100000:3.0:1787826301.522578:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6245 00000100:00100000:3.0:1787826301.522589:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+16:84213:x1874668789767168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.522608:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.522627:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbde2 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.522660:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdd4 expref: 17 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.522669:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.522673:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.522679:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 17 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.522712:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdd4 expref: 17 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.522726:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdd4 expref: 17 pid: 8430 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.522739:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778625920:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826301.522812:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.523369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.523439:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789767296 00000100:00100000:0.0:1787826301.523445:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789767296 00000100:00100000:0.0:1787826301.523486:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111360 00000100:00100000:0.0:1787826301.523495:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84214:x1874668789767296:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826301.524075:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789767040 00000100:00100000:3.0:1787826301.524082:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789767040 00010000:00010000:3.0:1787826301.524109:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdcd expref: 12 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.524145:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3020 00000100:00100000:3.0:1787826301.524154:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789767040:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.524167:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.524187:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdcd expref: 12 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.524202:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdcd expref: 12 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.524227:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349b09a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdcd expref: 12 pid: 8432 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.524247:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.524252:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.524261:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.524278:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.524320:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.524334:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a2580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778626048:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826301.524425:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e780 going to sleep for 11 seconds 00000001:00080000:1.0:1787826301.527044:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016463 is committed 00000020:00080000:1.0:1787826301.527112:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0f53d300 refcount 2 committed 0 result 0 batchid 4294970885 00000020:00080000:1.0:1787826301.527119:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f53d180 00000020:00080000:1.0:1787826301.527122:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0de29000 00000020:00080000:1.0:1787826301.527154:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbf0f76c900 refcount 2 committed 0 result 0 batchid 4294970884 00000020:00080000:1.0:1787826301.527158:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc7fe00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf0f76cc00 00000020:00080000:1.0:1787826301.527161:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d0fb200 00000020:00080000:1.0:1787826301.527166:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbf01254f00 refcount 2 committed 0 result 0 batchid 4294970883 00000020:00080000:1.0:1787826301.527169:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d0626c0 00000020:00080000:1.0:1787826301.527171:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a0f1e00 00000020:00080000:1.0:1787826301.527187:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970882 batchid updated 00000020:00080000:2.0:1787826301.527247:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970885 committed batchid 4294970882 00000020:00080000:2.0:1787826301.527357:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970882 00000100:00100000:3.0:1787826301.528668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84214:x1874668789767296:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 5162us (5288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.528683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111360 00010000:00010000:0.0:1787826301.529202:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529214:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529221:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529227:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.529232:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529241:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529258:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11f:0x0].0x0 (ffff9bbe0fe8c600) 00010000:00010000:0.0:1787826301.529262:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.529267:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529275:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349ae40 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529311:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529319:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529326:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529331:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.529335:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529341:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529350:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x121:0x0].0x0 (ffff9bbf0f565700) 00010000:00010000:0.0:1787826301.529352:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.529355:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529362:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349ae47 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x121:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529376:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529383:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529390:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529395:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.529398:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529405:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529424:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x120:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:0.0:1787826301.529427:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.529431:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529437:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349ae5c lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x120:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529451:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529457:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529462:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529467:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.529470:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529481:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529489:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:0.0:1787826301.529492:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826301.529495:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529501:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349afc1 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529512:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529519:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529526:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529531:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.529534:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529539:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529547:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:0.0:1787826301.529549:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826301.529552:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529562:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349aff9 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529572:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529579:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529586:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529591:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.529594:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529601:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529609:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:0.0:1787826301.529611:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826301.529614:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.529650:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b00e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.530094:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a2580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778626048:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826301.530116:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.530177:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789767040:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 6024us (7886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.530188:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3020 00000100:00100000:2.0:1787826301.533993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.534027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.534296:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789767552 00000100:00100000:1.0:1787826301.534305:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789767552 00002000:00100000:1.0:1787826301.534352:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc1:0x0] (0->157) req@ffff9bbe0c1f4b40 x1874668789767552/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/0 e 0 to 0 dl 1787826312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826301.534363:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c1f4b40 with x1874668789767552 ext(0->157) 00000100:00100000:3.0:1787826301.534363:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778625920:192.168.203.9@tcp:104: 00002000:00010000:1.0:1787826301.534367:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0c1f4b40 00000100:00100000:1.0:1787826301.534395:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1571 00010000:00010000:3.0:1787826301.534395:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 17 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.534404:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789767552:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.534424:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:3.0:1787826301.534486:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+17:84213:x1874668789767168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 11899us (12242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.534497:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6245 00000100:00100000:0.0:1787826301.534519:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789767424 00000100:00100000:0.0:1787826301.534523:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789767424 00010000:00010000:0.0:1787826301.534545:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdd4 expref: 17 pid: 8430 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.534583:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3021 00000100:00100000:0.0:1787826301.534591:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2399:x1874668789767424:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826301.534601:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.534620:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdd4 expref: 17 pid: 8430 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.534634:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdd4 expref: 17 pid: 8430 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.534656:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349b0a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdd4 expref: 17 pid: 8430 timeout: 3039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.534672:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.534680:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.534689:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 16 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.534700:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 16 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.534734:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 16 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.534747:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778626176:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826301.537640:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.537970:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789767680 00000100:00100000:3.0:1787826301.537980:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789767680 00000100:00100000:0.0:1787826301.538145:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.538379:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6246 00000100:00100000:3.0:1787826301.538390:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789767680:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.539058:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789767552:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 4652us (5027us total) trans 4294968159 rc 0/0 00000100:00100000:1.0:1787826301.539069:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1571 00002000:00100000:1.0:1787826301.539081:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc1:0x0] (0->157) req@ffff9bbe0c1f4b40 x1874668789767552/t4294968159(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/448 e 0 to 0 dl 1787826312 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826301.539091:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c1f4b40 with x1874668789767552 ext(0->157) 00002000:00010000:1.0:1787826301.539096:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0c1f4b40 00000001:00080000:0.0:1787826301.542206:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968174 is committed 00000001:00080000:0.0:1787826301.542224:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968173 is committed 00000100:00100000:1.0:1787826301.542397:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789767680:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 4003us (4760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.542417:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6246 00000100:00100000:1.0:1787826301.553762:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.553795:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.553841:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.553899:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789767808 00000100:00100000:1.0:1787826301.553907:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789767808 00000100:00100000:1.0:1787826301.553955:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789768192 00000100:00100000:1.0:1787826301.553959:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789768192 00000100:00100000:1.0:1787826301.553980:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111361 00000100:00100000:1.0:1787826301.553989:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84215:x1874668789767808:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.554121:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84215:x1874668789767808:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 133us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.554130:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111361 00000100:00100000:1.0:1787826301.554149:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111362 00000100:00100000:1.0:1787826301.554157:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84214:x1874668789768192:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.554195:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.554222:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b03f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x122:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbda3 expref: 31 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.554242:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:1.0:1787826301.554247:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826301.554273:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.554287:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.554297:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826301.554406:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff1df0e5 reply state 00000000d1894a7c transno 8590016464 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.554431:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.554438:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:1.0:1787826301.554441:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826301.554444:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826301.554501:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84214:x1874668789768192:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 344us (659us total) trans 8590016464 rc 0/0 00000100:00100000:1.0:1787826301.554509:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111362 00000100:00100000:0.0:1787826301.554661:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778626176:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826301.554681:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826301.554706:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789767424:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 20116us (20724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.554715:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3021 00000100:00100000:2.0:1787826301.555080:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789767936 00000100:00100000:2.0:1787826301.555086:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789767936 00002000:00100000:2.0:1787826301.555119:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc1:0x0] (0->157) req@ffff9bbf3fafe1c0 x1874668789767936/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/0 e 0 to 0 dl 1787826312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826301.555131:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fafe1c0 with x1874668789767936 ext(0->157) 00002000:00010000:2.0:1787826301.555136:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fafe1c0 00000100:00100000:2.0:1787826301.555163:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1572 00000100:00100000:2.0:1787826301.555171:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789767936:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.556389:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789767936:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1211us (2585us total) trans 4294968175 rc 0/0 00000100:00100000:2.0:1787826301.556403:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1572 00002000:00100000:2.0:1787826301.556424:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc1:0x0] (0->157) req@ffff9bbf3fafe1c0 x1874668789767936/t4294968175(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:657/0 lens 648/448 e 0 to 0 dl 1787826312 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826301.556435:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fafe1c0 with x1874668789767936 ext(0->157) 00002000:00010000:2.0:1787826301.556441:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fafe1c0 00000100:00100000:2.0:1787826301.563824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.563920:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.563991:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789768320 00000100:00100000:0.0:1787826301.564003:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789768320 00000100:00100000:0.0:1787826301.564067:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6247 00000100:00100000:0.0:1787826301.564076:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789768320:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.564188:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789768448 00000100:00100000:1.0:1787826301.564193:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789768448 00000100:00100000:1.0:1787826301.564235:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111363 00000100:00100000:1.0:1787826301.564242:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84214:x1874668789768448:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.564258:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.564278:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbde9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.564341:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde9 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.564356:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde9 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.564373:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:1.0:1787826301.564376:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.564381:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7400, rc 0) 00000100:00100000:1.0:1787826301.564449:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84214:x1874668789768448:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 207us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.564457:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111363 00000100:00100000:1.0:1787826301.566744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.566835:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789768576 00000100:00100000:0.0:1787826301.566845:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789768576 00000100:00100000:0.0:1787826301.566913:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111364 00000100:00100000:0.0:1787826301.566922:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84213:x1874668789768576:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.567044:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84213:x1874668789768576:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.567052:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111364 00000001:00080000:3.0:1787826301.567694:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968159 is committed 00000001:00080000:3.0:1787826301.567708:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968158 is committed 00000100:00100000:0.0:1787826301.567833:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789768320:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 3757us (3912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.567842:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6247 00000100:00100000:1.0:1787826301.573598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.573694:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789768704 00000100:00100000:2.0:1787826301.573704:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789768704 00000100:00100000:2.0:1787826301.573760:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6248 00000100:00100000:2.0:1787826301.573771:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2399:x1874668789768704:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787826301.575135:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968175 is committed 00000100:00100000:1.0:1787826301.579284:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789768704:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 5504us (5686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.579307:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6248 00000100:00100000:1.0:1787826301.582068:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.582112:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.582249:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789769088 00000100:00100000:3.0:1787826301.582260:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789769088 00000100:00100000:3.0:1787826301.582332:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6249 00000100:00100000:3.0:1787826301.582343:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789769088:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826301.582523:0:45681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc0:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826301.582527:0:45681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc0:0x0] updating lvb mtime from disk: 0 -> 1787826220 00002000:00010000:3.0:1787826301.582529:0:45681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc0:0x0] updating lvb atime from disk: 0 -> 1787826220 00002000:00010000:3.0:1787826301.582532:0:45681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc0:0x0] updating lvb ctime from disk: 0 -> 1787826220 00002000:00010000:3.0:1787826301.582534:0:45681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc0:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826301.582596:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789769088:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 255us (482us total) trans 4294968176 rc 0/0 00000100:00100000:2.0:1787826301.582601:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789768960 00000100:00100000:3.0:1787826301.582604:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6249 00000100:00100000:2.0:1787826301.582605:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789768960 00000100:00100000:2.0:1787826301.582635:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111365 00000100:00100000:2.0:1787826301.582642:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84215:x1874668789768960:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.582680:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.582714:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b085 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x123:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdb8 expref: 33 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.582731:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:2.0:1787826301.582736:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826301.582760:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.582771:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.582780:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826301.583693:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f24b8678 reply state 00000000de5a0903 transno 8590016465 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.583718:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.583725:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:0.0:1787826301.583728:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826301.583731:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826301.583825:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84215:x1874668789768960:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1181us (1765us total) trans 8590016465 rc 0/0 00000100:00100000:0.0:1787826301.583834:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111365 00000100:00100000:1.0:1787826301.593456:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.593572:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789769344 00000100:00100000:2.0:1787826301.593581:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789769344 00000100:00100000:2.0:1787826301.593641:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111366 00000100:00100000:2.0:1787826301.593650:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84213:x1874668789769344:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.593703:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826301.593729:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b093 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x124:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdc6 expref: 34 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.593748:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:2.0:1787826301.593752:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826301.593782:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.593795:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.593805:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826301.593960:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f80276a7 reply state 00000000c3ccb49c transno 8590016466 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.593972:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.593978:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:2.0:1787826301.593981:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826301.593983:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826301.594084:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84213:x1874668789769344:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 435us (636us total) trans 8590016466 rc 0/0 00000100:00100000:2.0:1787826301.594092:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111366 00000100:00100000:2.0:1787826301.594355:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.594429:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789769472 00000100:00100000:3.0:1787826301.594434:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789769472 00000100:00100000:3.0:1787826301.594476:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111367 00000100:00100000:3.0:1787826301.594493:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84215:x1874668789769472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.594507:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.594520:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdf0 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.594563:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf0 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.594576:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf0 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.594592:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:3.0:1787826301.594594:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826301.594597:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826301.594634:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84215:x1874668789769472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 142us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.594640:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111367 00000100:00100000:1.0:1787826301.604178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.604910:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789769600 00000100:00100000:2.0:1787826301.604922:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789769600 00000100:00100000:2.0:1787826301.604992:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111368 00000100:00100000:2.0:1787826301.605003:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84213:x1874668789769600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.605027:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.605046:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdf7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.605106:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf7 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.605122:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf7 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.605141:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:2.0:1787826301.605144:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826301.605148:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826301.605212:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84213:x1874668789769600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 210us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.605220:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111368 00000100:00100000:1.0:1787826301.618255:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.618302:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.618383:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789769984 00000100:00100000:3.0:1787826301.618383:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789769728 00000100:00100000:0.0:1787826301.618392:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789769984 00000100:00100000:3.0:1787826301.618392:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789769728 00000100:00100000:0.0:1787826301.618453:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111369 00000100:00100000:3.0:1787826301.618453:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6250 00000100:00100000:0.0:1787826301.618462:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84214:x1874668789769984:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00000100:00100000:3.0:1787826301.618462:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789769728:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.618525:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.618542:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd5d expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.618551:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.618583:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd5d expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.618597:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd5d expref: 37 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826301.618609:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc1:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826301.618612:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc1:0x0] updating lvb mtime from disk: 0 -> 1787826220 00002000:00010000:3.0:1787826301.618614:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc1:0x0] updating lvb atime from disk: 0 -> 1787826220 00000100:00100000:0.0:1787826301.618615:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778626304:192.168.203.9@tcp:104: 00002000:00010000:3.0:1787826301.618617:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc1:0x0] updating lvb ctime from disk: 0 -> 1787826220 00002000:00010000:3.0:1787826301.618619:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc1:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826301.629372:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.632695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.634822:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789770112 00000100:00100000:0.0:1787826301.634836:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789770112 00000100:00100000:0.0:1787826301.634931:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6251 00000100:00100000:0.0:1787826301.634943:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789770112:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826301.635103:0:8605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc1:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826301.635107:0:8605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc1:0x0] updating lvb mtime from disk: 0 -> 1787826220 00002000:00010000:0.0:1787826301.635109:0:8605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc1:0x0] updating lvb atime from disk: 0 -> 1787826220 00002000:00010000:0.0:1787826301.635112:0:8605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc1:0x0] updating lvb ctime from disk: 0 -> 1787826220 00002000:00010000:0.0:1787826301.635114:0:8605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc1:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826301.635172:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789770112:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 230us (2484us total) trans 4294968177 rc 0/0 00000100:00100000:0.0:1787826301.635179:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6251 00000100:00100000:1.0:1787826301.638012:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.638089:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789770240 00000100:00100000:3.0:1787826301.638098:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789770240 00010000:00010000:3.0:1787826301.638137:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd5d expref: 38 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.638222:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3022 00000100:00100000:3.0:1787826301.638232:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789770240:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.638248:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.638254:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd5d expref: 38 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.638268:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd5d expref: 38 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.638304:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:3.0:1787826301.638310:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.638320:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.638329:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.638348:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.638396:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789770240:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 166us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.638405:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3022 00010000:00010000:0.0:1787826301.638513:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349af90 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x122:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd5d expref: 37 pid: 6516 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.638530:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778626304:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.638549:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.638559:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.638565:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.638605:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.638613:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.638620:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.638627:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.638631:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.638639:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.638650:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:0.0:1787826301.638653:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826301.638656:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.638663:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b0e0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.638704:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84214:x1874668789769984:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 20243us (20401us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826301.638713:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111369 00000100:00100000:2.0:1787826301.640838:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789769728:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 22366us (22583us total) trans 4294968160 rc 0/0 00000100:00100000:2.0:1787826301.640865:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6250 00000100:00100000:1.0:1787826301.646142:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.646183:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.646296:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789770496 00000100:00100000:3.0:1787826301.646305:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789770496 00000100:00100000:1.0:1787826301.646823:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111370 00000100:00100000:1.0:1787826301.646836:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84213:x1874668789770496:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.646933:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.646951:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd80 expref: 36 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.646961:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.646998:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd80 expref: 36 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.647012:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd80 expref: 36 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.647028:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cb92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778626432:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826301.647118:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.648149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.648210:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789770880 00000100:00100000:2.0:1787826301.648217:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789770880 00000100:00100000:2.0:1787826301.648264:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111371 00000100:00100000:2.0:1787826301.648273:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84215:x1874668789770880:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.648320:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 3/0,1 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.648321:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789770624 00000100:00100000:0.0:1787826301.648326:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789770624 00010000:00010000:2.0:1787826301.648334:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd79 expref: 37 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.648341:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 4/0,1 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.648367:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd79 expref: 37 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.648377:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd79 expref: 37 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.648390:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778626560:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826301.648396:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6252 00000100:00100000:0.0:1787826301.648404:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2399:x1874668789770624:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.648436:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.648452:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 15 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.648456:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53df00 going to sleep for 11 seconds 00010000:00010000:0.0:1787826301.648460:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.648465:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826301.648469:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.648625:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 15 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.648636:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 15 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.648647:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778626688:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826301.648674:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.664060:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778626560:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826301.664096:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 3/0,1 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.664137:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778626688:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.664152:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.664594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.664628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.664658:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.664682:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789771136 00000100:00100000:3.0:1787826301.664688:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789771136 00000100:00100000:0.0:1787826301.664707:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789771008 00000100:00100000:0.0:1787826301.664711:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789771008 00010000:00010000:0.0:1787826301.664729:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd80 expref: 39 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.664729:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd79 expref: 39 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.664755:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789771264 00000100:00100000:0.0:1787826301.664757:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789771264 00010000:00010000:0.0:1787826301.664770:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 16 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.664814:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cb92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778626432:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826301.664833:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.670617:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3023 00000100:00100000:3.0:1787826301.670647:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40511c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789771008:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.670670:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.670683:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd80 expref: 39 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670699:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd80 expref: 39 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670725:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b007 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x124:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd80 expref: 39 pid: 45682 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670744:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:3.0:1787826301.670750:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670760:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670773:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670800:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.670894:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40511c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789771008:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 263us (6264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.670903:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3023 00000100:00100000:3.0:1787826301.670926:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3024 00000100:00100000:3.0:1787826301.670934:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2401:x1874668789771136:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.670943:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.670948:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd79 expref: 37 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670960:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd79 expref: 37 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670973:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349afe4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x123:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbd79 expref: 37 pid: 25756 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670984:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:3.0:1787826301.670988:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 3/0,1 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.670996:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671004:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671021:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.671041:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789771136:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 109us (6448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.671048:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3024 00000100:00100000:3.0:1787826301.671095:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3025 00000100:00100000:3.0:1787826301.671103:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789771264:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.671111:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.671133:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 16 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671146:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 16 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671163:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349b077 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdbf expref: 16 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671176:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.671180:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.671185:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671196:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671226:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.671245:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789771264:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 143us (6586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.671252:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3025 00010000:00010000:3.0:1787826301.671421:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671429:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671469:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671476:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671483:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671488:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.671492:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671500:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671508:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:3.0:1787826301.671511:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787826301.671515:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 2/0,0 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.671520:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b0ee lrc: 0/0,0 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.671572:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84215:x1874668789770880:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 23301us (23427us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787826301.671581:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111371 00010000:00010000:0.0:1787826301.672052:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.672063:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.672086:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.672094:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.672102:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.672108:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826301.672111:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.672123:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.672135:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.672141:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b0f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.672195:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789770624:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 23791us (26009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.672203:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6252 00010000:00010000:1.0:1787826301.678879:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.678898:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.678943:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.678951:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.678959:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.678965:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.678969:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.678977:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.678993:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:1.0:1787826301.678996:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826301.679001:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.679007:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b0e7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.679578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.679705:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789771392 00000100:00100000:0.0:1787826301.679714:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789771392 00000100:00100000:0.0:1787826301.679770:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6253 00000100:00100000:0.0:1787826301.679779:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789771392:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.679821:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.679838:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.679847:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.679866:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826301.679872:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.679907:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.679921:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 10 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.679936:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778626816:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826301.680028:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.680873:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84213:x1874668789770496:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 34020us (34719us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826301.680883:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111370 00000100:00100000:3.0:1787826301.684972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.685009:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789771648 00000100:00100000:1.0:1787826301.685221:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.685303:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778626816:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.685329:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.685420:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789771648 00000100:00100000:3.0:1787826301.685478:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111372 00000100:00100000:3.0:1787826301.685487:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84214:x1874668789771648:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.685562:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.685577:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.685589:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.685732:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.685743:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde9 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.685751:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.685777:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde9 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.685790:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde9 expref: 35 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.685803:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778626944:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826301.685892:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.685909:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789771776 00000100:00100000:3.0:1787826301.685913:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789771776 00010000:00010000:3.0:1787826301.685932:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 11 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.685960:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3026 00000100:00100000:3.0:1787826301.685968:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789771776:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.685977:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.685994:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 11 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.686005:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 11 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.686186:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000372f2cd6/0x68019081f349b0a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbddb expref: 11 pid: 19335 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.686203:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.686207:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.686212:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.686219:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.686243:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.686267:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789771776:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 300us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.686275:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3026 00010000:00010000:0.0:1787826301.686427:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.686436:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.686455:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.686462:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.686475:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.686482:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826301.686486:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.686494:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.686505:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.686512:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349b0fc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.686566:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789771392:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 6788us (6992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.686574:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6253 00000100:00100000:1.0:1787826301.690503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.690575:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789771904 00000100:00100000:0.0:1787826301.690585:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789771904 00000100:00100000:0.0:1787826301.690639:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6254 00000100:00100000:0.0:1787826301.690649:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789771904:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.690692:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.690713:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.690721:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.690724:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826301.690729:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.690765:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.690777:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 14 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.690792:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778627072:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826301.690895:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.692361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.692443:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789772032 00000100:00100000:1.0:1787826301.692450:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789772032 00010000:00010000:1.0:1787826301.692481:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde9 expref: 36 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.692518:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3027 00000100:00100000:1.0:1787826301.692527:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789772032:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826301.692541:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.692547:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde9 expref: 36 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.692559:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde9 expref: 36 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.692580:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:1.0:1787826301.692585:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.692595:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.692602:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.692618:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826301.692670:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789772032:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.692677:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3027 00010000:00010000:0.0:1787826301.692749:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b0bd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde9 expref: 35 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.692765:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778626944:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.692783:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.692791:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.692801:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826301.692931:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016467 00000001:00080000:0.0:1787826301.693064:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016468 00000001:00080000:0.0:1787826301.693099:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016469 00000100:00100000:0.0:1787826301.693167:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa97c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778627200:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787826301.693210:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.693236:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe13482840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.693361:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778627200 00000100:00100000:1.0:1787826301.693366:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778627200 00000100:00100000:1.0:1787826301.693404:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328 00000100:00100000:1.0:1787826301.693421:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778627200:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787826301.693491:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778627200:12345-0@lo:1000:mdt00_004.0 Request processed in 70us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.693497:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328 00000100:00100000:0.0:1787826301.693745:0:12105:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968173 gen 2 00000004:00080000:0.0:1787826301.693751:0:12105:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968173 committed transno 4294968173 00000100:00100000:0.0:1787826301.693767:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa97c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778627200:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1787826301.693883:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016470 00000100:00100000:0.0:1787826301.693925:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a114b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778627328:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787826301.693954:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.693978:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.694135:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778627328 00000100:00100000:2.0:1787826301.694140:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778627328 00000100:00100000:2.0:1787826301.694175:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329 00000100:00100000:2.0:1787826301.694184:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778627328:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787826301.694288:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:12105:x1874668778627328:12345-0@lo:1000:mdt00_004.0 Request processed in 105us (333us total) trans 4294968178 rc 0/0 00000100:00100000:2.0:1787826301.694295:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329 00000100:00100000:0.0:1787826301.694468:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a114b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778627328:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1787826301.694525:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016471 00010000:00010000:0.0:1787826301.694548:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694557:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694564:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694570:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.694575:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694582:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694595:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:0.0:1787826301.694598:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.694602:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694608:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b10a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694629:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f3499128 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694635:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f3499128 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694639:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f3499128 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694644:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.694647:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f3499128 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694652:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f3499128 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694659:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf0:0x0].0x0 (ffff9bbe0bd66c00) 00010000:00010000:0.0:1787826301.694661:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.694665:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f3499128 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694670:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f3499128 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694690:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694700:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694709:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694716:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694721:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694727:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694733:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.694735:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694740:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694747:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf0:0x0].0x0 (ffff9bbe0bd66c00) 00010000:00010000:0.0:1787826301.694749:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.694752:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694757:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b118 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694768:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694774:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694780:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694784:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.694787:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694793:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694800:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf0:0x0].0x0 (ffff9bbe0bd66c00) 00010000:00010000:0.0:1787826301.694802:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826301.694805:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.694811:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b103 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.695149:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84214:x1874668789771648:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 9659us (10183us total) trans 8590016472 rc 0/0 00000100:00100000:0.0:1787826301.695158:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111372 00000020:00080000:0.0:1787826301.695163:0:12105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:0.0:1787826301.698933:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778627072:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.698963:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.699947:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.701127:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789772160 00000100:00100000:3.0:1787826301.701138:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789772160 00010000:00010000:3.0:1787826301.701185:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 15 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.701258:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3028 00000100:00100000:3.0:1787826301.701267:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789772160:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.701282:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.701304:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 15 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.701317:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 15 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.701340:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349b0af lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbde2 expref: 15 pid: 45681 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.701360:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.701364:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826301.701368:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.701377:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.701418:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.701472:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789772160:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 205us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.701480:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3028 00010000:00010000:0.0:1787826301.701532:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.701542:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.701561:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.701568:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.701576:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.701582:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826301.701586:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.701594:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.701610:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.701617:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349b111 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.701664:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789771904:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 11016us (11170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.701672:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6254 00000100:00100000:2.0:1787826301.706212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.709253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.709468:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789772928 00000100:00100000:3.0:1787826301.709478:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789772928 00000100:00100000:3.0:1787826301.709537:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111373 00000100:00100000:3.0:1787826301.709548:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84213:x1874668789772928:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.709628:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 3/0,1 mode: --/PW res: [0x200000403:0xef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.709645:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.709656:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.709783:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.709798:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf7 expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.709807:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.709837:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf7 expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.709879:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf7 expref: 40 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.709893:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778627456:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826301.713240:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789772672 00000100:00100000:1.0:1787826301.713254:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789772672 00000100:00100000:0.0:1787826301.713381:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2665 00000100:00100000:0.0:1787826301.713392:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84214:x1874668789772672:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787826301.713641:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x122:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826301.713673:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016474 00010000:00010000:0.0:1787826301.713706:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.713720:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.713731:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.713740:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.713747:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.713758:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.713771:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826301.713887:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826301.713893:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.713900:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826301.713903:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.713911:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.713923:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:1.0:1787826301.713926:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826301.713931:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 1/0,0 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.713941:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349b12d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x122:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.713955:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826301.713956:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826301.713958:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826301.714195:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.714274:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84214:x1874668789772672:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 881us (8069us total) trans 8590016475 rc 0/0 00000100:00100000:0.0:1787826301.714284:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2665 00000020:00080000:0.0:1787826301.714289:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826301.717296:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.718479:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789772416 00000100:00100000:3.0:1787826301.718492:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789772416 00000100:00100000:3.0:1787826301.718565:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111374 00000100:00100000:3.0:1787826301.718575:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84215:x1874668789772416:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.718653:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.718670:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.718681:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.718986:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.718998:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf0 expref: 44 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.719006:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.719505:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf0 expref: 44 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.719519:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf0 expref: 44 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.719536:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778627584:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826301.719614:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.721131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.721174:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789773056 00000100:00100000:1.0:1787826301.721182:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789773056 00010000:00010000:1.0:1787826301.721218:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf7 expref: 45 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.721262:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3029 00000100:00100000:1.0:1787826301.721272:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+45:2401:x1874668789773056:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826301.721286:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.721293:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf7 expref: 45 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.721306:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf7 expref: 45 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.721327:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:1.0:1787826301.721333:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.721343:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.721351:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.721369:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826301.721434:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+45:2401:x1874668789773056:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 164us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.721441:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3029 00010000:00010000:3.0:1787826301.722168:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b0d9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf7 expref: 44 pid: 6517 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.722187:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778627456:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826301.722209:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.722218:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.722224:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826301.722789:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016473 00000001:00080000:3.0:1787826301.723166:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016477 00000001:00080000:3.0:1787826301.723203:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016478 00000100:00100000:2.0:1787826301.723225:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.723282:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778627712:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826301.723327:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.723369:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789773184 00000100:00100000:1.0:1787826301.723375:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789773184 00010000:00010000:1.0:1787826301.723405:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf0 expref: 47 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.723450:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3030 00000100:00100000:1.0:1787826301.723458:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2401:x1874668789773184:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826301.723471:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.724080:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf0 expref: 47 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.724103:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf0 expref: 47 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.724125:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826301.724130:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.724139:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.724147:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.724170:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826301.724217:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2401:x1874668789773184:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 758us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.724225:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3030 00000100:00100000:3.0:1787826301.724425:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c66d6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787826301.724628:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b0d2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdf0 expref: 46 pid: 12105 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.724645:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778627584:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.724666:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.724674:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.724680:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826301.724763:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016476 00000001:00080000:0.0:1787826301.725181:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016480 00000001:00080000:0.0:1787826301.725220:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016481 00000100:00100000:0.0:1787826301.725291:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778627840:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826301.725339:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.726344:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.726762:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778627712 00000100:00100000:1.0:1787826301.726771:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778627712 00000100:00100000:1.0:1787826301.726992:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778627840 00000100:00100000:1.0:1787826301.726997:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778627840 00000100:00100000:1.0:1787826301.727028:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3330 00000100:00100000:1.0:1787826301.727038:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778627712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787826301.727151:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778627712:12345-0@lo:1000:mdt00_002.0 Request processed in 114us (3822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.727158:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3330 00000100:00100000:1.0:1787826301.727176:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3331 00000100:00100000:1.0:1787826301.727187:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778627840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787826301.727243:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778627840:12345-0@lo:1000:mdt00_000.0 Request processed in 61us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.727249:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3331 00000100:00100000:1.0:1787826301.727282:0:6515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968158 gen 2 00000004:00080000:1.0:1787826301.727287:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968157 committed transno 4294968158 00000004:00080000:1.0:1787826301.727305:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968158 committed transno 4294968158 00000100:00100000:1.0:1787826301.727318:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778627840:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787826301.727458:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016482 00000100:00100000:1.0:1787826301.728067:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb23480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778627968:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787826301.728108:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.728140:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.728171:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778627712:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787826301.728252:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016479 00000100:00100000:1.0:1787826301.728287:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778628096:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787826301.728313:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.728328:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.728330:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778627968 00000100:00100000:3.0:1787826301.728336:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778627968 00000100:00100000:1.0:1787826301.728338:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778628096 00000100:00100000:1.0:1787826301.728340:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778628096 00000100:00100000:2.0:1787826301.728398:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3332 00000100:00100000:2.0:1787826301.728418:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778628096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826301.728434:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3333 00000100:00100000:3.0:1787826301.728441:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6515:x1874668778627968:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787826301.728524:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6517:x1874668778628096:12345-0@lo:1000:mdt00_002.0 Request processed in 117us (209us total) trans 4294968179 rc 0/0 00000100:00100000:3.0:1787826301.728524:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778627968:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (415us total) trans 4294968161 rc 0/0 00000100:00100000:3.0:1787826301.728531:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3333 00000100:00100000:1.0:1787826301.728571:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb23480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778627968:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787826301.728630:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016483 00010000:00010000:1.0:1787826301.728653:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728663:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728671:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728677:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.728681:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728688:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728704:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826301.728707:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.728712:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728721:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b13b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728743:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349912f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728749:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349912f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728754:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349912f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728759:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.728762:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349912f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728767:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349912f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728775:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf1:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:1.0:1787826301.728777:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.728780:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349912f lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728786:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349912f lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728940:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728954:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728965:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728974:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728980:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728985:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.728991:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.728994:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729000:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729008:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf1:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:1.0:1787826301.729011:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.729014:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729020:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b142 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729030:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729035:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729041:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729045:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.729048:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729053:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729061:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf1:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:1.0:1787826301.729063:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826301.729066:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729072:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b134 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.729186:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84215:x1874668789772416:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 10610us (11896us total) trans 8590016485 rc 0/0 00000100:00100000:1.0:1787826301.729195:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111374 00000020:00080000:1.0:1787826301.729199:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826301.729232:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778628096:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787826301.729276:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016484 00010000:00010000:1.0:1787826301.729297:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729304:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729314:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729318:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.729321:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729328:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729337:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:1.0:1787826301.729339:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.729342:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729348:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b126 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729362:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f3499121 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729368:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f3499121 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729373:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f3499121 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729378:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.729380:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f3499121 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729388:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f3499121 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729396:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xef:0x0].0x0 (ffff9bbe0bd66f00) 00010000:00010000:1.0:1787826301.729398:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.729400:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f3499121 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729405:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f3499121 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729431:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729439:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729446:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729453:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729458:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729464:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729469:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.729473:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729479:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729485:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xef:0x0].0x0 (ffff9bbe0bd66f00) 00010000:00010000:1.0:1787826301.729487:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.729490:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729495:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b149 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729504:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xef:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729509:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xef:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729515:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xef:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729519:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.729522:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xef:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729528:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xef:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729535:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xef:0x0].0x0 (ffff9bbe0bd66f00) 00010000:00010000:1.0:1787826301.729537:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826301.729539:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 2/0,0 mode: --/PW res: [0x200000403:0xef:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.729549:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b11f lrc: 0/0,0 mode: --/PW res: [0x200000403:0xef:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.729622:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84213:x1874668789772928:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 20075us (20377us total) trans 8590016486 rc 0/0 00000100:00100000:1.0:1787826301.729629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111373 00000020:00080000:1.0:1787826301.729633:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1787826301.729985:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826301.729990:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787826301.730055:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3332 00000040:00080000:3.0:1787826301.730192:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9691 count 103 00000040:00080000:3.0:1787826301.730200:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826301.730382:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778628224:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826301.730441:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c66de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.733744:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.733780:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.733942:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789773440 00000100:00100000:1.0:1787826301.733953:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789773440 00000100:00100000:1.0:1787826301.734004:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789773696 00000100:00100000:1.0:1787826301.734007:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789773696 00000100:00100000:1.0:1787826301.734023:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2666 00000100:00100000:1.0:1787826301.734031:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84213:x1874668789773440:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787826301.734276:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x124:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826301.734310:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016487 00010000:00010000:1.0:1787826301.734346:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734361:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734373:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734382:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734388:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734398:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734427:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826301.734462:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826301.734468:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734475:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc0c00440) 00000100:00100000:2.0:1787826301.734623:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2667 00000100:00100000:2.0:1787826301.734634:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84215:x1874668789773696:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826301.734754:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x123:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1787826301.734758:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734767:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826301.734768:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016489 00010000:00010000:1.0:1787826301.734780:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:1.0:1787826301.734784:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826301.734787:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734788:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734794:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b150 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x124:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.734796:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.734810:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.734817:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.734823:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.734828:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.734867:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826301.734944:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826301.734948:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734955:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826301.734958:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734968:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734978:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:1.0:1787826301.734980:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826301.734984:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.734989:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b157 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.735045:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826301.737044:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84213:x1874668789773440:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 3004us (3298us total) trans 8590016488 rc 0/0 00000100:00100000:0.0:1787826301.737059:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2666 00000020:00080000:0.0:1787826301.737065:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826301.738484:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84215:x1874668789773696:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 3844us (4695us total) trans 8590016490 rc 0/0 00000100:00100000:2.0:1787826301.738496:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2667 00000020:00080000:2.0:1787826301.738501:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826301.738612:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826301.738616:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826301.738618:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826301.740429:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778628224:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787826301.740715:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.740753:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.740788:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.740841:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789773824 00000100:00100000:1.0:1787826301.740849:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789773824 00000100:00100000:1.0:1787826301.740987:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789773952 00000100:00100000:1.0:1787826301.740991:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789773952 00000100:00100000:1.0:1787826301.741009:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789774080 00000100:00100000:1.0:1787826301.741012:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789774080 00000100:00100000:1.0:1787826301.741030:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111375 00000100:00100000:1.0:1787826301.741039:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84218:x1874668789773824:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826301.741071:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf3:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826301.741176:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84218:x1874668789773824:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 138us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.741183:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111375 00000100:00100000:1.0:1787826301.741201:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111376 00000100:00100000:1.0:1787826301.741207:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84219:x1874668789773952:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826301.741221:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826301.741262:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84219:x1874668789773952:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 55us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.741268:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111376 00000100:00100000:1.0:1787826301.741281:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111377 00000100:00100000:1.0:1787826301.741286:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84217:x1874668789774080:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826301.741299:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826301.741336:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84217:x1874668789774080:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 50us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.741342:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111377 00000100:00100000:1.0:1787826301.744246:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.744632:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789774208 00000100:00100000:3.0:1787826301.744641:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789774208 00000100:00100000:3.0:1787826301.744708:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111378 00000100:00100000:3.0:1787826301.744719:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84218:x1874668789774208:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.744798:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.744829:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.744840:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.744881:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.744890:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.744897:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.744926:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.744935:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.744941:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826301.744985:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf3:0x0]: returning size 158 00000004:00200000:3.0:1787826301.744989:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826301.745001:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745378:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745388:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745399:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745405:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.745420:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745429:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745442:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826301.745446:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.745450:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745457:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b15e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745472:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745479:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745485:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745490:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.745493:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745502:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745510:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2419c48e (ffff9bbe08124900) 00010000:00010000:3.0:1787826301.745512:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.745515:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745521:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b165 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2419c48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745536:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745541:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745546:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745551:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.745554:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745560:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745566:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf3:0x0].0x0 (ffff9bbe16cc5700) 00010000:00010000:3.0:1787826301.745569:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.745572:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.745581:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b16c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.745670:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84218:x1874668789774208:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 951us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.745678:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111378 00000100:00100000:1.0:1787826301.748749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.748780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.749433:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789774464 00000100:00100000:2.0:1787826301.749443:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789774464 00000100:00100000:2.0:1787826301.749497:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789774336 00000100:00100000:2.0:1787826301.749501:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789774336 00000100:00100000:2.0:1787826301.749525:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111379 00000100:00100000:2.0:1787826301.749534:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84219:x1874668789774464:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.749601:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.749630:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.749643:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.749659:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.749668:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.749675:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.749770:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111380 00000100:00100000:1.0:1787826301.749780:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84217:x1874668789774336:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.749819:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.749829:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.749837:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.749871:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.749882:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.749889:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.749911:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.749920:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.749926:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826301.749972:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf2:0x0]: returning size 158 00000004:00200000:1.0:1787826301.749977:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826301.749991:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750003:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750010:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750030:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750038:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.750042:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750051:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750065:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826301.750068:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.750073:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750080:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b181 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750094:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750101:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750108:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750113:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.750116:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750122:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750129:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xab40ea89 (ffff9bbe12458200) 00010000:00010000:1.0:1787826301.750131:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.750134:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750145:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b188 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xab40ea89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750161:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750168:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750175:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750181:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.750184:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750190:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750198:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf2:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:1.0:1787826301.750201:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.750204:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.750210:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b18f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.750283:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84217:x1874668789774336:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 504us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.750479:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111380 00010000:00010000:2.0:1787826301.750967:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.750979:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.750987:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.751086:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf4:0x0]: returning size 158 00000004:00200000:2.0:1787826301.751090:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826301.751100:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751113:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751120:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751125:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751131:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751136:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.751139:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751145:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751156:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826301.751158:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.751161:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751167:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b173 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751178:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751185:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751190:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751195:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.751198:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751205:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751212:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4c31855e (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826301.751215:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.751218:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751223:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b17a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c31855e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751241:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751247:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751252:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751257:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.751260:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751265:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751271:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf4:0x0].0x0 (ffff9bbe16cc5100) 00010000:00010000:2.0:1787826301.751274:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.751276:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.751282:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b196 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.751516:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84219:x1874668789774464:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1980us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.751524:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111379 00000100:00100000:1.0:1787826301.755914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.755950:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.755988:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.756219:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789774720 00000100:00100000:0.0:1787826301.756228:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789774720 00000100:00100000:0.0:1787826301.756281:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789774976 00000100:00100000:0.0:1787826301.756285:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789774976 00000100:00100000:0.0:1787826301.756320:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789775232 00000100:00100000:0.0:1787826301.756324:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789775232 00000100:00100000:0.0:1787826301.756348:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111381 00000100:00100000:0.0:1787826301.756357:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84218:x1874668789774720:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.756378:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.756397:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b19d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbdfe expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756513:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756529:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756540:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.756551:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf3:0x0]: returning size 158 00010000:00010000:0.0:1787826301.756638:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756647:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756655:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756662:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.756666:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756674:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756686:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf3:0x0].0x0 (ffff9bbe16cc5700) 00010000:00010000:0.0:1787826301.756689:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826301.756694:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756701:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1a4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756741:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b19d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdfe expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756752:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826301.756755:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826301.756760:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b19d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbdfe expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756770:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2400, rc 0) 00000100:00100000:0.0:1787826301.756838:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84218:x1874668789774720:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 482us (986us total) trans 8590016491 rc 301/301 00000100:00100000:0.0:1787826301.756874:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111381 00000100:00100000:0.0:1787826301.756895:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111382 00000100:00100000:0.0:1787826301.756902:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84217:x1874668789774976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.756911:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.756919:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b1b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe05 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756964:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756974:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.756982:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.756990:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf2:0x0]: returning size 158 00010000:00010000:0.0:1787826301.757096:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757105:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757112:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757117:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.757121:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757132:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757142:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf2:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:0.0:1787826301.757145:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826301.757148:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757154:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b1b9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757178:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b1b2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe05 expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757187:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826301.757189:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826301.757193:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b1b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe05 expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757202:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc 0) 00000100:00100000:0.0:1787826301.757226:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84217:x1874668789774976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 325us (1276us total) trans 8590016492 rc 301/301 00000100:00100000:0.0:1787826301.757233:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111382 00000100:00100000:0.0:1787826301.757248:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111383 00000100:00100000:0.0:1787826301.757255:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84219:x1874668789775232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.757263:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.757272:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b1c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe0c expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757313:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757322:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757330:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.757337:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf4:0x0]: returning size 158 00010000:00010000:0.0:1787826301.757366:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757373:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757379:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757384:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.757388:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757394:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757402:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf4:0x0].0x0 (ffff9bbe16cc5100) 00010000:00010000:0.0:1787826301.757404:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826301.757421:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757431:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b1ce lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757453:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b1c7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe0c expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757461:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826301.757463:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826301.757466:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b1c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe0c expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.757474:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:0.0:1787826301.757495:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84219:x1874668789775232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 241us (1508us total) trans 8590016493 rc 301/301 00000100:00100000:0.0:1787826301.757502:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111383 00000100:00100000:0.0:1787826301.764282:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826301.764314:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778628352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826301.764382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.764510:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778628352 00000100:00100000:1.0:1787826301.764518:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778628352 00000100:00100000:1.0:1787826301.764581:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:1.0:1787826301.764590:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778628352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826301.764624:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828649984 avail 3596898304 00000100:00100000:1.0:1787826301.764667:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778628352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.764674:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00080000:0.0:1787826301.764815:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826301.764876:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778628352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826301.765582:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778628864:0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.765638:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.765670:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778629376:0@lo:400:kworker.0 00000100:00100000:2.0:1787826301.765832:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778628864 00000100:00100000:2.0:1787826301.765838:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778628864 00000100:00100000:2.0:1787826301.765903:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4967 00000100:00100000:2.0:1787826301.765913:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778628864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826301.765955:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778628864:12345-0@lo:400:kworker.0 Request processed in 45us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.765964:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4967 00000100:00100000:3.0:1787826301.766186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.766220:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778628864:0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.766234:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787826301.766241:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c687310c-1e82-4391-b632-324cfd2cb9dd:3645:1874668778628480:0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.766269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.766362:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778628992:0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.766387:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.766405:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778629504:0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.766440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.766469:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778629504 00000100:00100000:3.0:1787826301.766472:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778629504 00000100:00100000:3.0:1787826301.766504:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3334 00000100:00100000:3.0:1787826301.766512:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778629504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.766548:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778629504:12345-0@lo:400:kworker.0 Request processed in 38us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.766559:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3334 00000100:00100000:3.0:1787826301.766585:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778629504:0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.766605:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778628992 00000100:00100000:3.0:1787826301.766608:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778628992 00000100:00100000:3.0:1787826301.766646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4968 00000100:00100000:3.0:1787826301.766652:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778628992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.766688:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778628992:12345-0@lo:400:kworker.0 Request processed in 36us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.766811:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778629376 00000100:00100000:2.0:1787826301.766816:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778629376 00000100:00100000:2.0:1787826301.766845:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3429 00000100:00100000:2.0:1787826301.766883:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778629376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826301.766917:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778629376:12345-0@lo:400:kworker.0 Request processed in 65us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.766923:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3429 00000100:00100000:0.0:1787826301.767128:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1607b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778628608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.767159:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.767178:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778629120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.767200:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.767216:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778629632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.767235:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.767255:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787826301.767261:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778628736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.767283:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.767373:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778629248:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.767397:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826301.767436:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826301.767440:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826301.767442:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826301.767454:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778629120 00000100:00100000:0.0:1787826301.767457:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778629120 00000100:00100000:0.0:1787826301.767490:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778629632 00000100:00100000:0.0:1787826301.767494:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778629632 00000100:00100000:0.0:1787826301.767512:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778628736 00000100:00100000:0.0:1787826301.767515:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778628736 00000100:00100000:0.0:1787826301.767529:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778629248 00000100:00100000:0.0:1787826301.767532:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778629248 00000100:00100000:0.0:1787826301.767551:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4969 00000100:00100000:0.0:1787826301.767558:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778629120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.767595:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778629120:12345-0@lo:400:kworker.0 Request processed in 37us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.767602:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4969 00000100:00100000:0.0:1787826301.767615:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4970 00000100:00100000:0.0:1787826301.767621:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778629632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.767649:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778629632:12345-0@lo:400:kworker.0 Request processed in 27us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.767656:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4970 00000100:00100000:0.0:1787826301.767666:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4971 00000100:00100000:0.0:1787826301.767672:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778628736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.767790:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4968 00000100:00100000:3.0:1787826301.767818:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4972 00000100:00100000:3.0:1787826301.767827:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778629248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826301.767913:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778628608 00000100:00100000:2.0:1787826301.767918:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778628608 00000100:00100000:2.0:1787826301.767946:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3335 00000100:00100000:2.0:1787826301.767952:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778628608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.768041:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778628736:12345-0@lo:400:kworker.0 Request processed in 368us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.768049:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4971 00000100:00080000:0.0:1787826301.768075:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826301.768078:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826301.768492:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778628480 00000100:00100000:1.0:1787826301.768497:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778628480 00000100:00100000:1.0:1787826301.768528:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1787826301.768535:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf03f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3645:x1874668778628480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826301.768572:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf03f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3645:x1874668778628480:12345-0@lo:400:kworker.0 Request processed in 37us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.768578:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1787826301.768722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.768746:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.768765:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.768779:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789775360 00000100:00100000:1.0:1787826301.768782:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789775360 00000100:00100000:1.0:1787826301.768815:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789775488 00000100:00100000:1.0:1787826301.768819:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789775488 00000100:00100000:1.0:1787826301.768834:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789775616 00000100:00100000:1.0:1787826301.768836:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789775616 00000100:00100000:1.0:1787826301.768867:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111384 00000100:00100000:1.0:1787826301.768874:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84219:x1874668789775360:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826301.768900:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826301.768996:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84219:x1874668789775360:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 121us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.769003:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111384 00000100:00100000:1.0:1787826301.769682:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111385 00000100:00100000:1.0:1787826301.769702:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84218:x1874668789775488:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826301.769723:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf3:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826301.769779:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84218:x1874668789775488:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 89us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.769786:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111385 00000100:00100000:1.0:1787826301.769812:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111386 00000100:00100000:1.0:1787826301.769821:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84217:x1874668789775616:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826301.769836:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826301.769899:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84217:x1874668789775616:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 79us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.769906:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111386 00000100:00100000:2.0:1787826301.773418:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778628608:12345-0@lo:400:kworker.0 Request processed in 5444us (6236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.773433:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3335 00000100:00100000:3.0:1787826301.773608:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778629248:12345-0@lo:400:kworker.0 Request processed in 5780us (6208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.773617:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4972 00000100:00100000:3.0:1787826301.773668:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c687310c-1e82-4391-b632-324cfd2cb9dd:3645:1874668778628480:0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.773684:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778628992:0@lo:400:kworker.0 00000100:00100000:3.0:1787826301.773696:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778629376:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.773830:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778628736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.773846:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778629248:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.773881:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1607b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778628608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.773894:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778629120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826301.773904:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778629632:0@lo:400:kworker.0 00000100:00100000:1.0:1787826301.774360:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.774455:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789775872 00000100:00100000:0.0:1787826301.774462:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789775872 00000100:00100000:0.0:1787826301.774548:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111387 00000100:00100000:0.0:1787826301.774559:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84218:x1874668789775872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.774578:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.774599:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b1dc lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe13 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.775202:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.775217:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.775229:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.775240:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x125:0x0]: returning size 0 00010000:00010000:0.0:1787826301.775356:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b1dc lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe13 expref: 61 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.775380:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe13 expref: 60 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.775388:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826301.775392:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826301.775395:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2200, rc 0) 00000100:00100000:0.0:1787826301.775522:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84218:x1874668789775872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 964us (1165us total) trans 8590016494 rc 0/0 00000100:00100000:0.0:1787826301.775531:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111387 00000100:00100000:1.0:1787826301.778645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.778750:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789776128 00000100:00100000:2.0:1787826301.778760:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789776128 00000100:00100000:2.0:1787826301.778891:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111388 00000100:00100000:2.0:1787826301.778901:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84219:x1874668789776128:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.778924:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.778943:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b1f1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe1a expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.779558:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b1f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.779574:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.779586:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.779597:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x126:0x0]: returning size 0 00010000:00010000:2.0:1787826301.779645:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b1f1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe1a expref: 63 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.779664:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe1a expref: 62 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.779674:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826301.779676:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826301.779680:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826301.779734:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84219:x1874668789776128:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 835us (1098us total) trans 8590016495 rc 0/0 00000100:00100000:2.0:1787826301.779743:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111388 00000100:00100000:2.0:1787826301.782754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.784416:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789776384 00000100:00100000:0.0:1787826301.784428:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789776384 00000100:00100000:0.0:1787826301.784536:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111389 00000100:00100000:0.0:1787826301.784548:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84217:x1874668789776384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.784571:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.784591:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b206 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe21 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.786265:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b20d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.786286:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b20d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.786298:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b20d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826301.786315:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x127:0x0]: returning size 0 00010000:00010000:1.0:1787826301.786373:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b206 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe21 expref: 65 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.786394:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b20d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe21 expref: 64 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.786403:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458200) 00010000:00010000:1.0:1787826301.786417:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826301.786421:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826301.786497:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84217:x1874668789776384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1950us (3751us total) trans 8590016496 rc 0/0 00000100:00100000:1.0:1787826301.786506:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111389 00000100:00100000:1.0:1787826301.800176:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.805958:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789776640 00000100:00100000:0.0:1787826301.805973:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789776640 00000100:00100000:0.0:1787826301.806240:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111390 00000100:00100000:0.0:1787826301.806252:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84218:x1874668789776640:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.806321:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.806348:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b1e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe13 expref: 64 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806368:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbf0f565d00) 00010000:00010000:0.0:1787826301.806378:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826301.806400:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806425:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806435:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806450:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806456:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806462:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806508:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806516:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806522:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806528:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806533:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.806537:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806545:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806553:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826301.806556:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.806560:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806566:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b21b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806576:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806581:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806587:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806592:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.806595:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806605:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806612:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xb59cbf0 (ffff9bbf0f565400) 00010000:00010000:0.0:1787826301.806614:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.806616:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.806621:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b222 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xb59cbf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.806706:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84218:x1874668789776640:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 455us (6538us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826301.806713:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111390 00000100:00100000:3.0:1787826301.808614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.816181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.816965:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789776768 00000100:00100000:1.0:1787826301.816977:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789776768 00000100:00100000:1.0:1787826301.819181:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111391 00000100:00100000:1.0:1787826301.819202:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84218:x1874668789776768:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.819222:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.819246:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b229 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe28 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.819281:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.819293:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.819305:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.819428:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b229 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe28 expref: 65 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.819447:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe28 expref: 64 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.819457:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:1.0:1787826301.819460:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826301.819464:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:1.0:1787826301.819527:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84218:x1874668789776768:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 334us (10918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.819535:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111391 00010000:00010000:2.0:1787826301.824007:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826301.824444:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789777024 00000100:00100000:1.0:1787826301.824453:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789777024 00000100:00100000:1.0:1787826301.824513:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111392 00000100:00100000:1.0:1787826301.824523:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84219:x1874668789777024:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.824573:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.824598:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b1f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe1a expref: 64 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824615:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe0fe8c300) 00010000:00010000:1.0:1787826301.824626:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826301.824648:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824662:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824671:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824685:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824691:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824697:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824735:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824743:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824750:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824756:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824761:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.824765:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824773:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824782:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826301.824785:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.824789:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824794:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b237 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824816:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824822:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824828:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824833:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826301.824837:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824843:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824884:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xfbab0796 (ffff9bbe12458300) 00010000:00010000:1.0:1787826301.824886:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.824889:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.824895:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b23e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xfbab0796 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.824974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84219:x1874668789777024:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 452us (8803us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826301.824982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111392 00000100:00100000:2.0:1787826301.825149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.825280:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789777280 00000100:00100000:3.0:1787826301.825292:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789777280 00000100:00100000:3.0:1787826301.825327:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111393 00000100:00100000:3.0:1787826301.825334:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84218:x1874668789777280:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.825383:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.825394:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.825402:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826301.825521:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d88778f6 reply state 00000000708a1566 transno 8590016497 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.825533:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.825540:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:3.0:1787826301.825543:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826301.825545:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826301.825613:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84218:x1874668789777280:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 279us (464us total) trans 8590016497 rc 0/0 00000100:00100000:3.0:1787826301.825620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111393 00000100:00100000:2.0:1787826301.833357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.833400:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.833433:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789777408 00000100:00100000:1.0:1787826301.833442:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789777536 00000100:00100000:0.0:1787826301.833443:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789777408 00000100:00100000:1.0:1787826301.833445:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789777536 00000100:00100000:2.0:1787826301.833504:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.833509:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111394 00000100:00100000:0.0:1787826301.833519:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84218:x1874668789777408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.833539:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.833560:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe2f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.833619:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe2f expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.833634:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe2f expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.833651:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826301.833654:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.833658:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3c00, rc 0) 00000100:00100000:0.0:1787826301.833781:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84218:x1874668789777408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 263us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.833789:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111394 00000100:00100000:3.0:1787826301.835176:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789777792 00000100:00100000:3.0:1787826301.835185:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789777792 00000100:00100000:1.0:1787826301.839152:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111395 00000100:00100000:1.0:1787826301.839177:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84219:x1874668789777536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.839202:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.839227:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b253 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe36 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.839263:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.839276:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.839286:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.839400:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b253 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe36 expref: 70 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.839434:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe36 expref: 69 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.839444:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:1.0:1787826301.839448:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826301.839451:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7000, rc 0) 00000100:00100000:1.0:1787826301.839524:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84219:x1874668789777536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 360us (6123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.839532:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111395 00000100:00100000:2.0:1787826301.841772:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.844044:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789777920 00000100:00100000:1.0:1787826301.844057:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789777920 00000100:00100000:1.0:1787826301.844121:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2668 00000100:00100000:1.0:1787826301.844130:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84218:x1874668789777920:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.844265:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84218:x1874668789777920:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 135us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.844273:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2668 00000100:00100000:3.0:1787826301.846489:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111396 00000100:00100000:3.0:1787826301.846507:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84217:x1874668789777792:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.846557:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.846586:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b20d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe21 expref: 67 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846610:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458200) 00010000:00010000:3.0:1787826301.846620:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826301.846643:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846656:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846666:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846680:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846687:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846693:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846736:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846744:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846752:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846758:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.846763:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846771:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846793:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826301.846796:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.846800:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846814:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b261 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846824:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846829:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846834:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.846839:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826301.846842:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.848035:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.848060:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x94094b07 (ffff9bbe08124900) 00010000:00010000:3.0:1787826301.848063:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826301.848068:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.848076:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b268 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x94094b07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.852083:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84217:x1874668789777792:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 5571us (18566us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826301.852095:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111396 00000100:00100000:2.0:1787826301.853133:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.853209:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.853327:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789778432 00000100:00100000:3.0:1787826301.853335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789778432 00000100:00100000:3.0:1787826301.853388:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2669 00000100:00100000:3.0:1787826301.853398:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84218:x1874668789778432:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826301.853616:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84218:x1874668789778432:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 218us (405us total) trans 8590016498 rc 0/0 00000100:00100000:3.0:1787826301.853624:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2669 00000100:00100000:1.0:1787826301.854426:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789778176 00000100:00100000:1.0:1787826301.854433:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789778176 00000100:00100000:1.0:1787826301.855350:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111397 00000100:00100000:1.0:1787826301.855362:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84219:x1874668789778176:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.855446:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.855463:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.855476:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826301.855603:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005776c69e reply state 00000000061a4ee3 transno 8590016499 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.855623:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.855631:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:1.0:1787826301.855635:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826301.855638:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826301.855731:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84219:x1874668789778176:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 371us (2601us total) trans 8590016499 rc 0/0 00000100:00100000:1.0:1787826301.855739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111397 00000100:00100000:2.0:1787826301.862178:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.862386:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789778560 00000100:00100000:1.0:1787826301.862396:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789778560 00000100:00100000:1.0:1787826301.862461:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111398 00000100:00100000:1.0:1787826301.862470:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84217:x1874668789778560:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.862490:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.862514:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b276 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe3d expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.862551:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.862564:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.862575:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.862678:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b276 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe3d expref: 71 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.862701:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe3d expref: 70 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.862710:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:1.0:1787826301.862713:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826301.862716:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826301.862776:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84217:x1874668789778560:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 306us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.863340:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111398 00000100:00100000:3.0:1787826301.865376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.868074:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.873198:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.873833:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789778816 00000100:00100000:1.0:1787826301.873842:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789778816 00000100:00100000:0.0:1787826301.874035:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789778944 00000100:00100000:0.0:1787826301.874039:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789778944 00000100:00100000:0.0:1787826301.874065:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111399 00000100:00100000:0.0:1787826301.874073:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84218:x1874668789778816:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.874167:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84218:x1874668789778816:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 94us (8798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.874174:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111399 00000100:00100000:0.0:1787826301.874190:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111400 00000100:00100000:0.0:1787826301.874196:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84219:x1874668789778944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.874208:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.874226:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.874274:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe44 expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.874288:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe44 expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.874302:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:0.0:1787826301.874306:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.874310:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2200, rc 0) 00000100:00100000:0.0:1787826301.874327:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84219:x1874668789778944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 131us (6262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.874332:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111400 00000100:00100000:3.0:1787826301.878152:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789779200 00000100:00100000:3.0:1787826301.878166:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789779200 00000100:00100000:2.0:1787826301.878440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.878894:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789779328 00000100:00100000:1.0:1787826301.878899:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789779328 00000100:00100000:1.0:1787826301.878942:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2670 00000100:00100000:1.0:1787826301.878952:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84219:x1874668789779328:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.879078:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84219:x1874668789779328:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 127us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.879086:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2670 00000100:00100000:0.0:1787826301.880063:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111401 00000100:00100000:0.0:1787826301.880080:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84217:x1874668789779200:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.880149:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.880166:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.880178:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826301.880310:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069f645bd reply state 000000004b45e157 transno 8590016500 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.880323:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.880331:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:0.0:1787826301.880334:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787826301.880337:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826301.880415:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84217:x1874668789779200:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 332us (7215us total) trans 8590016500 rc 0/0 00000100:00100000:0.0:1787826301.880427:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111401 00000100:00100000:1.0:1787826301.884623:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.890057:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789779584 00000100:00100000:2.0:1787826301.890071:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789779584 00000100:00100000:2.0:1787826301.890142:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111402 00000100:00100000:2.0:1787826301.890152:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84218:x1874668789779584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.890174:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.890195:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b292 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe4b expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.890298:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.890313:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe2f expref: 74 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.890322:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.890354:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe2f expref: 74 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.890368:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe2f expref: 74 pid: 6515 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.890382:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283f840 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778629760:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826301.890487:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.894368:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.894421:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.894511:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789779968 00000100:00100000:3.0:1787826301.894519:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789779968 00000100:00100000:3.0:1787826301.894568:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111403 00000100:00100000:3.0:1787826301.894579:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84217:x1874668789779968:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826301.894603:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.894625:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe52 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.894687:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe52 expref: 76 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.894706:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe52 expref: 76 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.894717:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:3.0:1787826301.894720:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826301.894723:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607e00, rc 0) 00000100:00100000:3.0:1787826301.894773:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84217:x1874668789779968:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 196us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.894780:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111403 00000100:00100000:2.0:1787826301.895270:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789779840 00000100:00100000:2.0:1787826301.895275:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789779840 00000100:00100000:2.0:1787826301.895317:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2671 00000100:00100000:2.0:1787826301.895325:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84219:x1874668789779840:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.895504:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84219:x1874668789779840:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 179us (1143us total) trans 8590016501 rc 0/0 00000100:00100000:2.0:1787826301.895512:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2671 00000100:00100000:2.0:1787826301.895552:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283f840 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778629760:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826301.895572:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.906684:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.907300:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789780096 00000100:00100000:0.0:1787826301.907310:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789780096 00010000:00010000:0.0:1787826301.907354:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe2f expref: 77 pid: 6515 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.907397:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3031 00000100:00100000:0.0:1787826301.907417:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40510450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+77:2402:x1874668789780096:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826301.907433:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.907439:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe2f expref: 77 pid: 6515 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.907453:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe2f expref: 77 pid: 6515 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.907476:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b24c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe2f expref: 77 pid: 6515 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.907493:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826301.907499:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.907509:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.907516:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.907552:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826301.907613:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40510450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:2402:x1874668789780096:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 208us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.907622:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3031 00010000:00010000:2.0:1787826301.908139:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908149:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.908168:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x125:0x0]: returning size 0 00000004:00080000:2.0:1787826301.908325:0:45683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc2:0x0], index 1: 0 00010000:00010000:2.0:1787826301.908437:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908445:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908452:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908462:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.908466:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908473:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908484:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826301.908487:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826301.908490:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908495:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b299 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908542:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b292 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe4b expref: 76 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908551:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826301.908554:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826301.908557:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b292 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe4b expref: 76 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.908566:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826301.908612:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84218:x1874668789779584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 18460us (23998us total) trans 8590016502 rc 301/301 00000100:00100000:2.0:1787826301.908620:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111402 00000100:00100000:3.0:1787826301.908910:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.909084:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789780352 00000100:00100000:0.0:1787826301.909090:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789780352 00000100:00100000:0.0:1787826301.909135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111404 00000100:00100000:0.0:1787826301.909143:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84219:x1874668789780352:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.909213:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84219:x1874668789780352:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 70us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.909220:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111404 00000100:00100000:3.0:1787826301.917545:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.917706:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789780480 00000100:00100000:2.0:1787826301.917717:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789780480 00000100:00100000:2.0:1787826301.917834:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2672 00000100:00100000:2.0:1787826301.917844:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84217:x1874668789780480:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.918005:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84217:x1874668789780480:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 162us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.918013:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2672 00000100:00100000:3.0:1787826301.921695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.921741:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.922036:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789780736 00000100:00100000:1.0:1787826301.922046:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789780736 00000100:00100000:1.0:1787826301.922107:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111405 00000100:00100000:1.0:1787826301.922117:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84219:x1874668789780736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.922136:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.922154:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b2ae lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe59 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.922260:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.922274:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe44 expref: 76 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.922284:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.922316:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe44 expref: 76 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.922330:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe44 expref: 76 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.922343:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778629888:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826301.922424:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.922442:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789780992 00000100:00100000:1.0:1787826301.922445:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789780992 00000100:00100000:1.0:1787826301.922469:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2673 00000100:00100000:1.0:1787826301.922476:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84218:x1874668789780992:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.922677:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84218:x1874668789780992:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 200us (934us total) trans 8590016503 rc 0/0 00000100:00100000:1.0:1787826301.922684:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2673 00000100:00100000:3.0:1787826301.922952:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.923313:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789781248 00000100:00100000:0.0:1787826301.923319:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789781248 00000100:00100000:1.0:1787826301.923533:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2674 00000100:00100000:1.0:1787826301.923543:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84217:x1874668789781248:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826301.923668:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84217:x1874668789781248:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 127us (716us total) trans 8590016504 rc 0/0 00000100:00100000:1.0:1787826301.923675:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2674 00000100:00100000:3.0:1787826301.925237:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.925751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789781376 00000100:00100000:0.0:1787826301.925759:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789781376 00000100:00100000:3.0:1787826301.925791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.925819:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111406 00000100:00100000:0.0:1787826301.925829:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84218:x1874668789781376:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.925846:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.926066:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b2bc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe60 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.926136:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b2c3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.926150:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.926165:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.926200:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778629888:192.168.203.9@tcp:104: 00000004:00200000:0.0:1787826301.926203:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x125:0x0]: returning size 0 00000004:00200000:0.0:1787826301.926207:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826301.926223:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.926223:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.926255:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b2bc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe60 expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.926273:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe60 expref: 80 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.926280:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826301.926283:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826301.926286:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:0.0:1787826301.927076:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84218:x1874668789781376:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1242us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.927086:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111406 00000100:00100000:0.0:1787826301.927126:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789781504 00000100:00100000:0.0:1787826301.927132:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789781504 00010000:00010000:0.0:1787826301.927156:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe44 expref: 80 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.927185:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3032 00000100:00100000:0.0:1787826301.927192:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789781504:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826301.927208:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.927214:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe44 expref: 80 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927227:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe44 expref: 80 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927245:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b284 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe44 expref: 80 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927259:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:0.0:1787826301.927264:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927274:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927283:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927305:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826301.927334:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2401:x1874668789781504:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 141us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.927341:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3032 00010000:00010000:0.0:1787826301.927361:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927369:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.927388:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x126:0x0]: returning size 0 00000004:00080000:0.0:1787826301.927539:0:25756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc2:0x0], index 0: 0 00010000:00010000:0.0:1787826301.927628:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927637:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927645:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927652:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826301.927656:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927665:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927675:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:0.0:1787826301.927677:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.927681:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927687:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b2b5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927725:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b2ae lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe59 expref: 79 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927736:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826301.927739:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826301.927743:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b2ae lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe59 expref: 79 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.927752:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7400, rc 0) 00000100:00100000:0.0:1787826301.927790:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84219:x1874668789780736:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5662us (6091us total) trans 8590016505 rc 301/301 00000100:00100000:0.0:1787826301.927797:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111405 00000100:00100000:0.0:1787826301.941078:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.941163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.942297:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789781760 00000100:00100000:3.0:1787826301.942309:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789781760 00000100:00100000:3.0:1787826301.942374:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111407 00000100:00100000:3.0:1787826301.942385:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe100392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84217:x1874668789781760:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826301.942507:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe100392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84217:x1874668789781760:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 124us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.942515:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111407 00000100:00100000:2.0:1787826301.945177:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789782016 00000100:00100000:2.0:1787826301.945190:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789782016 00000100:00100000:2.0:1787826301.945295:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2675 00000100:00100000:2.0:1787826301.945306:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84219:x1874668789782016:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826301.945613:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84219:x1874668789782016:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 308us (4448us total) trans 8590016506 rc 0/0 00000100:00100000:2.0:1787826301.945622:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2675 00000100:00100000:3.0:1787826301.953603:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826301.953648:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.953703:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789782400 00000100:00100000:1.0:1787826301.953714:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789782400 00000100:00100000:1.0:1787826301.953774:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6255 00000100:00100000:1.0:1787826301.953792:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2399:x1874668789782400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.953817:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.953839:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe6e expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826301.954162:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826301.954183:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=2940s v=(0 0) 00010000:00010000:1.0:1787826301.954188:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.954197:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe6e expref: 10 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.954216:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe6e expref: 10 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.954230:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826301.954294:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789782400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 503us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.954301:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6255 00000100:00100000:0.0:1787826301.954363:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789782272 00000100:00100000:0.0:1787826301.954368:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789782272 00000100:00100000:0.0:1787826301.954417:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111408 00000100:00100000:0.0:1787826301.954425:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84217:x1874668789782272:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.954437:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.954451:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b2d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe67 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.954548:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 3/0,1 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.954562:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe52 expref: 80 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.954570:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 4/0,1 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.954598:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe52 expref: 80 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.954613:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe52 expref: 80 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.954625:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cb92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778630016:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826301.954689:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.957914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.958052:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789782528 00000100:00100000:0.0:1787826301.958061:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789782528 00000100:00100000:0.0:1787826301.958121:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111409 00000100:00100000:0.0:1787826301.958131:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84219:x1874668789782528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.958152:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.958172:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b2e6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe75 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.958236:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b2ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.958250:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b2ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.958261:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b2ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826301.958302:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x126:0x0]: returning size 0 00000004:00200000:0.0:1787826301.958306:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826301.958324:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b2ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.958348:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b2e6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe75 expref: 83 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.958367:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b2ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe75 expref: 82 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.958375:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:0.0:1787826301.958378:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826301.958381:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:0.0:1787826301.958445:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84219:x1874668789782528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 316us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.958452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111409 00000100:00100000:1.0:1787826301.964124:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.964289:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789782656 00000100:00100000:0.0:1787826301.964299:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789782656 00000100:00100000:0.0:1787826301.964357:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6256 00000100:00100000:0.0:1787826301.964368:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789782656:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826301.964384:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.964403:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe7c expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826301.964439:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826301.964457:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=2940s v=(0 0) 00010000:00010000:0.0:1787826301.964462:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.964470:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe7c expref: 14 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.964487:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe7c expref: 14 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.964505:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3200, rc 0) 00000100:00100000:0.0:1787826301.964567:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789782656:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 201us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.964575:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6256 00000100:00100000:0.0:1787826301.966032:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cb92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778630016:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826301.966058:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 3/0,1 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.972055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.972146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.972384:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789783040 00000100:00100000:0.0:1787826301.972393:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789783040 00010000:00010000:0.0:1787826301.972457:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe52 expref: 82 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.972497:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3033 00000100:00100000:0.0:1787826301.972506:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2401:x1874668789783040:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826301.972523:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.972530:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe52 expref: 82 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.972542:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe52 expref: 82 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.972563:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349b2a0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe52 expref: 82 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.972584:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:0.0:1787826301.972589:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 3/0,1 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.972600:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.972607:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.974010:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826301.974080:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2401:x1874668789783040:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1571us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.974091:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3033 00000100:00100000:3.0:1787826301.974244:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789782912 00000100:00100000:3.0:1787826301.974251:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789782912 00000100:00100000:3.0:1787826301.974297:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111410 00000100:00100000:3.0:1787826301.974305:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84218:x1874668789782912:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826301.974371:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84218:x1874668789782912:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 67us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.974378:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111410 00010000:00010000:2.0:1787826301.977159:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977175:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.977199:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x127:0x0]: returning size 0 00000004:00080000:2.0:1787826301.977352:0:25759:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc3:0x0], index 1: 0 00010000:00010000:2.0:1787826301.977469:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977478:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977484:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977491:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826301.977495:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977502:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977516:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:2.0:1787826301.977519:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826301.977524:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 2/0,0 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977530:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b2df lrc: 0/0,0 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977585:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b2d8 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe67 expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977596:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826301.977598:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826301.977602:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b2d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe67 expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.977612:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:2.0:1787826301.978180:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84217:x1874668789782272:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 23752us (24583us total) trans 8590016507 rc 301/301 00000100:00100000:2.0:1787826301.978190:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111408 00000100:00100000:1.0:1787826301.985745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.986028:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789783296 00000100:00100000:0.0:1787826301.986038:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789783296 00000100:00100000:0.0:1787826301.986107:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111411 00000100:00100000:0.0:1787826301.986118:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84219:x1874668789783296:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.986221:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84219:x1874668789783296:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 104us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.986228:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111411 00000100:00100000:1.0:1787826301.986549:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.986631:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789783424 00000100:00100000:2.0:1787826301.986635:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789783424 00000100:00100000:2.0:1787826301.986674:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6257 00000100:00100000:2.0:1787826301.986682:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84218:x1874668789783424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826301.986693:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.986709:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe83 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.986736:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe6e expref: 11 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.986744:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.986749:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.986754:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 11 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.986798:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe6e expref: 11 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.986820:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe6e expref: 11 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.986834:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778630144:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826301.986931:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.988141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.988211:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789783680 00000100:00100000:0.0:1787826301.988217:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789783680 00000100:00100000:0.0:1787826301.988263:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2676 00000100:00100000:0.0:1787826301.988271:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84217:x1874668789783680:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826301.988525:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84217:x1874668789783680:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 254us (388us total) trans 8590016508 rc 0/0 00000100:00100000:0.0:1787826301.988534:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2676 00000100:00100000:3.0:1787826301.991266:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826301.991352:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789783808 00000100:00100000:1.0:1787826301.991361:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789783808 00000100:00100000:1.0:1787826301.991422:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6258 00000100:00100000:1.0:1787826301.991432:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84219:x1874668789783808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826301.991448:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.991466:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe8a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.991495:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe7c expref: 15 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.991504:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.991508:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826301.991514:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 15 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.991544:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe7c expref: 15 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.991557:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe7c expref: 15 pid: 45681 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.991576:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778630272:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826301.991654:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.997477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826301.997654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826301.998905:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789784064 00000100:00100000:0.0:1787826301.998915:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789784064 00010000:00010000:0.0:1787826301.998962:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe7c expref: 16 pid: 45681 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.999010:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3034 00000100:00100000:0.0:1787826301.999020:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789784064:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826301.999035:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.999057:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe7c expref: 16 pid: 45681 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.999072:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe7c expref: 16 pid: 45681 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.999098:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.999103:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826301.999112:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 16 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.999122:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 16 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.999159:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 16 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.999181:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cb92c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778630400:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826301.999260:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787826302.000193:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349b2f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe7c expref: 16 pid: 45681 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.000212:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778630272:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826302.000242:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 15 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.000255:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:3.0:1787826302.000294:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:84219:x1874668789783808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 8863us (9036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.000306:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6258 00000100:00100000:3.0:1787826302.003778:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.003825:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778630144:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.003844:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789784192 00000100:00100000:0.0:1787826302.003865:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789784192 00010000:00010000:2.0:1787826302.003887:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 12 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.003895:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe6e expref: 12 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.003905:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:0.0:1787826302.003925:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3035 00000100:00100000:0.0:1787826302.003934:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789784192:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.003948:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.003967:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe6e expref: 12 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.003980:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe6e expref: 12 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.004003:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b2d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe6e expref: 12 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.004008:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789783936 00000100:00100000:1.0:1787826302.004012:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789783936 00010000:00010000:0.0:1787826302.004028:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.004032:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.004040:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 11 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.004052:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111412 00010000:00010000:0.0:1787826302.004056:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 11 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.004059:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84217:x1874668789783936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.004076:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.004085:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 11 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.004092:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b310 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe91 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.004096:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778630528:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826302.004148:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b317 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.004161:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b317 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.004170:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b317 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826302.004210:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x127:0x0]: returning size 0 00000004:00200000:1.0:1787826302.004214:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826302.004233:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b317 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.004254:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b310 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe91 expref: 83 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.004270:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b317 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe91 expref: 82 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.004277:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:1.0:1787826302.004280:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826302.004283:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:1.0:1787826302.004324:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84217:x1874668789783936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 265us (6856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.004331:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111412 00000100:00080000:1.0:1787826302.004353:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826302.007111:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84218:x1874668789783424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 20419us (20552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.007122:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6257 00000100:00100000:1.0:1787826302.009013:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cb92c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778630400:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826302.009040:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826302.009082:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789784064:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 10064us (11428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.009091:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3034 00000100:00100000:0.0:1787826302.012929:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.031777:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778630528:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826302.031818:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826302.031913:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789784192:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 27978us (28143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.031924:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3035 00000100:00100000:2.0:1787826302.051159:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.051216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.051258:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.051353:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789784448 00000100:00100000:3.0:1787826302.051363:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789784448 00000100:00100000:0.0:1787826302.051384:0:45401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789784576 00000100:00100000:0.0:1787826302.051389:0:45401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789784576 00002000:00100000:0.0:1787826302.051423:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->157) req@ffff9bbe1283e580 x1874668789784576/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/0 e 0 to 0 dl 1787826313 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826302.051423:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xc2:0x0] (0->157) req@ffff9bbe1283f840 x1874668789784448/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/0 e 0 to 0 dl 1787826313 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826302.051435:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283e580 with x1874668789784576 ext(0->157) 00002000:00100000:3.0:1787826302.051435:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283f840 with x1874668789784448 ext(0->157) 00002000:00010000:0.0:1787826302.051441:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1283e580 00002000:00010000:3.0:1787826302.051441:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe1283f840 00000100:00100000:1.0:1787826302.051498:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789784320 00000100:00100000:1.0:1787826302.051503:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789784320 00000100:00100000:1.0:1787826302.051536:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6259 00000100:00100000:1.0:1787826302.051544:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789784320:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.051558:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.051578:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe98 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826302.051602:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826302.051621:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=2940s v=(0 0) 00010000:00010000:1.0:1787826302.051625:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.051634:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe98 expref: 12 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.051651:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe98 expref: 12 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.051665:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826302.051721:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789784320:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 177us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.051728:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6259 00000100:00100000:3.0:1787826302.051815:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1573 00000100:00100000:3.0:1787826302.051824:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789784448:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.053311:0:45401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1574 00000100:00100000:1.0:1787826302.053326:0:45401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789784576:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.054050:0:45401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789784576:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 726us (2788us total) trans 4294968162 rc 0/0 00000100:00100000:1.0:1787826302.054059:0:45401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1574 00002000:00100000:1.0:1787826302.054069:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->157) req@ffff9bbe1283e580 x1874668789784576/t4294968162(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/448 e 0 to 0 dl 1787826313 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826302.054079:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283e580 with x1874668789784576 ext(0->157) 00002000:00010000:1.0:1787826302.054085:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1283e580 00000100:00100000:1.0:1787826302.057541:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789784448:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 5706us (6380us total) trans 4294968180 rc 0/0 00000100:00100000:1.0:1787826302.057556:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1573 00002000:00100000:1.0:1787826302.057570:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xc2:0x0] (0->157) req@ffff9bbe1283f840 x1874668789784448/t4294968180(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/448 e 0 to 0 dl 1787826313 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826302.057581:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283f840 with x1874668789784448 ext(0->157) 00002000:00010000:1.0:1787826302.057588:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe1283f840 00000100:00100000:3.0:1787826302.064191:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.064391:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789784704 00000100:00100000:2.0:1787826302.064402:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789784704 00000100:00100000:2.0:1787826302.064520:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111413 00000100:00100000:2.0:1787826302.064530:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84218:x1874668789784704:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.065614:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.066031:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.066389:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789784960 00000100:00100000:0.0:1787826302.066397:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789784960 00000100:00100000:0.0:1787826302.066459:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111414 00000100:00100000:0.0:1787826302.066469:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84217:x1874668789784960:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000001:00080000:1.0:1787826302.066515:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016508 is committed 00010000:00010000:0.0:1787826302.066540:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066551:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066558:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826302.066559:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0a7cf540 refcount 2 committed 0 result 0 batchid 4294970888 00000020:00080000:1.0:1787826302.066563:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe02206600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe134b2300 00010000:00010000:0.0:1787826302.066564:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00000020:00080000:1.0:1787826302.066567:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf07378a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d246200 00010000:00010000:0.0:1787826302.066569:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066576:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826302.066577:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbf0f76ce40 refcount 2 committed 0 result 0 batchid 4294970887 00000020:00080000:1.0:1787826302.066580:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf07378900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf0f76cc00 00000020:00080000:1.0:1787826302.066583:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf07378200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f95ce00 00010000:00010000:0.0:1787826302.066592:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x122:0x0].0x0 (ffff9bbe0fe8c500) 00010000:00010000:0.0:1787826302.066595:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.066600:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826302.066601:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbf06ec9cc0 refcount 2 committed 0 result 0 batchid 4294970886 00000020:00080000:1.0:1787826302.066604:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf07cd7600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf06ec9300 00010000:00010000:0.0:1787826302.066607:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b0b6 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x122:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826302.066607:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf07cd7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f95c000 00000020:00080000:1.0:1787826302.066619:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970885 batchid updated 00010000:00010000:0.0:1787826302.066629:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826302.066632:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970888 committed batchid 4294970885 00010000:00010000:0.0:1787826302.066635:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066640:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066644:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.066648:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066653:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066660:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x123:0x0].0x0 (ffff9bbe0fe8ca00) 00010000:00010000:0.0:1787826302.066662:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.066664:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066669:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b0c4 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x123:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066680:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066686:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066691:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826302.066693:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970885 00010000:00010000:0.0:1787826302.066696:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.066698:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066704:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066710:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x124:0x0].0x0 (ffff9bbe0fe8c200) 00010000:00010000:0.0:1787826302.066712:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.066715:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066720:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b0cb lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x124:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066730:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066736:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066741:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066746:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.066748:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066753:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066760:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826302.066761:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826302.066764:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066769:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b245 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.066783:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84218:x1874668789784704:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 2254us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.066791:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111413 00010000:00010000:0.0:1787826302.066793:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066803:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066817:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066823:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.066826:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066839:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.066847:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00000100:00100000:2.0:1787826302.067367:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84217:x1874668789784960:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 897us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.067376:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111414 00010000:00010000:0.0:1787826302.067451:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826302.067457:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.067465:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b26f lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.067482:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.067488:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.067494:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.067498:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.067502:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.067508:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.067517:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:0.0:1787826302.067520:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826302.067522:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.067528:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b28b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.069726:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.069888:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789785216 00000100:00100000:1.0:1787826302.069899:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789785216 00000100:00100000:1.0:1787826302.071672:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6260 00000100:00100000:1.0:1787826302.071692:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789785216:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.073893:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.073947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789785088 00000100:00100000:0.0:1787826302.073956:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789785088 00000100:00100000:0.0:1787826302.074028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111415 00000100:00100000:0.0:1787826302.074039:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84219:x1874668789785088:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.074155:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84219:x1874668789785088:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 117us (8123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.074163:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111415 00000001:00080000:3.0:1787826302.075456:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968162 is committed 00000001:00080000:3.0:1787826302.075470:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968161 is committed 00000100:00100000:3.0:1787826302.075547:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789785216:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 3861us (5828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.075556:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6260 00000100:00100000:3.0:1787826302.075698:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789785344 00000100:00100000:3.0:1787826302.075703:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789785344 00000100:00100000:3.0:1787826302.075731:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6261 00000100:00100000:3.0:1787826302.075738:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84217:x1874668789785344:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.075750:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.075766:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbe9f expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.076027:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe98 expref: 11 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.076040:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.076044:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.076050:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 11 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.076081:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe98 expref: 11 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.076094:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe98 expref: 11 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.076108:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bf840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778630656:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826302.076159:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c66dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.080096:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.080133:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.080161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.080663:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bf840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778630656:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.080700:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 11 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.080720:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:0.0:1787826302.080781:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84217:x1874668789785344:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5042us (6896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.080793:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6261 00000100:00100000:0.0:1787826302.080831:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789785728 00000100:00100000:0.0:1787826302.080837:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789785728 00000100:00100000:0.0:1787826302.080902:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6262 00000100:00100000:0.0:1787826302.080910:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789785728:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.082400:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789785600 00000100:00100000:2.0:1787826302.082420:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789785600 00000100:00100000:2.0:1787826302.082474:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111416 00000100:00100000:2.0:1787826302.082483:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84218:x1874668789785600:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.082531:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.082557:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b2c3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x125:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe60 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.082576:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826302.082582:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826302.082611:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.082624:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.082638:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826302.082751:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e635a0fe reply state 000000009d9ae110 transno 8590016509 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.082764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.082770:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826302.082772:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826302.082774:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826302.082905:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84218:x1874668789785600:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 422us (2818us total) trans 8590016509 rc 0/0 00000100:00100000:2.0:1787826302.082912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111416 00000100:00100000:1.0:1787826302.083437:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789785856 00000100:00100000:1.0:1787826302.083443:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789785856 00010000:00010000:1.0:1787826302.083472:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe98 expref: 11 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.083510:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3036 00000100:00100000:1.0:1787826302.083518:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789785856:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826302.083533:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826302.083554:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe98 expref: 11 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.083567:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe98 expref: 11 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.083589:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349b31e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe98 expref: 11 pid: 19335 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.083603:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.083607:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.083614:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.083624:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.083661:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.083674:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8de1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778630784:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826302.083735:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4300 going to sleep for 11 seconds 00000001:00080000:1.0:1787826302.086225:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968180 is committed 00000001:00080000:1.0:1787826302.086243:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968179 is committed 00000100:00100000:0.0:1787826302.086393:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789785728:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 5478us (6253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.086412:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6262 00000100:00100000:3.0:1787826302.096046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.096128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.096215:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789785984 00000100:00100000:0.0:1787826302.096223:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789785984 00000100:00100000:0.0:1787826302.096275:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789786240 00000100:00100000:0.0:1787826302.096278:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789786240 00000100:00100000:0.0:1787826302.096303:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111417 00000100:00100000:0.0:1787826302.096312:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a106580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84218:x1874668789785984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.096337:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.096358:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbea6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.096426:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbea6 expref: 34 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.096440:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbea6 expref: 34 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.096459:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826302.096462:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826302.096467:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826302.096523:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a106580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84218:x1874668789785984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 211us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.096530:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111417 00000100:00100000:0.0:1787826302.096547:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111418 00000100:00100000:0.0:1787826302.096553:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84219:x1874668789786240:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.096587:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.096605:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b2ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x126:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe75 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.096620:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:0.0:1787826302.096623:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826302.096644:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.096652:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.096660:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826302.096760:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5736062 reply state 000000002eee3f2b transno 8590016510 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.096773:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.096780:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:0.0:1787826302.096782:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826302.096785:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826302.096837:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84219:x1874668789786240:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 284us (709us total) trans 8590016510 rc 0/0 00000100:00100000:0.0:1787826302.096844:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111418 00000100:00100000:1.0:1787826302.100171:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8de1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778630784:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826302.100203:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826302.100315:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789785856:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 16796us (20151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.100326:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3036 00000100:00100000:3.0:1787826302.106225:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.106322:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789786368 00000100:00100000:2.0:1787826302.106332:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789786368 00002000:00100000:2.0:1787826302.106381:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->157) req@ffff9bbe0a106940 x1874668789786368/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/0 e 0 to 0 dl 1787826313 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826302.106398:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a106940 with x1874668789786368 ext(0->157) 00002000:00010000:2.0:1787826302.106411:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a106940 00000100:00100000:2.0:1787826302.106490:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1575 00000100:00100000:2.0:1787826302.106499:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a106940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789786368:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.107543:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a106940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789786368:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1039us (1324us total) trans 4294968163 rc 0/0 00000100:00100000:2.0:1787826302.107555:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1575 00002000:00100000:2.0:1787826302.107565:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->157) req@ffff9bbe0a106940 x1874668789786368/t4294968163(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/448 e 0 to 0 dl 1787826313 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826302.107574:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a106940 with x1874668789786368 ext(0->157) 00002000:00010000:2.0:1787826302.107579:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0a106940 00000100:00100000:3.0:1787826302.111023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.111416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.111499:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789786624 00000100:00100000:1.0:1787826302.111509:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789786624 00000100:00100000:1.0:1787826302.111564:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6263 00000100:00100000:1.0:1787826302.111574:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789786624:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826302.111712:0:45681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826302.111715:0:45681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb mtime from disk: 0 -> 1787826221 00002000:00010000:1.0:1787826302.111718:0:45681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb atime from disk: 0 -> 1787826221 00002000:00010000:1.0:1787826302.111720:0:45681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb ctime from disk: 0 -> 1787826221 00002000:00010000:1.0:1787826302.111722:0:45681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826302.111775:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789786624:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 202us (370us total) trans 4294968164 rc 0/0 00000100:00100000:1.0:1787826302.111783:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6263 00000100:00100000:3.0:1787826302.114551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.116763:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789786496 00000100:00100000:3.0:1787826302.116812:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.117039:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789786880 00000100:00100000:1.0:1787826302.117044:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789786880 00000100:00100000:2.0:1787826302.117075:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789786496 00000100:00100000:1.0:1787826302.117090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789787008 00000100:00100000:1.0:1787826302.117093:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789787008 00000100:00100000:2.0:1787826302.117106:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111419 00000100:00100000:1.0:1787826302.117112:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111420 00000100:00100000:2.0:1787826302.117115:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84218:x1874668789786880:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.117117:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84219:x1874668789786496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.117135:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.117155:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbead expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.117167:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.117179:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe28 expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.117187:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.117195:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbead expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.117207:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbead expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.117216:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe28 expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.117223:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:1.0:1787826302.117226:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.117228:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe28 expref: 37 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.117229:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:2.0:1787826302.117244:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778630912:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826302.117277:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84219:x1874668789786496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 159us (6264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.117290:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.117367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111420 00000100:00100000:2.0:1787826302.117372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111421 00000100:00100000:2.0:1787826302.117380:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84217:x1874668789787008:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.117462:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84217:x1874668789787008:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 83us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.117469:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111421 00000100:00100000:3.0:1787826302.123627:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.124090:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778630912:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.124115:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.124211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.124423:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789787136 00000100:00100000:0.0:1787826302.124430:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789787136 00000100:00100000:1.0:1787826302.124453:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789787264 00000100:00100000:1.0:1787826302.124457:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789787264 00010000:00010000:0.0:1787826302.124468:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe28 expref: 36 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.124493:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6264 00000100:00100000:0.0:1787826302.124495:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3037 00000100:00100000:0.0:1787826302.124502:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789787136:12345-192.168.203.9@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787826302.124502:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789787264:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.124516:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.124522:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe28 expref: 36 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.124533:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe28 expref: 36 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.124553:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b230 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x125:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe28 expref: 36 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.124569:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826302.124573:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.124583:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.124592:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.124624:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826302.124699:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.124707:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.124742:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.124749:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.124755:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.124761:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.124765:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.124772:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.124781:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:1.0:1787826302.124784:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826302.124788:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.124795:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b348 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.127618:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2402:x1874668789787136:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2784us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.127633:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3037 00000100:00100000:1.0:1787826302.129835:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84218:x1874668789786880:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 12711us (15283us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826302.129864:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111419 00000100:00100000:2.0:1787826302.130528:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.130578:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789787392 00000100:00100000:0.0:1787826302.130588:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789787392 00000100:00100000:0.0:1787826302.130642:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6265 00000100:00100000:0.0:1787826302.130652:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789787392:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1787826302.130767:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968164 is committed 00002000:00010000:0.0:1787826302.130843:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826302.130847:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb mtime from disk: 0 -> 1787826221 00000100:00100000:3.0:1787826302.131004:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789787264:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 6501us (6792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.131022:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6264 00002000:00010000:0.0:1787826302.131159:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb atime from disk: 0 -> 1787826221 00002000:00010000:0.0:1787826302.131161:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb ctime from disk: 0 -> 1787826221 00002000:00010000:0.0:1787826302.131163:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826302.131190:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789787392:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 539us (662us total) trans 4294968181 rc 0/0 00000100:00100000:0.0:1787826302.131197:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6265 00000100:00100000:2.0:1787826302.133457:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.133499:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.133556:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789787520 00000100:00100000:2.0:1787826302.133564:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.133565:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789787520 00000100:00100000:0.0:1787826302.133617:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6266 00000100:00100000:0.0:1787826302.133626:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789787520:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.133644:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789787776 00000100:00100000:1.0:1787826302.133648:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789787776 00010000:00010000:0.0:1787826302.133664:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.133694:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 10 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.133713:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.133717:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826302.133721:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.133755:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 10 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.133769:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 10 pid: 8605 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.133793:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778631040:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826302.133825:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789788032 00000100:00100000:1.0:1787826302.133828:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789788032 00000100:00100000:0.0:1787826302.133951:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826302.133961:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111422 00000100:00100000:0.0:1787826302.133971:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111423 00000100:00100000:2.0:1787826302.133971:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84219:x1874668789787776:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.133977:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84217:x1874668789788032:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.134004:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.134021:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.134025:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b317 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x127:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe91 expref: 35 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.134033:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe36 expref: 34 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.134039:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:2.0:1787826302.134041:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.134044:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826302.134060:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe36 expref: 34 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.134062:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.134070:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe36 expref: 34 pid: 45682 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.134072:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.134080:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb5a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778631168:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.134081:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.134105:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d840 going to sleep for 11 seconds 00000004:00010000:0.0:1787826302.134529:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a893cea1 reply state 00000000b1ebc54c transno 8590016511 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.134542:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.134549:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:0.0:1787826302.134552:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826302.134555:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826302.134622:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84217:x1874668789788032:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 644us (1056us total) trans 8590016511 rc 0/0 00000100:00100000:0.0:1787826302.134630:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111423 00000100:00100000:3.0:1787826302.139242:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.139333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.139437:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789788160 00000100:00100000:1.0:1787826302.139446:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789788160 00000100:00100000:1.0:1787826302.139498:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111424 00000100:00100000:1.0:1787826302.139508:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84217:x1874668789788160:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.139529:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.139550:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbeb4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.139607:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeb4 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.139621:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeb4 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.139639:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:1.0:1787826302.139641:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826302.139645:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7200, rc 0) 00000100:00100000:1.0:1787826302.139705:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84217:x1874668789788160:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 198us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.139712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111424 00000100:00100000:0.0:1787826302.140756:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778631040:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.141344:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.141458:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789788288 00000100:00100000:2.0:1787826302.141464:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789788288 00010000:00010000:2.0:1787826302.141501:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 11 pid: 8605 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.141528:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3038 00000100:00100000:2.0:1787826302.141536:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40510c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789788288:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826302.141548:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.141568:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 11 pid: 8605 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.141580:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 11 pid: 8605 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.141602:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a89e4736/0x68019081f349b302 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe83 expref: 11 pid: 8605 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.141622:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826302.141626:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826302.141632:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.141641:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.141666:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826302.141713:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40510c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789788288:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 177us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.141721:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3038 00010000:00010000:3.0:1787826302.144848:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.144907:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.144938:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.144946:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.144954:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.144961:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826302.144966:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.144980:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.144999:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.145006:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349b34f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.145111:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789787520:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 11482us (11656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.145121:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6266 00000100:00100000:0.0:1787826302.145412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.145597:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb5a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778631168:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.145621:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.145805:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789788416 00000100:00100000:3.0:1787826302.145812:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789788416 00010000:00010000:3.0:1787826302.145844:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe36 expref: 37 pid: 45682 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.145986:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3039 00000100:00100000:3.0:1787826302.145996:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2400:x1874668789788416:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.146009:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.146016:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe36 expref: 37 pid: 45682 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.146027:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe36 expref: 37 pid: 45682 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.146051:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b25a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x126:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe36 expref: 37 pid: 45682 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.146064:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:3.0:1787826302.146069:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.146079:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.146085:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.146106:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.146131:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2400:x1874668789788416:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 137us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.146138:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3039 00010000:00010000:2.0:1787826302.146463:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.146471:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.146508:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.146515:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.146525:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.146530:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.146533:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.146540:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.146550:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:2.0:1787826302.146553:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826302.146556:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.146562:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b356 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.146601:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84219:x1874668789787776:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 12632us (13101us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826302.146609:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111422 00000100:00100000:3.0:1787826302.146932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.147009:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789788544 00000100:00100000:2.0:1787826302.147014:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789788544 00000100:00100000:2.0:1787826302.147052:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6267 00000100:00100000:2.0:1787826302.147060:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2399:x1874668789788544:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826302.147197:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826302.147201:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb mtime from disk: 0 -> 1787826220 00002000:00010000:2.0:1787826302.147203:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb atime from disk: 0 -> 1787826220 00002000:00010000:2.0:1787826302.147206:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb ctime from disk: 0 -> 1787826220 00002000:00010000:2.0:1787826302.147207:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826302.147243:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789788544:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 184us (368us total) trans 4294968165 rc 0/0 00000100:00100000:2.0:1787826302.147250:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6267 00000100:00100000:3.0:1787826302.149248:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.149364:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789788800 00000100:00100000:0.0:1787826302.149371:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789788800 00000100:00100000:0.0:1787826302.149435:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111425 00000100:00100000:0.0:1787826302.149444:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84218:x1874668789788800:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.149510:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.149532:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.149542:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.149688:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.149700:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbea6 expref: 36 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.149708:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.149739:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbea6 expref: 36 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.149753:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbea6 expref: 36 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.149767:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1607ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778631296:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826302.150147:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826302.150326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.150643:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789788928 00000100:00100000:3.0:1787826302.150648:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789788928 00000100:00100000:3.0:1787826302.150692:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6268 00000100:00100000:3.0:1787826302.150701:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789788928:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.150729:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.150747:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.150756:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.150760:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826302.150764:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.151290:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.151304:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 13 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.151316:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db75680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778631424:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826302.151376:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c66dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.151463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.153378:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789789184 00000100:00100000:3.0:1787826302.153390:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789789184 00000100:00100000:3.0:1787826302.153462:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111426 00000100:00100000:3.0:1787826302.153473:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84217:x1874668789789184:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.153535:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.153551:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe3d expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.153559:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.153592:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe3d expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.153603:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe3d expref: 37 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.153615:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db76580 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778631552:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826302.153690:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c66d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.154524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.154548:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.154568:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789789312 00000100:00100000:0.0:1787826302.154573:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789789312 00010000:00010000:0.0:1787826302.154595:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbea6 expref: 38 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.154616:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789789440 00000100:00100000:0.0:1787826302.154618:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789789440 00010000:00010000:0.0:1787826302.154628:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 14 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.154648:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3040 00000100:00100000:0.0:1787826302.154654:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789789312:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.154664:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.154670:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbea6 expref: 38 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.154682:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbea6 expref: 38 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.154703:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826302.154708:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.154717:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.154724:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.154741:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826302.154755:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b333 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbea6 expref: 38 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.154769:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789789312:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 115us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.154776:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1607ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778631296:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.154792:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3040 00010000:00010000:1.0:1787826302.154796:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.154812:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.154814:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3041 00010000:00010000:1.0:1787826302.154819:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.154821:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789789440:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.154830:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.154847:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 14 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.154886:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 14 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.154903:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826302.154907:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826302.154911:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.154919:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.154931:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826302.154949:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789789440:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 129us (400us total) trans 0 rc 0/0 00000001:00080000:1.0:1787826302.154949:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016512 00000100:00100000:0.0:1787826302.154960:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3041 00000001:00080000:1.0:1787826302.155060:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016513 00000001:00080000:1.0:1787826302.155099:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016514 00000100:00100000:1.0:1787826302.155165:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778631680:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787826302.155218:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.155236:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56180 going to sleep for 11 seconds 00010000:00010000:3.0:1787826302.155564:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000077a45e0/0x68019081f349b309 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe8a expref: 13 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.155577:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db75680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778631424:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826302.155590:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.155600:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.155606:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.155626:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.155634:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.155643:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.155651:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826302.155655:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.155663:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.155675:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.155682:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f9cde1f/0x68019081f349b379 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.155744:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789788928:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 5043us (5418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.155752:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6268 00000100:00100000:2.0:1787826302.155972:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778631680 00000100:00100000:2.0:1787826302.155977:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778631680 00000100:00100000:2.0:1787826302.156012:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3336 00000100:00100000:2.0:1787826302.156019:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778631680:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787826302.156104:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778631680:12345-0@lo:1000:mdt00_004.0 Request processed in 85us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.156111:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3336 00000100:00100000:1.0:1787826302.156171:0:12105:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968161 gen 2 00000004:00080000:1.0:1787826302.156176:0:12105:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968161 committed transno 4294968161 00000100:00100000:1.0:1787826302.156194:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778631680:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1787826302.156298:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016515 00000100:00100000:1.0:1787826302.156346:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778631808:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787826302.156376:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.156393:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.156566:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778631808 00000100:00100000:3.0:1787826302.156571:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778631808 00000100:00100000:3.0:1787826302.156607:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3337 00000100:00100000:3.0:1787826302.156613:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778631808:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826302.156711:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:12105:x1874668778631808:12345-0@lo:1000:mdt00_004.0 Request processed in 98us (334us total) trans 4294968166 rc 0/0 00000100:00100000:3.0:1787826302.156718:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3337 00000100:00100000:2.0:1787826302.156900:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778631808:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787826302.156955:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016516 00010000:00010000:2.0:1787826302.156981:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.156991:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.156997:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157003:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.157007:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157014:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157028:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:2.0:1787826302.157031:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.157034:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157040:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b372 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157060:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349913d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157067:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349913d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157072:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349913d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157078:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.157081:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349913d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157086:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349913d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157093:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf3:0x0].0x0 (ffff9bbe16cc5700) 00010000:00010000:2.0:1787826302.157095:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.157098:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349913d lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157103:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349913d lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157131:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157142:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157150:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157156:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157161:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157166:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157170:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.157173:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157620:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157633:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf3:0x0].0x0 (ffff9bbe16cc5700) 00010000:00010000:2.0:1787826302.157636:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.157639:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157645:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b387 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157656:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157662:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157668:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157673:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.157676:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157681:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157688:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf3:0x0].0x0 (ffff9bbe16cc5700) 00010000:00010000:2.0:1787826302.157690:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826302.157693:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.157699:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b36b lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.158112:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84218:x1874668789788800:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 8666us (8866us total) trans 8590016517 rc 0/0 00000100:00100000:2.0:1787826302.158122:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111425 00000020:00080000:2.0:1787826302.158126:0:12105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:2.0:1787826302.160498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.160557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.160637:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789789696 00000100:00100000:1.0:1787826302.160646:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789789696 00000100:00100000:1.0:1787826302.160704:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111427 00000100:00100000:1.0:1787826302.160714:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84219:x1874668789789696:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.160793:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.160810:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.160821:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.160992:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.161003:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbead expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.161019:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.161044:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbead expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.161053:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbead expref: 42 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.161063:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778631936:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826302.161118:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf40437780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.161376:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789789824 00000100:00100000:0.0:1787826302.161381:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789789824 00010000:00010000:0.0:1787826302.161415:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe3d expref: 43 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.161450:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3042 00000100:00100000:0.0:1787826302.161458:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2402:x1874668789789824:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.161468:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.161474:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe3d expref: 43 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.161486:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe3d expref: 43 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.161503:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:0.0:1787826302.161509:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.161518:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.161525:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.161540:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826302.161566:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2402:x1874668789789824:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 109us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.161572:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3042 00010000:00010000:2.0:1787826302.161984:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b27d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x127:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe3d expref: 42 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.162001:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db76580 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778631552:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.162145:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.162155:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.162161:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.162190:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.162197:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.162203:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.162208:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.162212:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.162219:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.162230:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:2.0:1787826302.162233:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826302.162238:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.162243:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b380 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.162341:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84217:x1874668789789184:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 8816us (10824us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826302.162349:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111426 00000100:00100000:0.0:1787826302.163448:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.163518:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789790080 00000100:00100000:2.0:1787826302.163525:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789790080 00000100:00100000:2.0:1787826302.163568:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2677 00000100:00100000:2.0:1787826302.163577:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84218:x1874668789790080:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826302.163809:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x125:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826302.163842:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016519 00010000:00010000:2.0:1787826302.164089:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.164104:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.164113:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.164120:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.164126:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.164132:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.164151:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826302.164265:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84218:x1874668789790080:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 689us (820us total) trans 8590016520 rc 0/0 00000100:00100000:2.0:1787826302.164274:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2677 00000020:00080000:2.0:1787826302.164279:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826302.164394:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826302.164402:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.164419:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826302.164422:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.164431:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.164442:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:3.0:1787826302.164445:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826302.164449:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 1/0,0 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.164454:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b39c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x125:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.164466:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826302.164467:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826302.164469:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826302.165233:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.165515:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778631936:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826302.165538:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.166083:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789790208 00000100:00100000:2.0:1787826302.166090:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789790208 00010000:00010000:2.0:1787826302.166121:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbead expref: 43 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.166246:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3043 00000100:00100000:2.0:1787826302.166256:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2402:x1874668789790208:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826302.166281:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.166288:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbead expref: 43 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.166300:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbead expref: 43 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.166320:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b341 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbead expref: 43 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.166334:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:2.0:1787826302.166339:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.166348:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.166357:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.166385:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826302.166448:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+42:2402:x1874668789790208:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 193us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.166456:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3043 00010000:00010000:0.0:1787826302.166506:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.166517:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826302.166610:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016518 00000001:00080000:0.0:1787826302.166718:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016521 00000001:00080000:0.0:1787826302.166754:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016522 00000100:00100000:0.0:1787826302.166876:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10038b40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778632064:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826302.166926:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.166960:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778632064 00000100:00100000:0.0:1787826302.166964:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778632064 00000100:00100000:0.0:1787826302.167000:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3338 00000100:00100000:0.0:1787826302.167008:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778632064:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826302.167070:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778632064:12345-0@lo:1000:mdt00_005.0 Request processed in 63us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.167076:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3338 00000100:00100000:0.0:1787826302.167095:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.167110:0:23845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968179 gen 2 00000004:00080000:0.0:1787826302.167115:0:23845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968178 committed transno 4294968179 00000004:00080000:0.0:1787826302.167129:0:23845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968179 committed transno 4294968179 00000100:00100000:0.0:1787826302.167141:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10038b40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778632064:0@lo:1000:mdt00_005.0 00000001:00080000:0.0:1787826302.167232:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016523 00000100:00100000:0.0:1787826302.167268:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a1680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778632192:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826302.167291:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.167313:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.167365:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778632192 00000100:00100000:3.0:1787826302.167370:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778632192 00000100:00100000:3.0:1787826302.167413:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3339 00000100:00100000:3.0:1787826302.167421:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:23845:x1874668778632192:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787826302.167513:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:23845:x1874668778632192:12345-0@lo:1000:mdt00_005.0 Request processed in 93us (220us total) trans 4294968182 rc 0/0 00000100:00100000:3.0:1787826302.167520:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3339 00000100:00100000:0.0:1787826302.167678:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a1680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:23845:1874668778632192:0@lo:1000:mdt00_005.0 00000001:00080000:0.0:1787826302.167723:0:23845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016524 00010000:00010000:0.0:1787826302.167747:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167755:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167762:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167767:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.167771:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167778:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167790:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:0.0:1787826302.167793:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826302.167798:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167889:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b395 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167912:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f3499144 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167918:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f3499144 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167925:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f3499144 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167934:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ec00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.167938:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f3499144 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167944:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f3499144 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167952:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf4:0x0].0x0 (ffff9bbe16cc5100) 00010000:00010000:0.0:1787826302.167954:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826302.167957:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f3499144 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167962:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f3499144 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167983:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.167995:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168004:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168011:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168017:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168022:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168027:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.168030:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168035:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168042:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf4:0x0].0x0 (ffff9bbe16cc5100) 00010000:00010000:0.0:1787826302.168044:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.168047:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168052:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3a3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168062:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168068:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168074:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168078:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.168082:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168088:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168099:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf4:0x0].0x0 (ffff9bbe16cc5100) 00010000:00010000:0.0:1787826302.168102:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826302.168104:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168110:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b38e lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.168211:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84219:x1874668789789696:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 7497us (7718us total) trans 8590016525 rc 0/0 00000100:00100000:0.0:1787826302.168219:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111427 00000020:00080000:0.0:1787826302.168223:0:23845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826302.168334:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.168452:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789790336 00000100:00100000:0.0:1787826302.168457:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789790336 00000100:00100000:0.0:1787826302.168494:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6269 00000100:00100000:0.0:1787826302.168502:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789790336:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.168529:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168545:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168553:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.168558:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826302.168563:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168596:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.168611:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 10 pid: 25038 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.168623:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778632320:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.168674:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.170557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.170633:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789790592 00000100:00100000:1.0:1787826302.170642:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789790592 00000100:00100000:1.0:1787826302.170697:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2678 00000100:00100000:1.0:1787826302.170707:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84219:x1874668789790592:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787826302.171208:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x126:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826302.171238:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016526 00010000:00010000:1.0:1787826302.171267:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.171280:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.171290:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.171299:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.171306:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.171312:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.171331:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826302.171412:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84219:x1874668789790592:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 697us (851us total) trans 8590016527 rc 0/0 00000100:00100000:1.0:1787826302.171419:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2678 00000020:00080000:1.0:1787826302.171423:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826302.171515:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826302.171522:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.171530:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826302.171533:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.171541:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.171554:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:0.0:1787826302.171557:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826302.171560:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.171566:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b3b1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x126:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.171582:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826302.171584:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826302.171586:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826302.172532:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778632320:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.172555:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.173515:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.173575:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789790720 00000100:00100000:2.0:1787826302.173582:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789790720 00010000:00010000:2.0:1787826302.173611:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 11 pid: 25038 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.173648:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3044 00000100:00100000:2.0:1787826302.173656:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789790720:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826302.173669:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.173687:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 11 pid: 25038 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.173699:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 11 pid: 25038 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.173721:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b325 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbe9f expref: 11 pid: 25038 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.173736:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826302.173740:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826302.173747:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.173756:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.173786:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826302.173829:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.173837:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789790720:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 182us (325us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826302.173839:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.173845:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3044 00010000:00010000:1.0:1787826302.173881:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.173891:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.173899:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.173905:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826302.173909:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.173917:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.173928:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.173936:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349b3aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.173986:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789790336:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 5484us (5653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.173994:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6269 00000100:00100000:1.0:1787826302.176787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.176831:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789790976 00000100:00100000:0.0:1787826302.176839:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789790976 00000100:00100000:0.0:1787826302.177061:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111428 00000100:00100000:0.0:1787826302.177071:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84217:x1874668789790976:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.177149:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.177165:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.177174:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.177331:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.177339:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeb4 expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.177345:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 4/0,1 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.177369:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeb4 expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.177379:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeb4 expref: 49 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.177390:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778632448:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.177505:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.180002:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778632448:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.180031:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.180351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.180486:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789791104 00000100:00100000:0.0:1787826302.180493:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789791104 00010000:00010000:0.0:1787826302.180526:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeb4 expref: 50 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.180590:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3045 00000100:00100000:0.0:1787826302.180599:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40512850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2402:x1874668789791104:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.180614:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.180621:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeb4 expref: 50 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.180633:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeb4 expref: 50 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.180659:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b364 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeb4 expref: 50 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.180673:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:0.0:1787826302.180678:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.180686:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.180701:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.180730:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826302.180777:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40512850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2402:x1874668789791104:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 179us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.180785:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3045 00010000:00010000:2.0:1787826302.181044:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.181053:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826302.181147:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016528 00000001:00080000:2.0:1787826302.181246:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016529 00000001:00080000:2.0:1787826302.181272:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016530 00000100:00100000:2.0:1787826302.181334:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778632576:0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1787826302.181380:0:45682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826302.181453:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.182322:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778632576 00000100:00100000:3.0:1787826302.182330:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778632576 00000100:00100000:2.0:1787826302.183183:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3340 00000100:00100000:2.0:1787826302.183195:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778632576:12345-0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1787826302.183327:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778632576:12345-0@lo:1000:mdt00_008.0 Request processed in 135us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.183334:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3340 00000100:00100000:0.0:1787826302.183412:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778632576:0@lo:1000:mdt00_008.0 00000001:00080000:0.0:1787826302.183556:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016531 00000100:00100000:0.0:1787826302.183622:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778632704:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1787826302.183659:0:45682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.183896:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.184039:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778632704 00000100:00100000:3.0:1787826302.184045:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778632704 00000100:00100000:3.0:1787826302.184086:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3341 00000100:00100000:3.0:1787826302.184095:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45682:x1874668778632704:12345-0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1787826302.184202:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:45682:x1874668778632704:12345-0@lo:1000:mdt00_008.0 Request processed in 109us (542us total) trans 4294968167 rc 0/0 00000100:00100000:3.0:1787826302.184208:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3341 00000100:00100000:0.0:1787826302.184342:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:45682:1874668778632704:0@lo:1000:mdt00_008.0 00000001:00080000:0.0:1787826302.184419:0:45682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016532 00010000:00010000:0.0:1787826302.184447:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184462:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184470:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184476:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.184481:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184488:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184503:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:0.0:1787826302.184506:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826302.184511:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 2/0,0 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184518:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b3bf lrc: 0/0,0 mode: --/EX res: [0x200000403:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184546:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f3499136 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184553:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f3499136 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184559:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f3499136 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184563:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.184567:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f3499136 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184572:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f3499136 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184580:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf2:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:0.0:1787826302.184582:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826302.184585:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f3499136 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184590:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f3499136 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184613:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184625:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184636:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184643:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184649:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184658:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184663:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.184666:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184671:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184678:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf2:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:0.0:1787826302.184680:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.184682:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184690:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b3c6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184751:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184757:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184762:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184767:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.184769:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184774:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184781:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf2:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:0.0:1787826302.184783:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826302.184786:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.184792:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b3b8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826302.185106:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826302.185110:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787826302.185201:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84217:x1874668789790976:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 8128us (8426us total) trans 8590016533 rc 0/0 00000100:00100000:0.0:1787826302.185210:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111428 00000020:00080000:0.0:1787826302.185214:0:45682:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1787826302.185473:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9694 count 103 00000040:00080000:3.0:1787826302.185481:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826302.185595:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db76580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778632832:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826302.185638:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c66d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.189488:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db76580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778632832:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787826302.190633:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.190671:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.190814:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.191543:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789791360 00000100:00100000:3.0:1787826302.191552:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789791360 00000100:00100000:3.0:1787826302.191605:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789791232 00000100:00100000:3.0:1787826302.191607:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789791232 00000100:00100000:3.0:1787826302.191624:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789791488 00000100:00100000:3.0:1787826302.191626:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789791488 00000100:00100000:3.0:1787826302.191643:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111429 00000100:00100000:3.0:1787826302.191650:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84220:x1874668789791360:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826302.191678:0:45683:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf5:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826302.191786:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84220:x1874668789791360:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 135us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.191890:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111430 00000100:00100000:2.0:1787826302.191900:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84222:x1874668789791232:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826302.191915:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826302.191966:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84222:x1874668789791232:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 68us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.191973:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111430 00000100:00100000:2.0:1787826302.191992:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111431 00000100:00100000:2.0:1787826302.191999:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84221:x1874668789791488:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826302.192012:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf6:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826302.192051:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84221:x1874668789791488:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 53us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.192058:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111431 00000100:00100000:3.0:1787826302.195623:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111429 00000100:00100000:2.0:1787826302.195985:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.196012:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789791616 00000100:00100000:2.0:1787826302.196021:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789791616 00000100:00100000:2.0:1787826302.196069:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111432 00000100:00100000:2.0:1787826302.196078:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84220:x1874668789791616:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.196216:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196229:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196238:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196248:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196253:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196257:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196280:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196415:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196424:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.196471:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf5:0x0]: returning size 158 00000004:00200000:2.0:1787826302.196476:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826302.196488:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196499:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196506:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196512:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196523:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.196528:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196535:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196546:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826302.196549:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.196554:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196559:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b3cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196571:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196577:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196583:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196587:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.196590:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196596:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196607:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8fc8d552 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826302.196609:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.196612:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.196617:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b3d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8fc8d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.196958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.196992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.197028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.197110:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789792000 00000100:00100000:1.0:1787826302.197115:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789792000 00010000:00010000:2.0:1787826302.197116:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197124:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197129:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197134:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.197137:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.197143:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789792128 00010000:00010000:2.0:1787826302.197143:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.197146:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789792128 00010000:00010000:2.0:1787826302.197153:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf5:0x0].0x0 (ffff9bbe16cc5b00) 00010000:00010000:2.0:1787826302.197155:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.197159:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.197162:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111433 00010000:00010000:2.0:1787826302.197165:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b3db lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.197169:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84221:x1874668789792000:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.197210:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197219:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197226:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.197236:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84220:x1874668789791616:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1159us (1252us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826302.197239:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.197243:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111432 00010000:00010000:1.0:1787826302.197246:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197251:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.197260:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111434 00000100:00100000:2.0:1787826302.197266:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84222:x1874668789792128:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.197272:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197280:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197287:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826302.197312:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf6:0x0]: returning size 158 00000004:00200000:1.0:1787826302.197316:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826302.197323:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197334:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197340:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197346:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197351:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197357:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.197360:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197366:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197375:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826302.197377:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826302.197380:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197386:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b3e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197396:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197399:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197411:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197418:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197418:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197424:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.197426:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197427:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197434:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197439:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197440:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xd5ef40e8 (ffff9bbe0bd66300) 00010000:00010000:1.0:1787826302.197443:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.197445:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197446:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197452:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197453:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b3e9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xd5ef40e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197469:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197469:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197476:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197477:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197482:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197484:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197487:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.197490:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197495:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.197502:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf6:0x0].0x0 (ffff9bbe16cc5f00) 00010000:00010000:1.0:1787826302.197504:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:2.0:1787826302.197504:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf7:0x0]: returning size 158 00010000:00010000:1.0:1787826302.197507:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.197507:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787826302.197513:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b3f0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826302.197513:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197521:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197527:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197532:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197537:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.197539:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.197544:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84221:x1874668789792000:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 375us (551us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826302.197546:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.197551:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111433 00010000:00010000:2.0:1787826302.197554:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826302.197556:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.197558:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197564:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b3f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197572:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197582:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197588:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197593:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.197596:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197602:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197609:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x64e34e6b (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826302.197612:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.197614:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197619:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b3fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x64e34e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197629:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.197635:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789791872 00010000:00010000:2.0:1787826302.197635:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.197639:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789791872 00010000:00010000:2.0:1787826302.197640:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197645:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.197648:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197654:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197660:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf7:0x0].0x0 (ffff9bbe16cc5500) 00010000:00010000:2.0:1787826302.197663:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.197666:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.197671:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b405 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.197673:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2679 00000100:00100000:0.0:1787826302.197680:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84217:x1874668789791872:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787826302.197982:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x127:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826302.198011:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016534 00010000:00010000:0.0:1787826302.198037:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.198046:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.198054:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.198061:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.198066:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.198071:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.198086:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826302.198110:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84222:x1874668789792128:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 843us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.198117:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111434 00000100:00100000:0.0:1787826302.198501:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84217:x1874668789791872:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 820us (1543us total) trans 8590016535 rc 0/0 00000100:00100000:0.0:1787826302.198509:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2679 00000020:00080000:0.0:1787826302.198512:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826302.198581:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826302.198588:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.198599:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826302.198602:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.198609:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.198620:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:1.0:1787826302.198622:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826302.198625:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 1/0,0 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.198632:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b40c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x127:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.198642:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826302.198644:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826302.198646:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826302.200519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.200556:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.200592:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789792640 00000100:00100000:1.0:1787826302.200600:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789792640 00000100:00100000:1.0:1787826302.200652:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789792384 00000100:00100000:1.0:1787826302.200656:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789792384 00000100:00100000:1.0:1787826302.200683:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111435 00000100:00100000:1.0:1787826302.200703:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84222:x1874668789792640:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.200720:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.200741:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b413 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbec2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.200888:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.200901:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.200910:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826302.200920:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf7:0x0]: returning size 158 00010000:00010000:1.0:1787826302.200990:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.200997:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.201004:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.201010:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.201013:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.201020:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.201030:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf7:0x0].0x0 (ffff9bbe16cc5500) 00010000:00010000:1.0:1787826302.201033:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826302.201036:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.201042:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b41a lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.201079:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b413 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbec2 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.201090:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826302.201092:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826302.201096:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b413 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbec2 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.201106:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc 0) 00000100:00100000:1.0:1787826302.201158:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84222:x1874668789792640:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 466us (644us total) trans 8590016536 rc 301/301 00000100:00100000:2.0:1787826302.202484:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111436 00000100:00100000:2.0:1787826302.202503:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84220:x1874668789792384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.202520:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.202535:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b428 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbebb expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202613:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202626:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202635:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.202645:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf5:0x0]: returning size 158 00010000:00010000:2.0:1787826302.202719:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202727:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202733:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202739:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.202743:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202750:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202760:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf5:0x0].0x0 (ffff9bbe16cc5b00) 00010000:00010000:2.0:1787826302.202763:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826302.202767:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202773:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b42f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202817:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b428 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbebb expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202827:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826302.202829:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826302.202833:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b428 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbebb expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.202843:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3800, rc 0) 00000100:00100000:2.0:1787826302.203125:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84220:x1874668789792384:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 629us (2567us total) trans 8590016537 rc 301/301 00000100:00100000:2.0:1787826302.203133:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111436 00000100:00100000:2.0:1787826302.203204:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.207028:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789792896 00000100:00100000:0.0:1787826302.207042:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789792896 00000100:00100000:1.0:1787826302.207473:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111435 00000100:00100000:0.0:1787826302.210064:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111437 00000100:00100000:0.0:1787826302.210086:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84221:x1874668789792896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.210108:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.210130:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b43d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbec9 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210239:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210253:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210264:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826302.210276:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf6:0x0]: returning size 158 00010000:00010000:0.0:1787826302.210349:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210358:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210365:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210372:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.210377:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210384:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210396:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf6:0x0].0x0 (ffff9bbe16cc5f00) 00010000:00010000:0.0:1787826302.210399:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826302.210413:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210419:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b444 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210461:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b43d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbec9 expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210472:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826302.210474:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826302.210477:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b43d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbec9 expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.210486:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3600, rc 0) 00000100:00100000:0.0:1787826302.215153:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84221:x1874668789792896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5064us (11934us total) trans 8590016538 rc 301/301 00000100:00100000:0.0:1787826302.215170:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111437 00000100:00100000:1.0:1787826302.215934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.216132:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789793024 00000100:00100000:0.0:1787826302.216141:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789793024 00000100:00100000:0.0:1787826302.216224:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111438 00000100:00100000:0.0:1787826302.216235:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84222:x1874668789793024:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826302.216272:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826302.216392:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84222:x1874668789793024:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 159us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.216400:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111438 00000100:00100000:2.0:1787826302.218035:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.218072:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789793152 00000100:00100000:2.0:1787826302.218079:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789793152 00000100:00100000:2.0:1787826302.218129:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111439 00000100:00100000:2.0:1787826302.218139:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84220:x1874668789793152:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826302.218173:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf5:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826302.218264:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84220:x1874668789793152:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 127us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.218272:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111439 00000100:00100000:2.0:1787826302.218779:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.218834:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789793280 00000100:00100000:3.0:1787826302.218839:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789793280 00000100:00100000:2.0:1787826302.219078:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111440 00000100:00100000:2.0:1787826302.219087:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84221:x1874668789793280:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826302.219106:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf6:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826302.219162:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84221:x1874668789793280:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 77us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.219170:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111440 00000100:00100000:2.0:1787826302.224087:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.225496:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789793536 00000100:00100000:3.0:1787826302.225507:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789793536 00000100:00100000:3.0:1787826302.225573:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111441 00000100:00100000:3.0:1787826302.225584:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84221:x1874668789793536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.225603:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.225623:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b452 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbed0 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.226129:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b459 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.226143:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b459 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.226154:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b459 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826302.226165:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x128:0x0]: returning size 0 00010000:00010000:3.0:1787826302.226208:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b452 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed0 expref: 61 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.226224:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b459 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed0 expref: 60 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.226233:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:3.0:1787826302.226236:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826302.226240:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826302.226316:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84221:x1874668789793536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 734us (2239us total) trans 8590016539 rc 0/0 00000100:00100000:3.0:1787826302.226324:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111441 00000100:00100000:1.0:1787826302.230130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.233128:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789793792 00000100:00100000:0.0:1787826302.233142:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789793792 00000100:00100000:2.0:1787826302.233299:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111442 00000100:00100000:2.0:1787826302.233310:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84221:x1874668789793792:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.233367:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.233393:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b459 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed0 expref: 60 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233421:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:2.0:1787826302.233431:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826302.233453:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233466:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233476:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233491:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233498:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233504:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233554:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233560:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233571:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233576:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233581:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.233585:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233593:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233602:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826302.233605:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.233609:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233615:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b467 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233624:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233630:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233636:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233641:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.233644:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233649:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233655:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xc13a6c3d (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826302.233657:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.233660:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.233666:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b46e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xc13a6c3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.233752:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84221:x1874668789793792:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 444us (3631us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826302.233760:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111442 00000100:00100000:0.0:1787826302.237124:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.237236:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789793920 00000100:00100000:2.0:1787826302.237246:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789793920 00000100:00100000:2.0:1787826302.237306:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111443 00000100:00100000:2.0:1787826302.237315:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84221:x1874668789793920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.237335:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.237358:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b475 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbed7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.237392:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.237414:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.237430:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.237538:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b475 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed7 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.237557:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed7 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.237565:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826302.237567:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826302.237570:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826302.237634:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84221:x1874668789793920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 319us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.237640:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111443 00000100:00100000:1.0:1787826302.241771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.241801:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.242173:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789794176 00000100:00100000:2.0:1787826302.242173:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789794432 00000100:00100000:0.0:1787826302.242183:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789794176 00000100:00100000:0.0:1787826302.242248:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111444 00000100:00100000:2.0:1787826302.242345:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789794432 00000100:00100000:2.0:1787826302.242386:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111445 00000100:00100000:2.0:1787826302.242395:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84221:x1874668789794432:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.242635:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84220:x1874668789794176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.242645:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.242667:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b483 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbede expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.242976:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.242991:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.243001:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826302.243127:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ff4cec0 reply state 000000009a4009f4 transno 8590016540 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.243141:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.243149:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826302.243152:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826302.243156:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826302.244168:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b491 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.244467:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84221:x1874668789794432:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 2070us (2661us total) trans 8590016540 rc 0/0 00000100:00100000:2.0:1787826302.244476:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111445 00010000:00010000:1.0:1787826302.244532:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b491 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.244547:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b491 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826302.244557:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x129:0x0]: returning size 0 00010000:00010000:1.0:1787826302.244608:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b483 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbede expref: 65 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.244625:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b491 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbede expref: 64 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.244635:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe0bd66300) 00010000:00010000:1.0:1787826302.244637:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826302.244640:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7400, rc 0) 00000100:00100000:1.0:1787826302.244678:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84220:x1874668789794176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2421us (2915us total) trans 8590016541 rc 0/0 00000100:00100000:1.0:1787826302.244685:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111444 00000100:00100000:1.0:1787826302.248972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.249011:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.249129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789794560 00000100:00100000:2.0:1787826302.249140:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789794560 00000100:00100000:2.0:1787826302.249255:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789794816 00000100:00100000:2.0:1787826302.249259:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789794816 00000100:00100000:2.0:1787826302.249293:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111446 00000100:00100000:2.0:1787826302.249303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84221:x1874668789794560:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.249324:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.249346:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbee5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.249416:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbee5 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.249432:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbee5 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.249448:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826302.249451:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.249455:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:2.0:1787826302.249516:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84221:x1874668789794560:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 215us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.249518:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111447 00000100:00100000:2.0:1787826302.249523:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111446 00000100:00100000:3.0:1787826302.249529:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84220:x1874668789794816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.249573:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.249595:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b491 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x129:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbede expref: 65 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249611:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe0bd66300) 00010000:00010000:3.0:1787826302.249619:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826302.249636:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249645:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249653:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249666:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249673:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249680:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249726:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249732:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249739:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249744:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.249748:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249755:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249764:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826302.249766:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.249770:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249776:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249785:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249791:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249796:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249813:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.249816:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249822:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249829:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xcd4266c5 (ffff9bbe08124400) 00010000:00010000:3.0:1787826302.249832:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.249835:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.249840:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ad lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xcd4266c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.249918:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84220:x1874668789794816:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 392us (905us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826302.249925:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111447 00000100:00100000:1.0:1787826302.253991:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.254135:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789794944 00000100:00100000:2.0:1787826302.254144:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789794944 00000100:00100000:2.0:1787826302.254205:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2680 00000100:00100000:2.0:1787826302.254215:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84221:x1874668789794944:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.254351:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84221:x1874668789794944:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 136us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.254359:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2680 00000100:00100000:0.0:1787826302.255182:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.257273:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789795200 00000100:00100000:2.0:1787826302.257288:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789795200 00000100:00100000:2.0:1787826302.257354:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111448 00000100:00100000:2.0:1787826302.257365:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84222:x1874668789795200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.257385:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.257415:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b4b4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbeec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.259114:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.259205:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789795328 00000100:00100000:3.0:1787826302.259213:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789795328 00000100:00100000:3.0:1787826302.259377:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111449 00000100:00100000:3.0:1787826302.259388:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84220:x1874668789795328:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.259413:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.259433:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4bb lrc: 2/0,0 mode: --/PR res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbef3 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.259474:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.259487:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.259505:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.259609:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbef3 expref: 69 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.259626:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbef3 expref: 68 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.259635:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826302.259638:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826302.259641:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606400, rc 0) 00000100:00100000:3.0:1787826302.259690:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84220:x1874668789795328:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 305us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.259697:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111449 00010000:00010000:2.0:1787826302.259988:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b4c9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.259997:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.260005:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.260013:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12a:0x0]: returning size 0 00010000:00010000:2.0:1787826302.260061:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b4b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeec expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.260073:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeec expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.260079:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826302.260082:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826302.260084:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826302.260111:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84222:x1874668789795200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2748us (4931us total) trans 8590016542 rc 0/0 00000100:00100000:2.0:1787826302.260118:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111448 00000100:00100000:1.0:1787826302.262012:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.262434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.262749:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789795840 00000100:00100000:2.0:1787826302.262759:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789795840 00000100:00100000:2.0:1787826302.262819:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111450 00000100:00100000:2.0:1787826302.262829:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84220:x1874668789795840:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.262837:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789795584 00000100:00100000:0.0:1787826302.262840:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789795584 00000100:00100000:0.0:1787826302.262897:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2681 00000100:00100000:0.0:1787826302.262905:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84221:x1874668789795584:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.262933:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.262948:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.262958:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826302.263046:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bed064c reply state 0000000027402671 transno 8590016544 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.263058:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.263065:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826302.263068:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826302.263071:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826302.263073:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84221:x1874668789795584:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 169us (1068us total) trans 8590016543 rc 0/0 00000100:00100000:0.0:1787826302.263079:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2681 00000100:00100000:2.0:1787826302.263111:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84220:x1874668789795840:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 284us (678us total) trans 8590016544 rc 0/0 00000100:00100000:2.0:1787826302.263117:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111450 00000100:00100000:1.0:1787826302.264004:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.264040:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789796096 00000100:00100000:2.0:1787826302.264046:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789796096 00000100:00100000:2.0:1787826302.264119:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111451 00000100:00100000:2.0:1787826302.264127:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84222:x1874668789796096:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.264162:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.264255:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b4c9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbeec expref: 70 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264272:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826302.264279:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826302.264297:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264308:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264509:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264526:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264533:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264540:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264576:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264583:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264588:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264595:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264600:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.264604:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264611:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264691:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826302.264696:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.264701:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264708:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b4de lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264719:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264725:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264731:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264737:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.264740:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264746:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264753:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x7c4b6b15 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826302.264755:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.264758:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.264764:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b4e5 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x7c4b6b15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.264831:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84222:x1874668789796096:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 705us (831us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826302.264840:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111451 00000100:00100000:0.0:1787826302.267741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.267793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.268100:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789796480 00000100:00100000:3.0:1787826302.268110:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789796480 00000100:00100000:3.0:1787826302.268226:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789796352 00000100:00100000:3.0:1787826302.268229:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789796352 00000100:00100000:3.0:1787826302.268265:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111452 00000100:00100000:3.0:1787826302.268274:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84220:x1874668789796480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.268297:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.268319:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbefa expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.268380:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbefa expref: 71 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.268395:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbefa expref: 71 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.268414:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826302.268417:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.268421:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:3.0:1787826302.268474:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84220:x1874668789796480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 200us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.268482:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111452 00000100:00100000:3.0:1787826302.268500:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111453 00000100:00100000:3.0:1787826302.268508:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84221:x1874668789796352:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.268561:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84221:x1874668789796352:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 54us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.268567:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111453 00000100:00100000:2.0:1787826302.271453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.271497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.271565:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789796608 00000100:00100000:3.0:1787826302.271574:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789796608 00000100:00100000:0.0:1787826302.271701:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789796736 00000100:00100000:0.0:1787826302.271706:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789796736 00000100:00100000:1.0:1787826302.271727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.271744:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2682 00000100:00100000:0.0:1787826302.271753:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84220:x1874668789796736:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.271912:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84220:x1874668789796736:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 152us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.271919:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2682 00000100:00100000:2.0:1787826302.272009:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789796992 00000100:00100000:2.0:1787826302.272014:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789796992 00000100:00100000:0.0:1787826302.273046:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826302.273063:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778632960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826302.273112:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.273211:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778632960 00000100:00100000:1.0:1787826302.273216:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778632960 00000100:00100000:3.0:1787826302.273217:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111454 00000100:00100000:3.0:1787826302.273226:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84222:x1874668789796608:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.273241:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787826302.273246:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:1.0:1787826302.273252:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778632960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826302.273265:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671560000 pending 0 free 3894796288 avail 3663216640 00010000:00010000:3.0:1787826302.273274:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b4f3 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf01 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.273314:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778632960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.273322:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:2.0:1787826302.273421:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111455 00000100:00100000:2.0:1787826302.273430:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84221:x1874668789796992:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.273438:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.273450:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b4fa lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf08 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.273535:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.273550:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbee5 expref: 73 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.273558:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.273582:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbee5 expref: 73 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.273596:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbee5 expref: 73 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.273606:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778633088:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826302.273674:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d300 going to sleep for 11 seconds 00010000:00010000:3.0:1787826302.273767:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.273777:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.273788:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.273838:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826302.273890:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b4f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf01 expref: 74 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.273907:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf01 expref: 73 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.273914:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826302.273917:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826302.273920:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:0.0:1787826302.274044:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778632960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826302.274149:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84222:x1874668789796608:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 923us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.274156:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111454 00000100:00100000:3.0:1787826302.274192:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789797248 00000100:00100000:3.0:1787826302.274196:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789797248 00000100:00100000:3.0:1787826302.274228:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2683 00000100:00100000:3.0:1787826302.274236:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84220:x1874668789797248:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.276737:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84220:x1874668789797248:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 2490us (2887us total) trans 8590016545 rc 0/0 00000100:00100000:3.0:1787826302.276750:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2683 00000100:00100000:0.0:1787826302.283412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.283520:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.283584:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778633088:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.283610:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.283793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.283917:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789797888 00000100:00100000:3.0:1787826302.283924:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789797888 00010000:00010000:3.0:1787826302.283963:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbee5 expref: 74 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.283996:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3046 00000100:00100000:3.0:1787826302.284005:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+74:2402:x1874668789797888:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.284020:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.284026:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbee5 expref: 74 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.284037:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbee5 expref: 74 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.284060:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b49f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbee5 expref: 74 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.284074:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:3.0:1787826302.284078:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.284087:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.284112:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.284135:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.284185:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+73:2402:x1874668789797888:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 181us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.284192:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3046 00010000:00010000:3.0:1787826302.287080:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287098:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826302.287123:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x128:0x0]: returning size 0 00000004:00080000:3.0:1787826302.287295:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc3:0x0], index 0: 0 00010000:00010000:3.0:1787826302.287412:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287421:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287427:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287434:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.287438:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287445:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287467:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:3.0:1787826302.287469:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.287474:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287480:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b501 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287532:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b4fa lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf08 expref: 73 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287542:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826302.287545:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826302.287549:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b4fa lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf08 expref: 73 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.287558:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:3.0:1787826302.287670:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84221:x1874668789796992:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 14241us (15942us total) trans 8590016546 rc 301/301 00000100:00100000:3.0:1787826302.287680:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111455 00000100:00100000:1.0:1787826302.288418:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789797504 00000100:00100000:1.0:1787826302.288426:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789797504 00000100:00100000:1.0:1787826302.288487:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789797760 00000100:00100000:1.0:1787826302.288491:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789797760 00000100:00100000:1.0:1787826302.288519:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111456 00000100:00100000:1.0:1787826302.288528:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84220:x1874668789797504:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.288601:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84220:x1874668789797504:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 74us (5344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.288608:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111456 00000100:00100000:1.0:1787826302.288635:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111457 00000100:00100000:1.0:1787826302.288642:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84222:x1874668789797760:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.288697:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.288712:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.288722:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826302.288837:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026778395 reply state 00000000a6684f0f transno 8590016547 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.288872:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.288880:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:1.0:1787826302.288882:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826302.288885:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826302.288935:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84222:x1874668789797760:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 292us (5415us total) trans 8590016547 rc 0/0 00000100:00100000:1.0:1787826302.288941:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111457 00000100:00100000:0.0:1787826302.295131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.295216:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.295250:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.295400:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789798400 00000100:00100000:1.0:1787826302.295418:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789798400 00000100:00100000:1.0:1787826302.295484:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789798528 00000100:00100000:1.0:1787826302.295487:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789798528 00000100:00100000:1.0:1787826302.295509:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111458 00000100:00100000:1.0:1787826302.295518:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84220:x1874668789798400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.295543:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.295565:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b51d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.295671:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.295686:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbefa expref: 76 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.295694:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.295731:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbefa expref: 76 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.295745:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbefa expref: 76 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.295759:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778633216:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.295877:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111459 00000100:00100000:0.0:1787826302.295886:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84222:x1874668789798528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.295896:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.295907:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf16 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.295940:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf16 expref: 77 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.295953:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf16 expref: 77 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.295962:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:0.0:1787826302.295964:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826302.295967:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc 0) 00000100:00100000:2.0:1787826302.296722:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789798144 00000100:00100000:2.0:1787826302.296730:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789798144 00000100:00100000:2.0:1787826302.296787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2684 00000100:00100000:2.0:1787826302.296796:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84221:x1874668789798144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.297295:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84222:x1874668789798528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1409us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.297303:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111459 00000100:00100000:1.0:1787826302.297761:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf404376c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826302.303129:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84221:x1874668789798144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 6323us (7995us total) trans 8590016548 rc 0/0 00000100:00100000:2.0:1787826302.303144:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2684 00000100:00100000:3.0:1787826302.303517:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.303555:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.303580:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789798656 00000100:00100000:3.0:1787826302.303588:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789798656 00000100:00100000:3.0:1787826302.303670:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2685 00000100:00100000:3.0:1787826302.303680:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84222:x1874668789798656:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.303793:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84222:x1874668789798656:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 115us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.303802:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2685 00000100:00100000:2.0:1787826302.303991:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789798784 00000100:00100000:2.0:1787826302.303996:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789798784 00010000:00010000:2.0:1787826302.304028:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbefa expref: 78 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.304058:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3047 00000100:00100000:2.0:1787826302.304065:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+78:2402:x1874668789798784:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826302.304076:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.304083:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbefa expref: 78 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304096:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbefa expref: 78 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304122:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826302.304128:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304138:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304145:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304162:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826302.304195:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+78:2402:x1874668789798784:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 130us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.304202:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3047 00010000:00010000:2.0:1787826302.304244:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b4ec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbefa expref: 77 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.304259:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778633216:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.304277:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304287:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304292:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.304307:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x129:0x0]: returning size 0 00000004:00080000:2.0:1787826302.304453:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc4:0x0], index 1: 0 00010000:00010000:2.0:1787826302.304846:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304879:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304886:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304891:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.304895:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304902:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304912:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826302.304915:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.304918:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304923:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b524 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304965:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b51d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf0f expref: 77 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304975:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826302.304977:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826302.304980:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b51d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf0f expref: 77 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.304993:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:2.0:1787826302.305492:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84220:x1874668789798400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9973us (10273us total) trans 8590016549 rc 301/301 00000100:00100000:2.0:1787826302.305500:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111458 00000100:00100000:3.0:1787826302.305740:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.306147:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789799040 00000100:00100000:1.0:1787826302.306154:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789799040 00000100:00100000:1.0:1787826302.306200:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2686 00000100:00100000:1.0:1787826302.306210:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84222:x1874668789799040:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.306352:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84222:x1874668789799040:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 144us (612us total) trans 8590016550 rc 0/0 00000100:00100000:1.0:1787826302.306359:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2686 00000100:00100000:3.0:1787826302.308954:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.308994:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.309189:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789799168 00000100:00100000:2.0:1787826302.309199:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789799168 00000100:00100000:2.0:1787826302.309260:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111460 00000100:00100000:2.0:1787826302.309270:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84221:x1874668789799168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.309293:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.309313:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b539 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf1d expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.309385:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b540 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.309399:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b540 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.309425:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b540 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.309465:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x128:0x0]: returning size 0 00000004:00200000:2.0:1787826302.309470:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826302.309493:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b540 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.309520:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b539 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf1d expref: 79 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.309545:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b540 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf1d expref: 78 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.309554:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:2.0:1787826302.309557:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826302.309561:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:2.0:1787826302.309622:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84221:x1874668789799168:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 354us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.309630:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111460 00000100:00100000:3.0:1787826302.310392:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.310534:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789799680 00000100:00100000:1.0:1787826302.310540:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789799680 00000100:00100000:1.0:1787826302.310580:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111461 00000100:00100000:1.0:1787826302.310588:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84222:x1874668789799680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.310654:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84222:x1874668789799680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.310662:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111461 00000100:00100000:0.0:1787826302.313685:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789799424 00000100:00100000:0.0:1787826302.313699:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789799424 00000100:00100000:0.0:1787826302.313776:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2687 00000100:00100000:0.0:1787826302.313788:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84220:x1874668789799424:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.314096:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84220:x1874668789799424:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 308us (5100us total) trans 8590016551 rc 0/0 00000100:00100000:0.0:1787826302.314103:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2687 00000100:00100000:2.0:1787826302.314746:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.314937:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789799808 00000100:00100000:3.0:1787826302.314943:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789799808 00000100:00100000:3.0:1787826302.314986:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6270 00000100:00100000:3.0:1787826302.314994:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789799808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.315015:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.315033:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf24 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826302.315057:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826302.315073:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=2940s v=(0 0) 00010000:00010000:3.0:1787826302.315077:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.315087:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf24 expref: 13 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.315105:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf24 expref: 13 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.315119:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826302.315165:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789799808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 171us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.315175:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6270 00000100:00100000:3.0:1787826302.320128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.322152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.327379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.333339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789800064 00000100:00100000:2.0:1787826302.333355:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789800064 00000100:00100000:1.0:1787826302.334940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789800192 00000100:00100000:1.0:1787826302.334951:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789800192 00000100:00100000:1.0:1787826302.334990:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111462 00000100:00100000:1.0:1787826302.335001:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84222:x1874668789800064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.335006:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111463 00000100:00100000:2.0:1787826302.335014:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84220:x1874668789800192:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.335022:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.335024:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.335043:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b54e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf2b expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.335043:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b555 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf32 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.335110:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b55c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.335123:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b55c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.335133:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b55c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.335135:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.335146:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf16 expref: 82 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.335153:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.335161:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x129:0x0]: returning size 0 00000004:00200000:2.0:1787826302.335165:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826302.335180:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b55c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.335185:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf16 expref: 82 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.335196:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf16 expref: 83 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.335202:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b555 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf32 expref: 83 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.335209:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778633344:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.335217:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b55c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf32 expref: 82 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.335225:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826302.335227:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826302.335231:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:1.0:1787826302.335304:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf40437780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826302.338453:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84220:x1874668789800192:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 3426us (16296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.338467:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111463 00000100:00100000:0.0:1787826302.342006:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789800448 00000100:00100000:0.0:1787826302.342021:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789800448 00000100:00100000:0.0:1787826302.342108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111464 00000100:00100000:0.0:1787826302.342118:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84221:x1874668789800448:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.342219:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84221:x1874668789800448:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 102us (14849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.342226:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111464 00000100:00100000:1.0:1787826302.346376:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778633344:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826302.346417:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.348071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.348267:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789800576 00000100:00100000:1.0:1787826302.348277:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789800576 00010000:00010000:1.0:1787826302.348377:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf16 expref: 82 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.348459:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3048 00000100:00100000:1.0:1787826302.348470:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2402:x1874668789800576:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826302.348499:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826302.348506:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf16 expref: 82 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.348521:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf16 expref: 82 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.348545:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349b52b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf16 expref: 82 pid: 7736 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.348562:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:1.0:1787826302.348568:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.348579:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.348588:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.348622:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826302.348682:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2402:x1874668789800576:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 215us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.348691:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3048 00010000:00010000:2.0:1787826302.348733:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.348742:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.348760:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12a:0x0]: returning size 0 00000004:00080000:2.0:1787826302.348992:0:7736:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc4:0x0], index 0: 0 00010000:00010000:2.0:1787826302.349077:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.349085:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.349093:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.349098:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.349102:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.349110:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.349119:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:2.0:1787826302.349122:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.349125:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.349131:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b563 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.349171:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b54e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf2b expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.349180:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826302.349183:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826302.349186:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b54e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf2b expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.349195:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:2.0:1787826302.349228:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84222:x1874668789800064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 14229us (29110us total) trans 8590016552 rc 301/301 00000100:00100000:2.0:1787826302.349239:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111462 00000100:00100000:3.0:1787826302.357451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.357535:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789800704 00000100:00100000:0.0:1787826302.357545:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789800704 00000100:00100000:0.0:1787826302.357598:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6271 00000100:00100000:0.0:1787826302.357608:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84221:x1874668789800704:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.357626:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.357644:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf39 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.357675:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf24 expref: 14 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.357685:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.357690:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.357695:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.357727:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf24 expref: 14 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.357742:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf24 expref: 14 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.357756:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778633472:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.357871:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.367045:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.367099:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.367156:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789801088 00000100:00100000:1.0:1787826302.367165:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789801088 00000100:00100000:1.0:1787826302.367231:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6272 00000100:00100000:1.0:1787826302.367240:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789801088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.367244:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789800960 00000100:00100000:0.0:1787826302.367248:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789800960 00010000:00010000:1.0:1787826302.367257:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.367277:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf40 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.367287:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2688 00000100:00100000:0.0:1787826302.367294:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84222:x1874668789800960:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00002000:00010000:1.0:1787826302.367310:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826302.367327:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=2940s v=(0 0) 00010000:00010000:1.0:1787826302.367331:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.367339:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf40 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.367356:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf40 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.367369:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc 0) 00000100:00100000:1.0:1787826302.367431:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789801088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 192us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.367438:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6272 00000100:00100000:0.0:1787826302.367537:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84222:x1874668789800960:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 244us (501us total) trans 8590016553 rc 0/0 00000100:00100000:0.0:1787826302.367546:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2688 00000100:00100000:3.0:1787826302.370524:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.371140:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.371234:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778633472:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.371265:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.371285:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826302.371338:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84221:x1874668789800704:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 13731us (13896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.371347:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6271 00000100:00100000:2.0:1787826302.371620:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789801472 00000100:00100000:2.0:1787826302.371627:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789801472 00000100:00100000:2.0:1787826302.371766:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111465 00000100:00100000:2.0:1787826302.371777:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84220:x1874668789801472:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.371794:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789801216 00000100:00100000:1.0:1787826302.371804:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789801216 00010000:00010000:1.0:1787826302.371826:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf24 expref: 14 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.371872:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84220:x1874668789801472:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 96us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.371879:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111465 00000100:00100000:1.0:1787826302.371884:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3049 00000100:00100000:1.0:1787826302.371891:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789801216:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826302.371901:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826302.371922:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf24 expref: 14 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.371935:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf24 expref: 14 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.371956:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349b547 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf24 expref: 14 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.371970:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.371974:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.371982:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.371992:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.372024:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.372037:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b7c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778633600:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826302.372097:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf40437780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.374609:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.374704:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789801600 00000100:00100000:1.0:1787826302.374713:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789801600 00000100:00100000:1.0:1787826302.374769:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111466 00000100:00100000:1.0:1787826302.374778:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84222:x1874668789801600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.374805:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.374825:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b57f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf47 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.374925:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b586 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.374940:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b586 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.374951:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b586 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826302.374989:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12a:0x0]: returning size 0 00000004:00200000:1.0:1787826302.374993:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826302.375007:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b586 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.375029:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b57f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf47 expref: 83 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.375045:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b586 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf47 expref: 82 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.375052:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:1.0:1787826302.375055:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826302.375058:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6800, rc 0) 00000100:00100000:1.0:1787826302.375109:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84222:x1874668789801600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 333us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.375116:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111466 00000100:00100000:3.0:1787826302.375942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.376260:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789801728 00000100:00100000:1.0:1787826302.376267:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789801728 00000100:00100000:1.0:1787826302.377432:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6273 00000100:00100000:1.0:1787826302.377444:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84220:x1874668789801728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.377459:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.377475:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf4e expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.377500:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf40 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.377508:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.377513:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.377518:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.377547:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf40 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.377560:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf40 expref: 11 pid: 8430 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.377573:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778633728:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826302.377644:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf404376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.378295:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b7c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778633600:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826302.378313:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826302.378344:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789801216:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 6454us (7832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.378354:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3049 00000100:00100000:3.0:1787826302.380728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.383260:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789801856 00000100:00100000:0.0:1787826302.383273:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789801856 00000100:00100000:3.0:1787826302.383322:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.383372:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6274 00000100:00100000:0.0:1787826302.383382:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789801856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.383411:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.383431:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf55 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826302.383456:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826302.383475:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=2940s v=(0 0) 00010000:00010000:0.0:1787826302.383479:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.383488:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf55 expref: 14 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.383503:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf55 expref: 14 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.383521:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:0.0:1787826302.383575:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789801856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 196us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.383582:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6274 00000100:00100000:1.0:1787826302.383689:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778633728:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826302.383725:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 11 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.383736:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:1.0:1787826302.383757:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84220:x1874668789801728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 6317us (7817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.383764:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6273 00000100:00100000:3.0:1787826302.386150:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.386280:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789801984 00000100:00100000:2.0:1787826302.386289:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789801984 00002000:00100000:2.0:1787826302.386330:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc3:0x0] (0->157) req@ffff9bbe0c033c00 x1874668789801984/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/0 e 0 to 0 dl 1787826313 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826302.386342:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c033c00 with x1874668789801984 ext(0->157) 00000100:00100000:3.0:1787826302.387265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.387464:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789802368 00000100:00100000:0.0:1787826302.387470:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789802368 00000100:00100000:0.0:1787826302.387518:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111467 00000100:00100000:0.0:1787826302.387527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84222:x1874668789802368:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.387615:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84222:x1874668789802368:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 88us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.387622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111467 00002000:00010000:2.0:1787826302.388252:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0c033c00 00000100:00100000:2.0:1787826302.388277:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1576 00000100:00100000:2.0:1787826302.388287:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2400:x1874668789801984:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.389300:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789802112 00000100:00100000:1.0:1787826302.389308:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789802112 00010000:00010000:1.0:1787826302.389337:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf40 expref: 11 pid: 8430 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.389363:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3050 00000100:00100000:1.0:1787826302.389370:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789802112:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826302.389382:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826302.389400:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf40 expref: 11 pid: 8430 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.389430:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf40 expref: 11 pid: 8430 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.389456:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f937ea7/0x68019081f349b578 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf40 expref: 11 pid: 8430 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.389471:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.389476:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.389484:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.389494:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.389532:0:45686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.389546:0:45686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778633856:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826302.389626:0:45686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf404376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.391458:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.391735:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789802496 00000100:00100000:3.0:1787826302.391743:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789802496 00000100:00100000:3.0:1787826302.391796:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6275 00000100:00100000:3.0:1787826302.391811:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+17:84222:x1874668789802496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.391826:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.391843:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf5c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.391901:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf55 expref: 18 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.391917:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.391921:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.391927:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 18 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.391956:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf55 expref: 18 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.391970:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf55 expref: 18 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.391984:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0321c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778633984:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826302.392028:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2400:x1874668789801984:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 3742us (8708us total) trans 4294968183 rc 0/0 00000100:00100000:2.0:1787826302.392037:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1576 00002000:00100000:2.0:1787826302.392047:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc3:0x0] (0->157) req@ffff9bbe0c033c00 x1874668789801984/t4294968183(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/448 e 0 to 0 dl 1787826313 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826302.392057:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c033c00 with x1874668789801984 ext(0->157) 00002000:00010000:2.0:1787826302.392062:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0c033c00 00000100:00100000:3.0:1787826302.395612:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c66d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.397075:0:45686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778633856:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826302.397101:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826302.397156:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789802112:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 7785us (11012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.397168:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3050 00000100:00100000:1.0:1787826302.406254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.406439:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0321c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778633984:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.406475:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 17 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.406498:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00000100:00100000:0.0:1787826302.406562:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+17:84222:x1874668789802496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 14754us (15107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.406574:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6275 00000100:00100000:3.0:1787826302.407607:0:25758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789802624 00000100:00100000:3.0:1787826302.407616:0:25758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789802624 00002000:00100000:3.0:1787826302.407659:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xc4:0x0] (0->157) req@ffff9bbe099b4000 x1874668789802624/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/0 e 0 to 0 dl 1787826313 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826302.407671:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe099b4000 with x1874668789802624 ext(0->157) 00002000:00010000:3.0:1787826302.407675:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe099b4000 00000100:00100000:3.0:1787826302.407714:0:25758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1577 00000100:00100000:3.0:1787826302.407724:0:25758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789802624:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.414427:0:25758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789802624:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 6682us (8161us total) trans 4294968168 rc 0/0 00000100:00100000:1.0:1787826302.414442:0:25758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1577 00002000:00100000:1.0:1787826302.414457:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xc4:0x0] (0->157) req@ffff9bbe099b4000 x1874668789802624/t4294968168(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/448 e 0 to 0 dl 1787826313 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826302.414468:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe099b4000 with x1874668789802624 ext(0->157) 00002000:00010000:1.0:1787826302.414474:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe099b4000 00000100:00100000:0.0:1787826302.414995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.415022:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789802752 00000100:00100000:0.0:1787826302.415029:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789802752 00010000:00010000:0.0:1787826302.415059:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf55 expref: 17 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.415088:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3051 00000100:00100000:0.0:1787826302.415096:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789802752:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.415110:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.415129:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf55 expref: 17 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.415142:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf55 expref: 17 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.415164:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349b594 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf55 expref: 17 pid: 25038 timeout: 3040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.415179:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.415183:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.415191:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 16 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.415201:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 16 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.415231:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 16 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.415244:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778634112:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826302.415305:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.415341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.415361:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789802880 00000100:00100000:0.0:1787826302.415365:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789802880 00000100:00100000:0.0:1787826302.415392:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111468 00000100:00100000:0.0:1787826302.415398:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84221:x1874668789802880:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787826302.425005:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016553 is committed 00000020:00080000:1.0:1787826302.425056:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe16caea80 refcount 2 committed 0 result 0 batchid 4294970891 00000020:00080000:1.0:1787826302.425061:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0721aa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16cae3c0 00000020:00080000:1.0:1787826302.425065:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf05e83f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe124a4000 00000020:00080000:1.0:1787826302.425088:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbf06ec9300 refcount 2 committed 0 result 0 batchid 4294970890 00000020:00080000:1.0:1787826302.425091:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf0e4feb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf012ed900 00000020:00080000:1.0:1787826302.425095:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf02b70c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0e943600 00000020:00080000:1.0:1787826302.425106:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe17d56600 refcount 2 committed 0 result 0 batchid 4294970889 00000020:00080000:1.0:1787826302.425109:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf1064c200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17d56180 00000020:00080000:1.0:1787826302.425112:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf1064c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0dde9000 00000020:00080000:1.0:1787826302.425122:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970888 batchid updated 00000020:00080000:1.0:1787826302.425147:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970891 committed batchid 4294970888 00000020:00080000:1.0:1787826302.425222:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970888 00010000:00010000:0.0:1787826302.426026:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426040:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426048:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426055:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.426059:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426066:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426081:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x125:0x0].0x0 (ffff9bbe12458600) 00010000:00010000:0.0:1787826302.426085:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.426089:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426094:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b32c lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x125:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426118:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426124:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426129:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426133:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.426136:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426141:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426147:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x126:0x0].0x0 (ffff9bbe12458e00) 00010000:00010000:0.0:1787826302.426149:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.426152:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426158:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349b33a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x126:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426171:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426180:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426186:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426192:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.426194:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426200:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426208:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x127:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:0.0:1787826302.426210:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.426212:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426219:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349b35d lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x127:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426231:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426237:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426243:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426248:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.426251:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426257:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426264:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:0.0:1787826302.426267:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826302.426270:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426276:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b48a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426960:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426969:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426975:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426980:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.426983:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426989:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.426998:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:0.0:1787826302.427001:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826302.427005:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.427011:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b4d7 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.427021:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.427027:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.427032:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.427037:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.427040:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.427045:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.427053:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:0.0:1787826302.427055:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826302.427057:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.427063:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b516 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.427458:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84221:x1874668789802880:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 12052us (12110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.427469:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111468 00000100:00100000:2.0:1787826302.429619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.429649:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789803008 00000100:00100000:2.0:1787826302.429658:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789803008 00002000:00100000:2.0:1787826302.429706:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc4:0x0] (0->157) req@ffff9bbf3fc7a940 x1874668789803008/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/0 e 0 to 0 dl 1787826313 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826302.429717:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fc7a940 with x1874668789803008 ext(0->157) 00002000:00010000:2.0:1787826302.429723:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fc7a940 00000100:00100000:2.0:1787826302.429749:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1578 00000100:00100000:2.0:1787826302.429757:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789803008:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.433104:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778634112:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826302.433132:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826302.433199:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789802752:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 18103us (18205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.433211:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3051 00000100:00100000:2.0:1787826302.434673:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789803008:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 4911us (5056us total) trans 4294968184 rc 0/0 00000100:00100000:2.0:1787826302.434686:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1578 00002000:00100000:2.0:1787826302.434697:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc4:0x0] (0->157) req@ffff9bbf3fc7a940 x1874668789803008/t4294968184(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/448 e 0 to 0 dl 1787826313 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826302.434708:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fc7a940 with x1874668789803008 ext(0->157) 00002000:00010000:2.0:1787826302.434714:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fc7a940 00000100:00100000:2.0:1787826302.434788:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.439373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.439426:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789803264 00000100:00100000:0.0:1787826302.439435:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789803264 00000100:00100000:0.0:1787826302.439489:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6276 00000100:00100000:0.0:1787826302.439497:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2399:x1874668789803264:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787826302.442921:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968184 is committed 00000001:00080000:0.0:1787826302.442942:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968182 is committed 00000100:00100000:1.0:1787826302.443093:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789803136 00000100:00100000:1.0:1787826302.443103:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789803136 00000100:00100000:1.0:1787826302.443167:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111469 00000100:00100000:1.0:1787826302.443178:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84220:x1874668789803136:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.446026:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789803264:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 6519us (6651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.446041:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6276 00000100:00100000:1.0:1787826302.448004:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84220:x1874668789803136:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 4818us (13206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.448017:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111469 00000100:00100000:2.0:1787826302.451081:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.451765:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789803392 00000100:00100000:1.0:1787826302.451775:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789803392 00000100:00100000:1.0:1787826302.451845:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111470 00000100:00100000:1.0:1787826302.452027:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84222:x1874668789803392:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.452165:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84222:x1874668789803392:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 311us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.452174:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111470 00000100:00100000:2.0:1787826302.455800:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.456159:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789803520 00000100:00100000:1.0:1787826302.456168:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789803520 00000100:00100000:1.0:1787826302.456227:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6277 00000100:00100000:1.0:1787826302.456238:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789803520:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787826302.460241:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968168 is committed 00000001:00080000:1.0:1787826302.460258:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968167 is committed 00000100:00100000:2.0:1787826302.462353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.462509:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789803776 00000100:00100000:1.0:1787826302.462517:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789803776 00000100:00100000:1.0:1787826302.462572:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111471 00000100:00100000:1.0:1787826302.462581:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84221:x1874668789803776:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.462633:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826302.462656:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b540 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x128:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf1d expref: 31 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.462674:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:1.0:1787826302.462679:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826302.462722:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.462733:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.462742:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826302.463081:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000158674bc reply state 000000005b26ebf7 transno 8590016554 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.463096:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.463102:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:1.0:1787826302.463105:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826302.463108:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826302.463316:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84221:x1874668789803776:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 735us (971us total) trans 8590016554 rc 0/0 00000100:00100000:1.0:1787826302.463324:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111471 00000100:00100000:0.0:1787826302.466593:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789803520:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 10342us (10787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.466606:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6277 00000100:00100000:2.0:1787826302.469342:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.471705:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789803904 00000100:00100000:0.0:1787826302.471720:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789803904 00000100:00100000:0.0:1787826302.471785:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6278 00000100:00100000:0.0:1787826302.471795:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789803904:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.472046:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789803904:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 252us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.472054:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6278 00000100:00100000:2.0:1787826302.475538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.475569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.476215:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789804032 00000100:00100000:3.0:1787826302.476224:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789804032 00000100:00100000:3.0:1787826302.476290:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789804288 00000100:00100000:3.0:1787826302.476295:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789804288 00000100:00100000:3.0:1787826302.476319:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111472 00000100:00100000:3.0:1787826302.476329:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84221:x1874668789804032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.476353:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.476374:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf63 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.476442:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf63 expref: 34 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.476459:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf63 expref: 34 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.476477:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:3.0:1787826302.476480:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.476484:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:3.0:1787826302.476537:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84221:x1874668789804032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 209us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.476543:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111472 00000100:00100000:3.0:1787826302.476563:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111473 00000100:00100000:3.0:1787826302.476570:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84220:x1874668789804288:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.476604:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.476622:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b55c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x129:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf32 expref: 33 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.476635:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826302.476640:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826302.476660:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.476669:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.476677:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826302.477485:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe62596e reply state 00000000e8a0e273 transno 8590016555 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.477501:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.477509:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826302.477511:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826302.477514:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826302.477582:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84220:x1874668789804288:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1011us (2010us total) trans 8590016555 rc 0/0 00000100:00100000:3.0:1787826302.477590:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111473 00000100:00100000:2.0:1787826302.480638:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.481434:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789804544 00000100:00100000:3.0:1787826302.481445:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789804544 00000100:00100000:3.0:1787826302.481501:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111474 00000100:00100000:3.0:1787826302.481511:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84222:x1874668789804544:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.481561:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.481588:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b586 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf47 expref: 34 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.481610:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826302.481615:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826302.481642:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.481655:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.481664:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826302.481789:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a7c34c9 reply state 0000000025084bc3 transno 8590016556 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.481811:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.481818:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826302.481821:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826302.481824:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826302.485260:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84222:x1874668789804544:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 3741us (4621us total) trans 8590016556 rc 0/0 00000100:00100000:3.0:1787826302.485274:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111474 00000100:00100000:2.0:1787826302.489087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.489238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.489268:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789804800 00000100:00100000:2.0:1787826302.489277:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789804800 00000100:00100000:2.0:1787826302.489337:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111475 00000100:00100000:2.0:1787826302.489348:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84220:x1874668789804800:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.489371:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.489392:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 2/0,0 mode: --/CR res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf6a expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.489460:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf6a expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.489476:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf6a expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.489495:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826302.489498:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.489502:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:2.0:1787826302.489553:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84220:x1874668789804800:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 207us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.489560:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111475 00000100:00100000:3.0:1787826302.490205:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789804672 00000100:00100000:3.0:1787826302.490211:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789804672 00000100:00100000:3.0:1787826302.490297:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6279 00000100:00100000:3.0:1787826302.490305:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789804672:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826302.490458:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826302.490462:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb mtime from disk: 0 -> 1787826221 00002000:00010000:3.0:1787826302.490465:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb atime from disk: 0 -> 1787826221 00002000:00010000:3.0:1787826302.490467:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb ctime from disk: 0 -> 1787826221 00002000:00010000:3.0:1787826302.490470:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826302.490504:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789804672:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 200us (1427us total) trans 4294968185 rc 0/0 00000100:00100000:3.0:1787826302.490512:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6279 00000100:00100000:2.0:1787826302.493690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.493805:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.494266:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789804928 00000100:00100000:3.0:1787826302.494275:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789804928 00000100:00100000:3.0:1787826302.494332:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111476 00000100:00100000:3.0:1787826302.494340:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84222:x1874668789804928:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.494363:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.494381:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf71 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.494443:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf71 expref: 37 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.494456:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf71 expref: 37 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.494473:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826302.494475:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.494480:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826302.494526:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84222:x1874668789804928:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 186us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.494532:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111476 00000100:00100000:0.0:1787826302.495945:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789805056 00000100:00100000:0.0:1787826302.495954:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789805056 00000100:00100000:0.0:1787826302.495993:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6280 00000100:00100000:0.0:1787826302.496001:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789805056:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826302.496143:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826302.496147:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb mtime from disk: 0 -> 1787826221 00002000:00010000:0.0:1787826302.496149:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb atime from disk: 0 -> 1787826221 00002000:00010000:0.0:1787826302.496152:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb ctime from disk: 0 -> 1787826221 00002000:00010000:0.0:1787826302.496155:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826302.496206:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789805056:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 204us (2399us total) trans 4294968169 rc 0/0 00000100:00100000:0.0:1787826302.496214:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6280 00000100:00100000:3.0:1787826302.497721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.497752:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789805312 00000100:00100000:3.0:1787826302.497760:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789805312 00000100:00100000:3.0:1787826302.497816:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111477 00000100:00100000:3.0:1787826302.497825:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84221:x1874668789805312:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.497913:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.497929:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed7 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.497939:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 4/0,1 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.497972:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed7 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.497987:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed7 expref: 37 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.498002:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0321c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778634240:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826302.498076:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c66d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.501170:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.501291:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.501315:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789805696 00000100:00100000:3.0:1787826302.501323:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789805696 00010000:00010000:3.0:1787826302.501360:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed7 expref: 38 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.501400:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3052 00000100:00100000:3.0:1787826302.501420:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40511450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789805696:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.501434:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.501440:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed7 expref: 38 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.501453:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed7 expref: 38 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.501476:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:3.0:1787826302.501481:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.501490:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.501498:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.501516:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.501563:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40511450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789805696:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 144us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.501570:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3052 00010000:00010000:0.0:1787826302.501754:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349b47c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x128:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbed7 expref: 37 pid: 6515 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.501770:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0321c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778634240:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.501787:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.501809:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.501815:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.501887:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.501895:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.501902:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.501908:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.501913:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.501925:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.501936:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:0.0:1787826302.501938:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826302.501942:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 2/0,0 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.501948:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349b5cc lrc: 0/0,0 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.501996:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84221:x1874668789805312:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 4172us (4279us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826302.502005:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111477 00000100:00100000:0.0:1787826302.502021:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789805568 00000100:00100000:0.0:1787826302.502025:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789805568 00000100:00100000:2.0:1787826302.511639:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111478 00000100:00100000:2.0:1787826302.511660:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84220:x1874668789805568:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.511726:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.511745:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbef3 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.511754:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.511790:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbef3 expref: 36 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.511818:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbef3 expref: 36 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.511833:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08302d00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778634368:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826302.511949:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.513784:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.513894:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789805824 00000100:00100000:0.0:1787826302.513903:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789805824 00000100:00100000:0.0:1787826302.513948:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6281 00000100:00100000:0.0:1787826302.513957:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789805824:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826302.514096:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826302.514100:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb mtime from disk: 0 -> 1787826221 00002000:00010000:0.0:1787826302.514103:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb atime from disk: 0 -> 1787826221 00002000:00010000:0.0:1787826302.514105:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb ctime from disk: 0 -> 1787826221 00002000:00010000:0.0:1787826302.514108:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826302.514164:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789805824:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 208us (387us total) trans 4294968186 rc 0/0 00000100:00100000:0.0:1787826302.514175:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6281 00000100:00100000:3.0:1787826302.524172:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.524538:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789805952 00000100:00100000:0.0:1787826302.524547:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789805952 00000100:00100000:0.0:1787826302.524604:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6282 00000100:00100000:0.0:1787826302.524613:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789805952:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.524657:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.524676:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.524684:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.524688:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826302.524705:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.524740:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.524751:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 15 pid: 8433 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.524764:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778634496:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.525393:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd099c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.529828:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.529887:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789806080 00000100:00100000:3.0:1787826302.529896:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789806080 00010000:00010000:3.0:1787826302.529938:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbef3 expref: 37 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.529975:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3053 00000100:00100000:3.0:1787826302.529984:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2401:x1874668789806080:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.529999:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.530005:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbef3 expref: 37 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.530018:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbef3 expref: 37 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.530043:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826302.530049:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.530058:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.530065:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.530083:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.530131:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2401:x1874668789806080:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 148us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.530138:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3053 00000100:00100000:3.0:1787826302.530188:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.530211:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789806336 00000100:00100000:3.0:1787826302.530215:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789806336 00000100:00100000:3.0:1787826302.530241:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111479 00000100:00100000:3.0:1787826302.530249:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84222:x1874668789806336:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.530308:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.530321:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf01 expref: 37 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.530329:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.530356:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf01 expref: 37 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.530367:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf01 expref: 37 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.530379:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778634624:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826302.530436:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15babb40 going to sleep for 11 seconds 00010000:00010000:2.0:1787826302.530793:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349b4c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x129:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbef3 expref: 37 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.530808:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08302d00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778634368:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.530824:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.530833:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.530838:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.530905:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.530914:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.530922:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.530928:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.530932:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.530939:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.530950:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826302.530953:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826302.530957:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.530964:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b5d3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.531008:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84220:x1874668789805568:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 19357us (29847us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826302.531016:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111478 00000100:00100000:0.0:1787826302.532620:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778634496:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.532642:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.535129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.535213:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789806464 00000100:00100000:0.0:1787826302.535221:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789806464 00010000:00010000:0.0:1787826302.535262:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 16 pid: 8433 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.535319:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3054 00000100:00100000:0.0:1787826302.535329:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789806464:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.535347:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.535371:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 16 pid: 8433 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535385:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 16 pid: 8433 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535418:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349b571 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf39 expref: 16 pid: 8433 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535434:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826302.535438:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826302.535444:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535454:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535480:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826302.535531:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789806464:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 203us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.535538:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3054 00010000:00010000:0.0:1787826302.535563:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535572:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535591:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535599:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535607:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535614:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826302.535619:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535627:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535644:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.535651:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8c302eb/0x68019081f349b5da lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.535711:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789805952:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 11099us (11549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.535720:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6282 00000100:00100000:3.0:1787826302.539032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.539067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.539090:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789806720 00000100:00100000:3.0:1787826302.539098:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789806720 00010000:00010000:3.0:1787826302.539135:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf01 expref: 36 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.539168:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3055 00000100:00100000:3.0:1787826302.539177:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2400:x1874668789806720:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.539192:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.539199:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf01 expref: 36 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.539211:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf01 expref: 36 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.539232:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826302.539238:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.539247:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.539255:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.539273:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.539332:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2400:x1874668789806720:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 156us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.539341:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3055 00010000:00010000:0.0:1787826302.540487:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349b508 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf01 expref: 35 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.540510:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778634624:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.540531:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.540540:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.540545:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.540587:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.540593:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.540604:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.540610:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.540614:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.540622:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.540634:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:0.0:1787826302.540637:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826302.540640:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.540646:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349b5e1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.540712:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84222:x1874668789806336:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 10463us (10523us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826302.540720:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111479 00000100:00100000:1.0:1787826302.541119:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789806592 00000100:00100000:1.0:1787826302.541126:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789806592 00000100:00100000:1.0:1787826302.541166:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6283 00000100:00100000:1.0:1787826302.541175:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789806592:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.541214:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.541231:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.541240:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.541244:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826302.541249:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.541280:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 10 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.543597:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826302.544046:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 10 pid: 19335 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.544072:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778634752:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826302.544153:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf40437780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.546118:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.548204:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778634752:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826302.548232:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.549924:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789807104 00000100:00100000:2.0:1787826302.549935:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789807104 00000100:00100000:2.0:1787826302.549986:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6284 00000100:00100000:2.0:1787826302.549996:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789807104:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.550040:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.550060:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 14 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.550069:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826302.550073:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826302.550077:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.550114:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 14 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.550126:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 14 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.550141:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778634880:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826302.550218:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.552991:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.553023:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789807232 00000100:00100000:3.0:1787826302.553031:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789807232 00010000:00010000:3.0:1787826302.553070:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 11 pid: 19335 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.553109:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3056 00000100:00100000:3.0:1787826302.553117:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789807232:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.553130:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.553150:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 11 pid: 19335 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553163:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 11 pid: 19335 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553202:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349b58d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf4e expref: 11 pid: 19335 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553216:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826302.553220:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826302.553226:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553236:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553262:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.553306:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789807232:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 189us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.553314:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3056 00010000:00010000:3.0:1787826302.553338:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553347:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553367:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553375:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553383:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553390:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826302.553394:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553413:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553426:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.553433:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be6e1168/0x68019081f349b5e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.553494:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789806592:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 12319us (14471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.553502:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6283 00000100:00100000:2.0:1787826302.554084:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778634880:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.554108:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.554198:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789806976 00000100:00100000:0.0:1787826302.554203:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789806976 00000100:00100000:3.0:1787826302.554227:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.554238:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111480 00000100:00100000:0.0:1787826302.554246:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84221:x1874668789806976:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.554323:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554338:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554348:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554502:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554513:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf63 expref: 35 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554521:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554546:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf63 expref: 35 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554557:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf63 expref: 35 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.554570:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778635008:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.554630:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.554645:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789807360 00000100:00100000:0.0:1787826302.554649:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789807360 00010000:00010000:0.0:1787826302.554665:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 15 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.554684:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3057 00000100:00100000:0.0:1787826302.554689:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789807360:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.554700:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.554712:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 15 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554722:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 15 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554739:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349b59b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf5c expref: 15 pid: 8430 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554751:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826302.554754:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826302.554759:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554767:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.554780:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826302.554809:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789807360:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 108us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.554815:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3057 00010000:00010000:2.0:1787826302.555187:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.555201:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.555220:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.555228:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.555236:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.555242:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826302.555246:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.555253:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.555264:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.555271:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349b5ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.555330:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789807104:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 5336us (9220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.555338:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6284 00000100:00100000:2.0:1787826302.560739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.560833:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778635008:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.560889:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.560964:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789807616 00000100:00100000:3.0:1787826302.560971:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789807616 00000100:00100000:3.0:1787826302.561029:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111481 00000100:00100000:3.0:1787826302.561039:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84220:x1874668789807616:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.561114:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.561128:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.561139:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.561343:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.561353:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf6a expref: 37 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.561361:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.561393:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf6a expref: 37 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.561419:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf6a expref: 37 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.561432:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778635136:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826302.561524:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf1351b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826302.564355:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.564395:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.564465:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789808000 00000100:00100000:1.0:1787826302.564474:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789808000 00000100:00100000:1.0:1787826302.564565:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111482 00000100:00100000:1.0:1787826302.564574:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84222:x1874668789808000:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.564639:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.564653:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.564661:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.564802:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.564814:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf71 expref: 39 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.564821:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.564864:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf71 expref: 39 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.564882:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf71 expref: 39 pid: 25756 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.564896:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778635264:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826302.565331:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf404376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.565705:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789807744 00000100:00100000:3.0:1787826302.565711:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789807744 00010000:00010000:3.0:1787826302.565742:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf63 expref: 40 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.565787:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3058 00000100:00100000:3.0:1787826302.565801:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789807744:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.565813:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.565819:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf63 expref: 40 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.565832:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf63 expref: 40 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.565937:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b5a9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf63 expref: 40 pid: 23845 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.565954:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:3.0:1787826302.565959:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.565972:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.565979:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.566004:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.566037:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789807744:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 242us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.566044:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3058 00010000:00010000:3.0:1787826302.566071:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.566079:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826302.566149:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016557 00000001:00080000:3.0:1787826302.571763:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016560 00000001:00080000:3.0:1787826302.571873:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016561 00000100:00100000:3.0:1787826302.571970:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778635392:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826302.572041:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826302.572077:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c17e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.572106:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778635392 00000100:00100000:3.0:1787826302.572113:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778635392 00000100:00100000:3.0:1787826302.572159:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3342 00000100:00100000:3.0:1787826302.572168:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778635392:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826302.572248:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778635392:12345-0@lo:1000:mdt00_004.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.572259:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3342 00000100:00100000:3.0:1787826302.572296:0:12105:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968182 gen 2 00000004:00080000:3.0:1787826302.572301:0:12105:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968182 committed transno 4294968182 00000100:00100000:3.0:1787826302.572323:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778635392:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787826302.572432:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016562 00000100:00100000:3.0:1787826302.572470:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778635520:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826302.572495:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826302.572512:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c17eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.572525:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778635520 00000100:00100000:3.0:1787826302.572528:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778635520 00000100:00100000:3.0:1787826302.572551:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3343 00000100:00100000:3.0:1787826302.572557:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778635520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826302.572639:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:12105:x1874668778635520:12345-0@lo:1000:mdt00_004.0 Request processed in 82us (144us total) trans 4294968187 rc 0/0 00000100:00100000:3.0:1787826302.572647:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3343 00000100:00100000:3.0:1787826302.572678:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778635520:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787826302.572721:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016563 00010000:00010000:3.0:1787826302.572742:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572751:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572759:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572764:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.572769:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572776:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572792:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:3.0:1787826302.572795:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.572800:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572806:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b5fd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572827:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f3499152 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572833:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f3499152 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572839:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f3499152 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572843:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.572847:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f3499152 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572873:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f3499152 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572881:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf6:0x0].0x0 (ffff9bbe16cc5f00) 00010000:00010000:3.0:1787826302.572883:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.572887:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f3499152 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572893:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f3499152 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572914:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572926:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572935:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572941:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572946:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572952:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572956:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.572959:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572965:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572971:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf6:0x0].0x0 (ffff9bbe16cc5f00) 00010000:00010000:3.0:1787826302.572973:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.572976:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572982:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b620 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572991:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.572996:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573002:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573007:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.573009:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573015:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573021:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf6:0x0].0x0 (ffff9bbe16cc5f00) 00010000:00010000:3.0:1787826302.573023:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826302.573026:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573031:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b5f6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.573133:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84221:x1874668789806976:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 18886us (29540us total) trans 8590016564 rc 0/0 00000100:00100000:3.0:1787826302.573141:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111480 00000020:00080000:3.0:1787826302.573145:0:12105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826302.573179:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778635136:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826302.573194:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.573240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.573262:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789808128 00000100:00100000:3.0:1787826302.573267:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789808128 00010000:00010000:3.0:1787826302.573284:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf6a expref: 43 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.573304:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3059 00000100:00100000:3.0:1787826302.573310:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40513050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2402:x1874668789808128:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.573324:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.573329:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf6a expref: 43 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573339:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf6a expref: 43 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573354:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b5be lrc: 0/0,0 mode: --/CR res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf6a expref: 43 pid: 12105 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573363:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826302.573367:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573374:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573381:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573397:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.573429:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40513050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+42:2402:x1874668789808128:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 119us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.573435:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3059 00010000:00010000:3.0:1787826302.573478:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.573485:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826302.573537:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016558 00000001:00080000:3.0:1787826302.573621:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016565 00000001:00080000:3.0:1787826302.573650:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016566 00000100:00100000:3.0:1787826302.573704:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08302d00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778635648:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787826302.573739:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826302.573759:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c17e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.579495:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778635264:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826302.579530:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.579793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.579824:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789808256 00000100:00100000:0.0:1787826302.579831:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789808256 00010000:00010000:0.0:1787826302.579887:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf71 expref: 45 pid: 25756 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.579920:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3060 00000100:00100000:0.0:1787826302.579929:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+45:2401:x1874668789808256:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.579943:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.579951:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf71 expref: 45 pid: 25756 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.579965:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf71 expref: 45 pid: 25756 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.579988:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b5c5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf71 expref: 45 pid: 25756 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.580008:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:0.0:1787826302.580012:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.580022:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.580031:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.580059:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826302.580189:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+44:2401:x1874668789808256:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 259us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.580273:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3060 00000100:00100000:2.0:1787826302.580433:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778635648 00000100:00100000:2.0:1787826302.580439:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778635648 00000100:00100000:2.0:1787826302.580473:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3344 00000100:00100000:2.0:1787826302.580480:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778635648:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1787826302.580524:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.580585:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778635648:12345-0@lo:1000:mdt00_006.0 Request processed in 105us (6844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.580592:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3344 00010000:00010000:0.0:1787826302.580756:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.580765:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.580781:0:25756:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968167 gen 2 00000004:00080000:3.0:1787826302.580788:0:25756:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968166 committed transno 4294968167 00000001:00080000:0.0:1787826302.580886:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016559 00000001:00080000:0.0:1787826302.581000:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016568 00000004:00080000:3.0:1787826302.581036:0:25756:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968167 committed transno 4294968167 00000001:00080000:0.0:1787826302.581039:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016569 00000100:00100000:3.0:1787826302.581053:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08302d00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778635648:0@lo:1000:mdt00_006.0 00000001:00080000:3.0:1787826302.581160:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016567 00000100:00100000:3.0:1787826302.581215:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc4780 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778635776:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787826302.581254:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826302.581276:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17d56cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.581552:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789808512 00000100:00100000:1.0:1787826302.581558:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789808512 00000100:00100000:2.0:1787826302.581907:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778635776 00000100:00100000:2.0:1787826302.581912:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778635776 00000100:00100000:2.0:1787826302.581944:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3345 00000100:00100000:2.0:1787826302.581951:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778635776:12345-0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787826302.582071:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778635776:12345-0@lo:1000:mdt00_006.0 Request processed in 120us (816us total) trans 4294968170 rc 0/0 00000100:00100000:2.0:1787826302.582079:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3345 00000100:00100000:3.0:1787826302.582288:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc4780 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778635776:0@lo:1000:mdt00_006.0 00000001:00080000:3.0:1787826302.582349:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016571 00010000:00010000:3.0:1787826302.582375:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582385:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582392:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582397:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.582412:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582420:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582434:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826302.582436:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.582440:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582447:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b60b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582468:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349914b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.582471:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778635904:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787826302.582478:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349914b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582486:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349914b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582492:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.582495:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349914b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582501:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349914b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582509:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf5:0x0].0x0 (ffff9bbe16cc5b00) 00010000:00010000:3.0:1787826302.582511:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.582515:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349914b lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.582516:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826302.582525:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349914b lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.582544:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00010000:00010000:3.0:1787826302.582550:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582562:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.582564:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778635904 00000100:00100000:0.0:1787826302.582569:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778635904 00010000:00010000:3.0:1787826302.582573:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582581:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582587:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582592:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582597:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.582600:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582604:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582610:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf5:0x0].0x0 (ffff9bbe16cc5b00) 00010000:00010000:3.0:1787826302.582612:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.582615:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582621:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b627 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582630:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582635:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582641:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582646:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.582649:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582654:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.582659:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2689 00010000:00010000:3.0:1787826302.582670:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf5:0x0].0x0 (ffff9bbe16cc5b00) 00010000:00010000:3.0:1787826302.582674:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1787826302.582676:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84221:x1874668789808512:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.582678:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.582688:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b604 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826302.582844:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x128:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826302.582907:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016573 00010000:00010000:1.0:1787826302.582932:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.582942:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.582951:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.582959:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.582966:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.582972:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.582989:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826302.583059:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84221:x1874668789808512:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 388us (2535us total) trans 8590016574 rc 0/0 00000100:00100000:1.0:1787826302.583067:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2689 00000020:00080000:1.0:1787826302.583071:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826302.583278:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346 00000100:00100000:0.0:1787826302.583356:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778635904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826302.583739:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778635904:12345-0@lo:1000:mdt00_000.0 Request processed in 387us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.583747:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346 00000100:00100000:0.0:1787826302.583793:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778635904:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787826302.583918:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016570 00000100:00100000:3.0:1787826302.584035:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84220:x1874668789807616:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 22995us (23304us total) trans 8590016572 rc 0/0 00000100:00100000:3.0:1787826302.584044:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111481 00000020:00080000:3.0:1787826302.584048:0:25756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00010000:00010000:1.0:1787826302.584692:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826302.584702:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.584714:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826302.584718:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.584728:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.584743:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:1.0:1787826302.584748:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826302.584752:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 1/0,0 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.584758:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b62e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x128:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.584768:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826302.584770:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826302.584771:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826302.584849:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778636032:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826302.584910:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.584933:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.586396:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778636032 00000100:00100000:3.0:1787826302.586418:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778636032 00000100:00100000:3.0:1787826302.590738:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3347 00000100:00100000:3.0:1787826302.590758:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6515:x1874668778636032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787826302.591327:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.591333:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6515:x1874668778636032:12345-0@lo:1000:mdt00_000.0 Request processed in 582us (6421us total) trans 4294968188 rc 0/0 00000100:00100000:3.0:1787826302.591342:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3347 00000100:00100000:2.0:1787826302.591437:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789808768 00000100:00100000:2.0:1787826302.591444:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789808768 00000100:00100000:2.0:1787826302.591475:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2690 00000100:00100000:2.0:1787826302.591482:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84220:x1874668789808768:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826302.591670:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x129:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826302.591710:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016576 00010000:00010000:2.0:1787826302.591738:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.591753:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.591764:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.591773:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.591780:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.591786:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.591808:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826302.591954:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84220:x1874668789808768:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 471us (631us total) trans 8590016577 rc 0/0 00000100:00100000:2.0:1787826302.591961:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2690 00000020:00080000:2.0:1787826302.591965:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787826302.591987:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826302.591993:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.592005:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826302.592009:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.592017:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.592028:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:2.0:1787826302.592031:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826302.592035:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.592042:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b635 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x129:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.592055:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826302.592057:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826302.592059:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826302.593143:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1874668778636032:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787826302.593223:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016575 00010000:00010000:3.0:1787826302.593253:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593262:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593268:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593274:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.593278:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593284:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593295:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826302.593298:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.593301:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593307:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b619 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593327:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f3499159 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593333:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f3499159 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593339:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f3499159 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593344:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.593347:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f3499159 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593352:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f3499159 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593363:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf7:0x0].0x0 (ffff9bbe16cc5500) 00010000:00010000:3.0:1787826302.593366:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.593368:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f3499159 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593374:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f3499159 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593390:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593412:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593420:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593427:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593433:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593438:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593443:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.593446:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593452:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593459:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf7:0x0].0x0 (ffff9bbe16cc5500) 00010000:00010000:3.0:1787826302.593461:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.593464:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593470:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b63c lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593478:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593484:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593489:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593493:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.593496:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593501:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593507:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf7:0x0].0x0 (ffff9bbe16cc5500) 00010000:00010000:3.0:1787826302.593510:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826302.593513:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.593519:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b612 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.593626:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84222:x1874668789808000:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 29052us (29227us total) trans 8590016578 rc 0/0 00000100:00100000:3.0:1787826302.593635:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111482 00000020:00080000:3.0:1787826302.593639:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787826302.594144:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826302.594149:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826302.594251:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9697 count 103 00000040:00080000:2.0:1787826302.594258:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787826302.594370:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a5621c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778636160:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787826302.594429:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.608279:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.608517:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a5621c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778636160:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826302.610104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.610140:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.610165:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.610366:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789809152 00000100:00100000:3.0:1787826302.610375:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789809152 00000100:00100000:3.0:1787826302.610439:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789809280 00000100:00100000:3.0:1787826302.610443:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789809280 00000100:00100000:3.0:1787826302.610462:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789809408 00000100:00100000:3.0:1787826302.610465:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789809408 00000100:00100000:3.0:1787826302.610488:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111483 00000100:00100000:3.0:1787826302.610498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84230:x1874668789809152:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826302.610537:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf8:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826302.610657:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84230:x1874668789809152:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 159us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.610665:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111483 00000100:00100000:3.0:1787826302.610682:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111484 00000100:00100000:3.0:1787826302.610689:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84231:x1874668789809280:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826302.610703:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf9:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826302.610743:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84231:x1874668789809280:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 55us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.610750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111484 00000100:00100000:3.0:1787826302.610761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111485 00000100:00100000:3.0:1787826302.610768:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84232:x1874668789809408:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826302.610782:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfa:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826302.610819:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84232:x1874668789809408:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 51us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.610825:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111485 00000100:00100000:2.0:1787826302.611472:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789809024 00000100:00100000:2.0:1787826302.611478:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789809024 00000100:00100000:2.0:1787826302.611515:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2691 00000100:00100000:2.0:1787826302.611523:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84222:x1874668789809024:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826302.611743:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x12a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826302.611774:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016579 00010000:00010000:2.0:1787826302.611807:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.611824:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.611836:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.611844:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.611867:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.613862:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.613896:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826302.613998:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84222:x1874668789809024:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 2472us (5726us total) trans 8590016580 rc 0/0 00000100:00100000:2.0:1787826302.614643:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2691 00000020:00080000:2.0:1787826302.614651:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826302.615155:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826302.615164:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.615176:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826302.615181:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.615195:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.615214:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:1.0:1787826302.615217:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826302.615221:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.615227:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b643 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.615238:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826302.615243:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826302.615245:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826302.618559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.618596:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789809536 00000100:00100000:1.0:1787826302.618606:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789809536 00000100:00100000:1.0:1787826302.618660:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111486 00000100:00100000:1.0:1787826302.618670:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84230:x1874668789809536:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.618743:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618760:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618772:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618788:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618814:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618821:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618849:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618885:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618892:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826302.618938:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf8:0x0]: returning size 158 00000004:00200000:1.0:1787826302.618943:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826302.618956:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618969:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618976:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618982:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618989:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.618999:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.619004:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619011:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619022:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826302.619025:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826302.619030:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619036:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b64a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619049:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619055:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619060:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619065:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.619067:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619073:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619083:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x68e74412 (ffff9bbe12458d00) 00010000:00010000:1.0:1787826302.619085:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826302.619088:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619093:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b651 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x68e74412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619109:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619114:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619119:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619124:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.619126:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619132:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619139:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf8:0x0].0x0 (ffff9bbe16cc5000) 00010000:00010000:1.0:1787826302.619141:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826302.619143:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.619149:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b658 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.619219:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84230:x1874668789809536:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 551us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.619228:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111486 00000100:00100000:1.0:1787826302.619278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.619685:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789809664 00000100:00100000:3.0:1787826302.619692:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789809664 00000100:00100000:3.0:1787826302.619735:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111487 00000100:00100000:3.0:1787826302.619743:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84231:x1874668789809664:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.619781:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619793:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619801:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619814:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619821:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619828:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619846:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619895:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619903:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826302.619931:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf9:0x0]: returning size 158 00000004:00200000:3.0:1787826302.619934:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826302.619943:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619952:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619958:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619964:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619969:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619974:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.619977:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619984:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.619992:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826302.619994:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.619998:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620007:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349b65f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620016:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620021:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620026:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620030:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.620032:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620037:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620043:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3ba553d2 (ffff9bbe08124800) 00010000:00010000:3.0:1787826302.620046:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.620048:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620052:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b666 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3ba553d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620064:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620069:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620076:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620081:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.620084:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620089:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620095:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf9:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:3.0:1787826302.620097:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.620100:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.620105:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b66d lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.620150:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84231:x1874668789809664:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 407us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.620157:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111487 00000100:00100000:0.0:1787826302.630248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.630380:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789809920 00000100:00100000:3.0:1787826302.630390:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789809920 00000100:00100000:3.0:1787826302.630462:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111488 00000100:00100000:3.0:1787826302.630472:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84231:x1874668789809920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.630497:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.630516:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b674 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630625:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630639:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630650:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826302.630661:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf9:0x0]: returning size 158 00010000:00010000:3.0:1787826302.630739:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630747:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630754:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630760:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.630765:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630772:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630783:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf9:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:3.0:1787826302.630786:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826302.630791:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630815:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b67b lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630882:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b674 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf78 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630893:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826302.630896:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826302.630900:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b674 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf78 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.630910:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606800, rc 0) 00000100:00100000:3.0:1787826302.630981:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84231:x1874668789809920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 510us (741us total) trans 8590016581 rc 301/301 00000100:00100000:3.0:1787826302.630989:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111488 00000100:00100000:0.0:1787826302.635357:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.635385:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.635424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.635484:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789810048 00000100:00100000:1.0:1787826302.635493:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789810048 00000100:00100000:1.0:1787826302.635541:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789810176 00000100:00100000:1.0:1787826302.635544:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789810176 00000100:00100000:1.0:1787826302.635558:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789810432 00000100:00100000:1.0:1787826302.635560:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789810432 00000100:00100000:1.0:1787826302.635577:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111489 00000100:00100000:1.0:1787826302.635584:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84232:x1874668789810048:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.635648:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.635664:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.635675:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.635689:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.635696:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.635702:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.635728:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.635736:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.635742:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826302.635779:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfa:0x0]: returning size 158 00000004:00200000:1.0:1787826302.635782:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826302.635793:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.635884:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111490 00000100:00100000:0.0:1787826302.635893:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84231:x1874668789810176:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826302.635908:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf9:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826302.635990:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84231:x1874668789810176:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 99us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.635998:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111490 00000100:00100000:0.0:1787826302.636016:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111491 00000100:00100000:0.0:1787826302.636021:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84230:x1874668789810432:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.636032:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.636042:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b69e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf7f expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636094:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636103:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636110:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826302.636118:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf8:0x0]: returning size 158 00010000:00010000:0.0:1787826302.636181:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636187:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636193:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636199:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.636204:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636211:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636227:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf8:0x0].0x0 (ffff9bbe16cc5000) 00010000:00010000:0.0:1787826302.636229:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826302.636233:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636239:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b6a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636270:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b69e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf7f expref: 59 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636279:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826302.636281:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826302.636285:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b69e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf7f expref: 59 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.636298:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc 0) 00000100:00100000:0.0:1787826302.636322:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84230:x1874668789810432:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 300us (897us total) trans 8590016582 rc 301/301 00000100:00100000:0.0:1787826302.636328:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111491 00010000:00010000:1.0:1787826302.636433:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636440:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636446:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636452:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636457:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.636460:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636465:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636474:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826302.636477:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826302.636480:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636486:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b689 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636495:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636500:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636506:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636511:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.636514:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636519:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636525:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x6e4b4494 (ffff9bbe12458d00) 00010000:00010000:1.0:1787826302.636527:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826302.636530:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636535:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b690 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x6e4b4494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636552:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636559:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636565:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636569:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.636572:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636577:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636583:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe16cc5200) 00010000:00010000:1.0:1787826302.636585:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826302.636588:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.636593:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b697 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.636622:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84232:x1874668789810048:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1038us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.636628:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111489 00000100:00100000:0.0:1787826302.642500:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.642541:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.642664:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.643801:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789810816 00000100:00100000:1.0:1787826302.643813:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789810816 00000100:00100000:1.0:1787826302.644062:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789810688 00000100:00100000:1.0:1787826302.644067:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789810688 00000100:00100000:1.0:1787826302.644090:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789811072 00000100:00100000:1.0:1787826302.644093:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789811072 00000100:00100000:1.0:1787826302.644115:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111492 00000100:00100000:1.0:1787826302.644124:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84230:x1874668789810816:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826302.644156:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xf8:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826302.644343:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111493 00000100:00100000:0.0:1787826302.644353:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84231:x1874668789810688:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.644364:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.644384:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b6b3 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf86 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645123:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b6ba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645138:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b6ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645148:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b6ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826302.645158:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12b:0x0]: returning size 0 00010000:00010000:0.0:1787826302.645276:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b6b3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf86 expref: 62 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645296:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b6ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf86 expref: 61 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645306:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbf0f565600) 00010000:00010000:0.0:1787826302.645309:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826302.645313:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3600, rc 0) 00000100:00100000:0.0:1787826302.645377:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84231:x1874668789810688:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1025us (2834us total) trans 8590016583 rc 0/0 00000100:00100000:0.0:1787826302.645385:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111493 00000100:00100000:0.0:1787826302.645425:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111494 00000100:00100000:0.0:1787826302.645434:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84232:x1874668789811072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.645444:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.645454:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b6c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf8d expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645635:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645646:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645654:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826302.645662:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfa:0x0]: returning size 158 00010000:00010000:0.0:1787826302.645699:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645707:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645719:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645726:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.645730:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645738:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645749:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe16cc5200) 00010000:00010000:0.0:1787826302.645752:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826302.645756:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645763:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b6cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645789:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b6c8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf8d expref: 62 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645799:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826302.645802:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826302.645807:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b6c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf8d expref: 62 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.645817:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3200, rc 0) 00000100:00100000:0.0:1787826302.645841:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84232:x1874668789811072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 409us (3176us total) trans 8590016584 rc 301/301 00000100:00100000:0.0:1787826302.646027:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111494 00000100:00100000:1.0:1787826302.648914:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84230:x1874668789810816:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 4780us (6414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.648928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111492 00000100:00100000:0.0:1787826302.662057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.662094:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.662139:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789811328 00000100:00100000:2.0:1787826302.662150:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789811328 00000100:00100000:1.0:1787826302.662164:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789811456 00000100:00100000:1.0:1787826302.662168:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789811456 00000100:00100000:2.0:1787826302.662207:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111495 00000100:00100000:2.0:1787826302.662217:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84231:x1874668789811328:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.662273:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.662311:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b6ba lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf86 expref: 61 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662331:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbf0f565600) 00010000:00010000:2.0:1787826302.662343:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826302.662366:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662378:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662387:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662412:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662420:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662427:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662473:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662480:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662487:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662494:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662501:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.662505:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662513:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662521:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826302.662523:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.662527:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662533:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b6dd lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662543:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662549:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662555:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662559:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.662562:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662567:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662578:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x96b81d15 (ffff9bbe0fe8c400) 00010000:00010000:2.0:1787826302.662580:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826302.662583:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.662588:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b6e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x96b81d15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.662655:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84231:x1874668789811328:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 439us (607us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826302.662663:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111495 00000100:00100000:2.0:1787826302.662680:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111496 00000100:00100000:2.0:1787826302.662687:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84232:x1874668789811456:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826302.662704:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfa:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826302.662774:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84232:x1874668789811456:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 87us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.662781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111496 00000100:00100000:0.0:1787826302.678000:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.682124:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.682216:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789811584 00000100:00100000:2.0:1787826302.682227:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789811584 00000100:00100000:2.0:1787826302.682283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789811840 00000100:00100000:2.0:1787826302.682287:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789811840 00000100:00100000:2.0:1787826302.682316:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111497 00000100:00100000:2.0:1787826302.682326:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84231:x1874668789811584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.682345:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787826302.682359:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111498 00000100:00100000:0.0:1787826302.682368:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84230:x1874668789811840:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.682368:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b6eb lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf94 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.682375:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.682385:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b6f2 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbf9b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.682416:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.682428:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.682438:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.682654:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b6eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf94 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.682672:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf94 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.682680:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826302.682683:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826302.682686:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:2.0:1787826302.682740:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84231:x1874668789811584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 416us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.682747:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111497 00010000:00010000:0.0:1787826302.682798:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b700 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.682821:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b700 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.682829:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b700 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826302.682838:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12c:0x0]: returning size 0 00010000:00010000:0.0:1787826302.682897:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349b6f2 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf9b expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.682912:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b700 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf9b expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.682918:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbf0f565c00) 00010000:00010000:0.0:1787826302.682922:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826302.682924:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:0.0:1787826302.682950:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84230:x1874668789811840:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 584us (836us total) trans 8590016585 rc 0/0 00000100:00100000:0.0:1787826302.682957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111498 00000100:00100000:0.0:1787826302.690276:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.690358:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.690451:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789812096 00000100:00100000:2.0:1787826302.690460:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789812096 00000100:00100000:2.0:1787826302.690523:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789812352 00000100:00100000:2.0:1787826302.690527:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789812352 00000100:00100000:2.0:1787826302.690558:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111499 00000100:00100000:2.0:1787826302.690569:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84231:x1874668789812096:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.690580:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111500 00000100:00100000:3.0:1787826302.690589:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84232:x1874668789812352:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.690597:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.690617:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b70e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfa2 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.690650:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.690663:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.690673:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826302.690792:0:7736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c821abb0 reply state 000000001bfe2f4c transno 8590016586 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.690805:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.690812:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826302.690815:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826302.690818:0:7736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826302.690927:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84231:x1874668789812096:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 359us (660us total) trans 8590016586 rc 0/0 00000100:00100000:2.0:1787826302.690935:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111499 00010000:00010000:3.0:1787826302.690964:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b71c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.690973:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b71c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.690985:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b71c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826302.690993:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12d:0x0]: returning size 0 00010000:00010000:3.0:1787826302.691033:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b70e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa2 expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.691048:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b71c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa2 expref: 66 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.691056:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe08124800) 00010000:00010000:3.0:1787826302.691058:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826302.691060:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00000100:00100000:3.0:1787826302.691082:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84232:x1874668789812352:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 495us (724us total) trans 8590016587 rc 0/0 00000100:00100000:3.0:1787826302.691089:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111500 00000100:00100000:2.0:1787826302.699816:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.700278:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789812480 00000100:00100000:0.0:1787826302.700289:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789812480 00000100:00100000:0.0:1787826302.700350:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111501 00000100:00100000:0.0:1787826302.700359:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84231:x1874668789812480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.700383:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.700416:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfa9 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.700490:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa9 expref: 67 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.700505:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa9 expref: 67 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.700515:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:0.0:1787826302.700518:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826302.700522:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:0.0:1787826302.700587:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84231:x1874668789812480:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 228us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.700594:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111501 00000100:00100000:0.0:1787826302.700692:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.700757:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789812736 00000100:00100000:0.0:1787826302.700761:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789812736 00000100:00100000:0.0:1787826302.700787:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111502 00000100:00100000:0.0:1787826302.700794:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84230:x1874668789812736:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.700832:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.702079:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b700 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf9b expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702104:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbf0f565c00) 00010000:00010000:0.0:1787826302.702115:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826302.702141:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702154:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702164:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702319:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702329:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702337:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702392:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702415:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702421:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702429:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702434:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.702439:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702446:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702456:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826302.702459:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.702463:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702470:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b731 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702480:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702486:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702493:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702498:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826302.702501:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702506:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702512:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xfd2fc4b5 (ffff9bbf0f565800) 00010000:00010000:0.0:1787826302.702514:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826302.702517:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.702523:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b738 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xfd2fc4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.702658:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84230:x1874668789812736:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1861us (1963us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826302.702668:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111502 00000100:00100000:0.0:1787826302.708177:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.708223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.708307:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789812992 00000100:00100000:1.0:1787826302.708317:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789812992 00000100:00100000:1.0:1787826302.708368:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111503 00000100:00100000:1.0:1787826302.708378:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84230:x1874668789812992:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.708398:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.708437:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b73f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfb0 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.708470:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.708483:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.708495:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.708607:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b73f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb0 expref: 68 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.708625:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb0 expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.708634:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:1.0:1787826302.708637:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826302.708641:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826302.708708:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84230:x1874668789812992:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 331us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.708715:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111503 00000100:00100000:2.0:1787826302.708790:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789812864 00000100:00100000:2.0:1787826302.708795:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789812864 00000100:00100000:2.0:1787826302.708830:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2692 00000100:00100000:2.0:1787826302.708838:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84231:x1874668789812864:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.708934:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84231:x1874668789812864:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 96us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.708941:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2692 00000100:00100000:0.0:1787826302.709555:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.709613:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789813248 00000100:00100000:1.0:1787826302.709618:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789813248 00000100:00100000:1.0:1787826302.709655:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111504 00000100:00100000:1.0:1787826302.709663:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84232:x1874668789813248:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.709696:0:7736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826302.709716:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b71c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa2 expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709730:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe08124800) 00010000:00010000:1.0:1787826302.709738:0:7736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826302.709755:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709766:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709774:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709786:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709792:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709797:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709841:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709848:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709891:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709897:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709902:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.709906:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709914:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709922:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826302.709925:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826302.709928:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709935:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b74d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709945:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709951:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709956:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709961:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826302.709964:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709970:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709976:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xb583b8f5 (ffff9bbe12458500) 00010000:00010000:1.0:1787826302.709978:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826302.709981:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.709987:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b754 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xb583b8f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.710040:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84232:x1874668789813248:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 377us (485us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826302.710046:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111504 00000100:00100000:0.0:1787826302.713325:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.713417:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789813504 00000100:00100000:1.0:1787826302.713425:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789813504 00000100:00100000:1.0:1787826302.713518:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111505 00000100:00100000:1.0:1787826302.713529:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84230:x1874668789813504:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.713612:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.713630:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.713642:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826302.713778:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080642b89 reply state 00000000fb46816c transno 8590016588 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.713792:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.713799:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:1.0:1787826302.713802:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826302.713805:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826302.721095:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84230:x1874668789813504:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 7556us (7767us total) trans 8590016588 rc 0/0 00000100:00100000:1.0:1787826302.721108:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111505 00000100:00100000:0.0:1787826302.722134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.722294:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789813632 00000100:00100000:1.0:1787826302.722305:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789813632 00000100:00100000:1.0:1787826302.722362:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111506 00000100:00100000:1.0:1787826302.722370:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84232:x1874668789813632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.722389:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.722423:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b762 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfb7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.722460:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.722473:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.722486:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.722498:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826302.722611:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b762 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb7 expref: 70 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.722643:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb7 expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.722653:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:1.0:1787826302.722657:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826302.722663:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826302.722743:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84232:x1874668789813632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 367us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.722756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111506 00000100:00100000:2.0:1787826302.724517:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789813888 00000100:00100000:2.0:1787826302.724537:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789813888 00000100:00100000:2.0:1787826302.725083:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2693 00000100:00100000:2.0:1787826302.725098:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84231:x1874668789813888:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.725422:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84231:x1874668789813888:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 328us (2925us total) trans 8590016589 rc 0/0 00000100:00100000:2.0:1787826302.725431:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2693 00000100:00100000:3.0:1787826302.734215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.734267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.734637:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789814016 00000100:00100000:2.0:1787826302.734651:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789814016 00000100:00100000:2.0:1787826302.734718:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789814272 00000100:00100000:2.0:1787826302.734721:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789814272 00000100:00100000:2.0:1787826302.734750:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111507 00000100:00100000:2.0:1787826302.734762:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84230:x1874668789814016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.735304:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111508 00000100:00100000:3.0:1787826302.735318:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84231:x1874668789814272:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.735455:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787826302.735466:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84231:x1874668789814272:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 148us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.735475:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111508 00010000:00010000:2.0:1787826302.735485:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfbe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.735562:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfbe expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.735580:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfbe expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.735591:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:2.0:1787826302.735594:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.735599:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826302.735960:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84230:x1874668789814016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1200us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.735968:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111507 00000100:00100000:1.0:1787826302.748408:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.748468:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.748521:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.748564:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789814528 00000100:00100000:1.0:1787826302.748577:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789814528 00000100:00100000:1.0:1787826302.748648:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789814912 00000100:00100000:1.0:1787826302.748654:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789814912 00000100:00100000:1.0:1787826302.748686:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111509 00000100:00100000:1.0:1787826302.748697:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84232:x1874668789814528:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.749070:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.749093:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.749107:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826302.749369:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019a6d7c4 reply state 000000009d029e68 transno 8590016590 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.749385:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.749394:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:1.0:1787826302.749398:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826302.749412:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826302.749545:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84232:x1874668789814528:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 849us (1160us total) trans 8590016590 rc 0/0 00000100:00100000:1.0:1787826302.749554:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111509 00000100:00100000:1.0:1787826302.749584:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111510 00000100:00100000:1.0:1787826302.749593:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84231:x1874668789814912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.749607:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.749620:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b77e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfc5 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.749702:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.749716:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa9 expref: 74 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.749724:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.749764:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa9 expref: 74 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.749780:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa9 expref: 74 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.750435:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778636288:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826302.750535:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf40437480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.750685:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789814656 00000100:00100000:1.0:1787826302.750693:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789814656 00000100:00100000:1.0:1787826302.750749:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2694 00000100:00100000:1.0:1787826302.750758:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84230:x1874668789814656:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.751208:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84230:x1874668789814656:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 450us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.751216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2694 00000100:00100000:1.0:1787826302.756195:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.756293:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.756341:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789815424 00000100:00100000:3.0:1787826302.756354:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789815424 00010000:00010000:3.0:1787826302.756420:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa9 expref: 75 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.756514:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3061 00000100:00100000:3.0:1787826302.756526:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:2400:x1874668789815424:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.756548:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.756569:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa9 expref: 75 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.756593:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa9 expref: 75 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.756632:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:3.0:1787826302.756639:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.756651:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.756660:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.756688:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.756758:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:2400:x1874668789815424:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 234us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.756767:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3061 00000100:00100000:1.0:1787826302.758119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.758154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789815296 00000100:00100000:1.0:1787826302.758163:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789815296 00000100:00100000:1.0:1787826302.758218:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111511 00000100:00100000:1.0:1787826302.758229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84232:x1874668789815296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.758261:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.758291:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfcc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.758383:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfcc expref: 76 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.758413:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfcc expref: 76 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.758427:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:1.0:1787826302.758431:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826302.758435:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7000, rc 0) 00000100:00100000:1.0:1787826302.758494:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84232:x1874668789815296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 267us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.758502:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111511 00000100:00100000:0.0:1787826302.759084:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789815168 00000100:00100000:0.0:1787826302.759093:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789815168 00000100:00100000:0.0:1787826302.759141:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2695 00000100:00100000:0.0:1787826302.759151:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84230:x1874668789815168:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.760180:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84230:x1874668789815168:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1023us (3990us total) trans 8590016591 rc 0/0 00000100:00100000:0.0:1787826302.760192:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2695 00010000:00010000:2.0:1787826302.760446:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349b72a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfa9 expref: 76 pid: 45683 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.760471:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778636288:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.760522:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.760544:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.760550:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.760588:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12b:0x0]: returning size 0 00000004:00080000:2.0:1787826302.761125:0:12105:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc5:0x0], index 1: 0 00010000:00010000:2.0:1787826302.761467:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.761478:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.761486:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.761492:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.761498:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.761506:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.761528:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826302.761532:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.761537:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.761544:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b785 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.762027:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b77e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfc5 expref: 76 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.762040:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826302.762043:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826302.762047:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349b77e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfc5 expref: 76 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.762058:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6800, rc 0) 00000100:00100000:2.0:1787826302.762118:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84231:x1874668789814912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 12526us (13596us total) trans 8590016592 rc 301/301 00000100:00100000:2.0:1787826302.762127:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111510 00000100:00100000:1.0:1787826302.764313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.769503:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.770072:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789815808 00000100:00100000:0.0:1787826302.770087:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789815808 00000100:00100000:0.0:1787826302.770169:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111512 00000100:00100000:0.0:1787826302.770181:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84230:x1874668789815808:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.770345:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84230:x1874668789815808:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 166us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.770353:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111512 00000100:00100000:2.0:1787826302.772085:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789815552 00000100:00100000:2.0:1787826302.772098:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789815552 00000100:00100000:2.0:1787826302.772161:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2696 00000100:00100000:2.0:1787826302.772173:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84232:x1874668789815552:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.774350:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84232:x1874668789815552:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 2161us (10030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.774377:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2696 00000100:00100000:2.0:1787826302.780525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.781502:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789816064 00000100:00100000:3.0:1787826302.781521:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789816064 00000100:00100000:2.0:1787826302.782186:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.782274:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789816320 00000100:00100000:3.0:1787826302.782279:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789816320 00000100:00100000:3.0:1787826302.782348:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2697 00000100:00100000:3.0:1787826302.782360:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84231:x1874668789816320:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.783420:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84231:x1874668789816320:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 870us (1049us total) trans 8590016593 rc 0/0 00000100:00100000:3.0:1787826302.783433:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2697 00000100:00100000:2.0:1787826302.784750:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.784955:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789816576 00000100:00100000:3.0:1787826302.784968:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789816576 00000100:00100000:3.0:1787826302.785133:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2698 00000100:00100000:3.0:1787826302.785145:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84232:x1874668789816576:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.785479:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84232:x1874668789816576:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 336us (737us total) trans 8590016594 rc 0/0 00000100:00100000:3.0:1787826302.785488:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2698 00000100:00100000:0.0:1787826302.785952:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111513 00000100:00100000:0.0:1787826302.785962:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84230:x1874668789816064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.785977:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.786006:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b79a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfd3 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.786119:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.786139:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfbe expref: 78 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.786150:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.786195:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfbe expref: 78 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.786214:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfbe expref: 78 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.786245:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2a940 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778636416:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.786345:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.789828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.791105:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2a940 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778636416:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826302.791143:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.791590:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.792296:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789816960 00000100:00100000:3.0:1787826302.792308:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789816960 00010000:00010000:3.0:1787826302.792359:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfbe expref: 79 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.792628:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3062 00000100:00100000:3.0:1787826302.792642:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2401:x1874668789816960:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.793422:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.793441:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfbe expref: 79 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.793460:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfbe expref: 79 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.793489:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b770 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfbe expref: 79 pid: 6517 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.793506:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:3.0:1787826302.793514:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.793525:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.793535:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.793570:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826302.794060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.794283:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:2401:x1874668789816960:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1641us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.794298:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3062 00010000:00010000:3.0:1787826302.794371:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.794381:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826302.794420:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12c:0x0]: returning size 0 00000004:00080000:3.0:1787826302.794652:0:45682:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc5:0x0], index 0: 0 00010000:00010000:3.0:1787826302.794821:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.794831:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.794839:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.794847:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.794882:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.794893:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.794910:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:3.0:1787826302.794913:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826302.794919:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.794926:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349b7a1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.795008:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b79a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfd3 expref: 78 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.795019:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826302.795023:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826302.795027:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b79a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfd3 expref: 78 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.795038:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2400, rc 0) 00000100:00100000:3.0:1787826302.795090:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84230:x1874668789816064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9129us (14589us total) trans 8590016595 rc 301/301 00000100:00100000:3.0:1787826302.795099:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111513 00000100:00100000:2.0:1787826302.802290:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.802987:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789817344 00000100:00100000:2.0:1787826302.803004:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789817344 00000100:00100000:2.0:1787826302.803085:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2699 00000100:00100000:2.0:1787826302.803096:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84230:x1874668789817344:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.803914:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84230:x1874668789817344:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 813us (1935us total) trans 8590016596 rc 0/0 00000100:00100000:2.0:1787826302.803925:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2699 00000100:00100000:3.0:1787826302.812137:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789816832 00000100:00100000:3.0:1787826302.812160:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789816832 00000100:00100000:1.0:1787826302.812201:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789817088 00000100:00100000:1.0:1787826302.812208:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789817088 00000100:00100000:1.0:1787826302.812299:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111514 00000100:00100000:1.0:1787826302.812311:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84231:x1874668789817088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826302.812343:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.812373:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b7af lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfda expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.812487:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b7b6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.812508:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.812522:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826302.812610:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12b:0x0]: returning size 0 00000004:00200000:1.0:1787826302.814155:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826302.814214:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.814282:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b7af lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfda expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.814313:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfda expref: 80 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.814324:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:1.0:1787826302.814328:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826302.814332:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7400, rc 0) 00000100:00100000:1.0:1787826302.814439:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84231:x1874668789817088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2130us (20381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.814452:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111514 00000100:00100000:1.0:1787826302.814499:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111515 00000100:00100000:1.0:1787826302.814515:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84232:x1874668789816832:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.814587:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84232:x1874668789816832:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 80us (25061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.814595:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111515 00000100:00100000:2.0:1787826302.817647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.817704:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789817472 00000100:00100000:2.0:1787826302.817715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789817472 00000100:00100000:2.0:1787826302.818191:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111516 00000100:00100000:2.0:1787826302.818203:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84230:x1874668789817472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.818232:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.818262:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b7bd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfe1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.818436:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b7c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.818455:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.818469:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.818528:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12c:0x0]: returning size 0 00000004:00200000:2.0:1787826302.818533:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826302.818555:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.818588:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b7bd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe1 expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.818610:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe1 expref: 80 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.818620:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:2.0:1787826302.818624:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826302.818628:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:2.0:1787826302.818689:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84230:x1874668789817472:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 489us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.818697:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111516 00000100:00100000:3.0:1787826302.828632:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.828788:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789817600 00000100:00100000:2.0:1787826302.828809:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789817600 00000100:00100000:2.0:1787826302.828901:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6285 00000100:00100000:2.0:1787826302.828913:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789817600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.828947:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.829191:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfe8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826302.829237:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826302.829264:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=2940s v=(0 0) 00010000:00010000:2.0:1787826302.829270:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826302.829293:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe8 expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.829315:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe8 expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.829334:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826302.829432:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789817600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 521us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.829441:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6285 00000100:00100000:3.0:1787826302.829813:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.830333:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789817856 00000100:00100000:2.0:1787826302.830341:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789817856 00000100:00100000:2.0:1787826302.830407:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111517 00000100:00100000:2.0:1787826302.830417:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84232:x1874668789817856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.830441:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.830465:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b7d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbfef expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.830607:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.830625:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfcc expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.830636:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.830681:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfcc expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.830697:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfcc expref: 81 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.830712:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778636544:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826302.831085:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf01254f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.846410:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.846561:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789817984 00000100:00100000:2.0:1787826302.846574:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789817984 00000100:00100000:2.0:1787826302.846649:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6286 00000100:00100000:2.0:1787826302.846660:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789817984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.846686:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.846712:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbff6 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826302.846761:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826302.846786:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=2940s v=(0 0) 00010000:00010000:2.0:1787826302.846791:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826302.846803:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbff6 expref: 14 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.846825:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbff6 expref: 14 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.846842:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:2.0:1787826302.846933:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789817984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 273us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.847065:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6286 00010000:00010000:1.0:1787826302.849801:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826302.853598:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.853767:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789818240 00000100:00100000:3.0:1787826302.853782:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789818240 00000100:00100000:1.0:1787826302.855101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.855147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826302.855470:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789818368 00000100:00100000:0.0:1787826302.855480:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789818368 00000100:00100000:2.0:1787826302.855629:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789818624 00000100:00100000:2.0:1787826302.855633:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789818624 00000100:00100000:3.0:1787826302.856101:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111518 00010000:00010000:0.0:1787826302.858484:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfcc expref: 84 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.858559:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3063 00000100:00100000:0.0:1787826302.858574:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+84:2401:x1874668789818368:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826302.858595:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826302.858604:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfcc expref: 84 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.858624:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfcc expref: 84 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.858658:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:0.0:1787826302.858666:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.858679:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.858690:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.858729:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826302.858825:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+84:2401:x1874668789818368:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 256us (3731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.858834:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3063 00000100:00100000:2.0:1787826302.863178:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111519 00000100:00100000:2.0:1787826302.863197:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84230:x1874668789818624:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.863367:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84230:x1874668789818624:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 175us (8219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.863375:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111519 00010000:00010000:2.0:1787826302.863467:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349b78c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfcc expref: 82 pid: 6516 timeout: 3040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.863489:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778636544:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.863521:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.863533:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.863538:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826302.863567:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12d:0x0]: returning size 0 00000004:00080000:2.0:1787826302.863797:0:45683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc6:0x0], index 1: 0 00010000:00010000:2.0:1787826302.865560:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.865583:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.865592:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.865599:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826302.865605:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.866135:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.866164:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00000100:00100000:3.0:1787826302.866165:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84231:x1874668789818240:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.866169:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826302.866178:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.866196:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b7d9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.866275:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b7d2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfef expref: 82 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.866290:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826302.866293:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826302.866298:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b7d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfef expref: 82 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.866308:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826302.866414:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84232:x1874668789817856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 35997us (36602us total) trans 8590016597 rc 301/301 00000100:00100000:2.0:1787826302.866424:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111517 00000100:00100000:1.0:1787826302.867055:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84231:x1874668789818240:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 10939us (13471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.867067:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111518 00000100:00100000:3.0:1787826302.892669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.892832:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789818752 00000100:00100000:3.0:1787826302.893452:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789818752 00000100:00100000:3.0:1787826302.893538:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6287 00000100:00100000:3.0:1787826302.893550:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84230:x1874668789818752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.893576:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.893603:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fbffd expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.893710:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbff6 expref: 15 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.893722:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826302.893728:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.893735:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 15 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.893793:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbff6 expref: 15 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.893809:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbff6 expref: 15 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.893826:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb21e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778636672:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826302.895328:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.913361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.913469:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789819136 00000100:00100000:2.0:1787826302.913486:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789819136 00000100:00100000:2.0:1787826302.913562:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2700 00000100:00100000:2.0:1787826302.913574:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84232:x1874668789819136:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.913579:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.915801:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84232:x1874668789819136:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 2214us (2437us total) trans 8590016598 rc 0/0 00000100:00100000:2.0:1787826302.915819:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2700 00000100:00100000:0.0:1787826302.918115:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789818880 00000100:00100000:0.0:1787826302.918136:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789818880 00000100:00100000:0.0:1787826302.918226:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6288 00000100:00100000:0.0:1787826302.918239:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:84231:x1874668789818880:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826302.918265:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.918304:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc004 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.918349:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe8 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.918359:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826302.918364:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826302.918370:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 11 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.918430:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe8 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.918448:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe8 expref: 11 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.918467:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778636800:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826302.918592:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.924180:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb21e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778636672:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826302.924244:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 15 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.924274:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:3.0:1787826302.924557:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:84230:x1874668789818752:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 31007us (31900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.924568:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6287 00000100:00100000:3.0:1787826302.931478:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.936946:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.940790:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.940910:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789819520 00000100:00100000:3.0:1787826302.940922:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789819520 00000100:00100000:3.0:1787826302.941006:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111520 00000100:00100000:3.0:1787826302.941019:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84232:x1874668789819520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.941060:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.941089:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b7fc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc00b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.942593:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b803 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.942622:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b803 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.942640:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b803 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826302.942706:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12d:0x0]: returning size 0 00000004:00200000:3.0:1787826302.942711:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826302.942737:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b803 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.942780:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b7fc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc00b expref: 83 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.943361:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b803 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc00b expref: 82 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.943377:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:3.0:1787826302.943380:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826302.943386:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826302.943502:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84232:x1874668789819520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2484us (2727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.943516:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111520 00000100:00100000:1.0:1787826302.944032:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789819264 00000100:00100000:1.0:1787826302.944046:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789819264 00010000:00010000:1.0:1787826302.944097:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbff6 expref: 15 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.944957:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789819392 00000100:00100000:1.0:1787826302.944962:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789819392 00010000:00010000:1.0:1787826302.945064:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe8 expref: 12 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.945093:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778636800:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826302.945134:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 12 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.945157:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3800, rc 0) 00000100:00100000:1.0:1787826302.945269:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3064 00000100:00100000:2.0:1787826302.945341:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:84231:x1874668789818880:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 27104us (31763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.945350:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6288 00000100:00100000:3.0:1787826302.945374:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3065 00000100:00100000:3.0:1787826302.945391:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789819392:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826302.945422:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826302.945459:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe8 expref: 11 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.945475:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe8 expref: 11 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.945513:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c4ad8e/0x68019081f349b7cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe8 expref: 11 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.945529:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.945534:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.945544:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.945557:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.945600:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.945622:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0321c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778636928:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826302.946525:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.947963:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789819264:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826302.948010:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826302.948048:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbff6 expref: 15 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.948071:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbff6 expref: 15 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.948110:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b26478ee/0x68019081f349b7e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbff6 expref: 15 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.948128:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.948133:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826302.948143:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.948155:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.948452:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 14 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.948473:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778637056:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826302.948558:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf40437480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.952775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.953023:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789819648 00000100:00100000:2.0:1787826302.953034:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789819648 00000100:00100000:2.0:1787826302.953108:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6289 00000100:00100000:2.0:1787826302.953121:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789819648:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826302.953144:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.953173:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc012 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826302.953714:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826302.953745:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=2941s v=(0 0) 00010000:00010000:2.0:1787826302.953751:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826302.953765:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc012 expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.953793:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc012 expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.953812:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826302.954475:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789819648:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1350us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.954494:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6289 00000100:00100000:3.0:1787826302.960697:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.960752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.960836:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0321c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778636928:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826302.960906:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826302.961080:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789819392:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 15694us (24148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.961095:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3065 00000100:00100000:3.0:1787826302.961273:0:45397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789819776 00000100:00100000:3.0:1787826302.961348:0:45397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789819776 00002000:00100000:3.0:1787826302.961423:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xc5:0x0] (0->157) req@ffff9bbe088bbc00 x1874668789819776/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/0 e 0 to 0 dl 1787826313 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826302.961438:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe088bbc00 with x1874668789819776 ext(0->157) 00002000:00010000:3.0:1787826302.961445:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe088bbc00 00000100:00100000:3.0:1787826302.961473:0:45397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789819904 00000100:00100000:3.0:1787826302.961477:0:45397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789819904 00002000:00100000:3.0:1787826302.961494:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xc5:0x0] (0->157) req@ffff9bbe088b9a40 x1874668789819904/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/0 e 0 to 0 dl 1787826313 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826302.961502:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe088b9a40 with x1874668789819904 ext(0->157) 00002000:00010000:3.0:1787826302.961506:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe088b9a40 00000100:00100000:3.0:1787826302.961524:0:45397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1579 00000100:00100000:3.0:1787826302.961535:0:45397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2399:x1874668789819776:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.962678:0:45401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1580 00000100:00100000:2.0:1787826302.962705:0:45401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789819904:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826302.963875:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778637056:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826302.963908:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826302.964962:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789819264:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 17022us (33494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.965016:0:45401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789819904:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2315us (4253us total) trans 4294968171 rc 0/0 00000100:00100000:2.0:1787826302.965030:0:45401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1580 00002000:00100000:2.0:1787826302.965045:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xc5:0x0] (0->157) req@ffff9bbe088b9a40 x1874668789819904/t4294968171(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/448 e 0 to 0 dl 1787826313 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826302.965063:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe088b9a40 with x1874668789819904 ext(0->157) 00002000:00010000:2.0:1787826302.965069:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe088b9a40 00000100:00100000:2.0:1787826302.966015:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826302.966902:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3064 00000100:00100000:3.0:1787826302.967636:0:45397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2399:x1874668789819776:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 6096us (6947us total) trans 4294968189 rc 0/0 00000100:00100000:3.0:1787826302.967659:0:45397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1579 00002000:00100000:3.0:1787826302.967675:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xc5:0x0] (0->157) req@ffff9bbe088bbc00 x1874668789819776/t4294968189(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:658/0 lens 648/448 e 0 to 0 dl 1787826313 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826302.967687:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe088bbc00 with x1874668789819776 ext(0->157) 00002000:00010000:3.0:1787826302.967697:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe088bbc00 00000100:00100000:3.0:1787826302.967743:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789820160 00000100:00100000:3.0:1787826302.967752:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789820160 00000100:00100000:3.0:1787826302.967822:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111521 00000100:00100000:3.0:1787826302.967834:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84232:x1874668789820160:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826302.967935:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84232:x1874668789820160:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 103us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.967941:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111521 00000100:00100000:3.0:1787826302.980987:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.981033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.981080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.981130:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789820288 00000100:00100000:3.0:1787826302.981143:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789820544 00000100:00100000:2.0:1787826302.981147:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789820288 00000100:00100000:3.0:1787826302.981156:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789820544 00000100:00100000:2.0:1787826302.981235:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789820416 00000100:00100000:2.0:1787826302.981242:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789820416 00000100:00100000:3.0:1787826302.981245:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6290 00000100:00100000:3.0:1787826302.981265:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84232:x1874668789820544:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.981286:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111522 00000100:00100000:2.0:1787826302.981301:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84230:x1874668789820288:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826302.981376:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111523 00000100:00100000:2.0:1787826302.981385:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84231:x1874668789820416:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787826302.982553:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.982585:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc019 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.982633:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc012 expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.982650:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.982656:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826302.982663:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.982708:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc012 expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.982726:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc012 expref: 14 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.982744:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778637184:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826302.982890:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caed80 going to sleep for 11 seconds 00000001:00080000:1.0:1787826302.986097:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016598 is committed 00010000:00010000:3.0:1787826302.986637:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986663:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986671:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986680:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.986686:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986695:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986720:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x128:0x0].0x0 (ffff9bbe0fe8cf00) 00010000:00010000:3.0:1787826302.986724:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.986731:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986738:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349b5a2 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x128:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986781:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986789:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986796:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986801:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.986804:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986810:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986818:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x129:0x0].0x0 (ffff9bbe08124400) 00010000:00010000:3.0:1787826302.986820:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.986823:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986829:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b5b0 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x129:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986849:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986880:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986886:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986890:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.986893:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986898:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986907:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12a:0x0].0x0 (ffff9bbe08124300) 00010000:00010000:3.0:1787826302.986909:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826302.986912:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986918:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b5b7 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986931:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986937:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986942:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986949:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.986952:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986958:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986966:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:3.0:1787826302.986969:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826302.986972:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986979:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b715 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986991:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.986997:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987003:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987008:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.987011:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987018:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987032:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:3.0:1787826302.987034:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826302.987037:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987044:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b75b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987055:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987062:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987068:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987073:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826302.987076:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987083:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.987091:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:3.0:1787826302.987094:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826302.987097:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826302.987262:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0fd09f00 refcount 2 committed 0 result 0 batchid 4294970894 00000020:00080000:1.0:1787826302.987267:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0721ae00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0fd099c0 00000020:00080000:1.0:1787826302.987271:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0721ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0de29000 00000020:00080000:1.0:1787826302.987290:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0c17e540 refcount 2 committed 0 result 0 batchid 4294970893 00000020:00080000:1.0:1787826302.987293:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf060ee780 00000020:00080000:1.0:1787826302.987297:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0e5e3400 00000020:00080000:1.0:1787826302.987312:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0c17ef00 refcount 2 committed 0 result 0 batchid 4294970892 00000020:00080000:1.0:1787826302.987316:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c17e600 00000020:00080000:1.0:1787826302.987318:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3dc55b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0b95f600 00000020:00080000:1.0:1787826302.987336:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970891 batchid updated 00000100:00100000:1.0:1787826302.987543:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84231:x1874668789820416:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 6151us (6501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.987554:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111523 00000100:00100000:1.0:1787826302.987633:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84230:x1874668789820288:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 6337us (6672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.987640:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111522 00000020:00080000:2.0:1787826302.988230:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970894 committed batchid 4294970891 00010000:00010000:3.0:1787826302.988325:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349b777 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826302.988334:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970891 00000100:00100000:3.0:1787826302.988617:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778637184:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826302.988661:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.988687:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826302.988738:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84232:x1874668789820544:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 7480us (7657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.988748:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6290 00000100:00100000:3.0:1787826302.989182:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.992711:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826302.992759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826302.993112:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789820672 00000100:00100000:2.0:1787826302.993139:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789820672 00000100:00100000:3.0:1787826302.993172:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789820800 00000100:00100000:3.0:1787826302.993184:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789820800 00010000:00010000:2.0:1787826302.993193:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc012 expref: 14 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.993248:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789820928 00000100:00100000:2.0:1787826302.993249:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3066 00000100:00100000:3.0:1787826302.993256:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789820928 00000100:00100000:2.0:1787826302.993269:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40511850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789820672:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826302.993288:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826302.993314:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc012 expref: 15 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.993340:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc012 expref: 15 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.993367:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349b80a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc012 expref: 15 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.993388:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826302.993392:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826302.993412:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.993429:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.993472:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.993486:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778637312:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826302.993590:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.994880:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6291 00000100:00100000:3.0:1787826302.994903:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789820800:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787826302.998442:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6292 00000100:00100000:0.0:1787826302.998468:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2399:x1874668789820928:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787826303.000990:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968171 is committed 00000001:00080000:1.0:1787826303.001014:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968170 is committed 00000100:00100000:3.0:1787826303.001534:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789820800:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 6631us (8826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.001547:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6291 00000001:00080000:3.0:1787826303.002548:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968189 is committed 00000001:00080000:3.0:1787826303.002567:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968188 is committed 00000100:00100000:1.0:1787826303.003221:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.003513:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789820928:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 5052us (10749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.003527:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6292 00000100:00100000:0.0:1787826303.005023:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1874668778637312:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826303.005057:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.005116:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40511850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789820672:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 11854us (15935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.005127:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3066 00000100:00100000:3.0:1787826303.006576:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789821056 00000100:00100000:3.0:1787826303.006594:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789821056 00002000:00100000:3.0:1787826303.006750:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc6:0x0] (0->157) req@ffff9bbe1283b0c0 x1874668789821056/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/0 e 0 to 0 dl 1787826314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826303.006770:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283b0c0 with x1874668789821056 ext(0->157) 00002000:00010000:3.0:1787826303.006778:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1283b0c0 00000100:00080000:1.0:1787826303.007458:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826303.007500:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1581 00000100:00100000:1.0:1787826303.007518:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789821056:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.013627:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789821056:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 6101us (10396us total) trans 4294968172 rc 0/0 00000100:00100000:1.0:1787826303.013642:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1581 00002000:00100000:1.0:1787826303.013657:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xc6:0x0] (0->157) req@ffff9bbe1283b0c0 x1874668789821056/t4294968172(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/448 e 0 to 0 dl 1787826314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826303.013681:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283b0c0 with x1874668789821056 ext(0->157) 00002000:00010000:1.0:1787826303.013688:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1283b0c0 00000100:00100000:0.0:1787826303.017675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.017729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.017783:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789821312 00000100:00100000:3.0:1787826303.017798:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789821312 00000100:00100000:3.0:1787826303.017890:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789821568 00000100:00100000:3.0:1787826303.017894:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789821568 00000100:00100000:3.0:1787826303.017922:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111524 00000100:00100000:3.0:1787826303.017934:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84231:x1874668789821312:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00000100:00100000:0.0:1787826303.017942:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111525 00000100:00100000:0.0:1787826303.017956:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84230:x1874668789821568:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.018018:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.018059:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b7c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfe1 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.018086:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:0.0:1787826303.018093:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826303.018142:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.018158:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.018169:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.018180:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.018209:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349b7b6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfda expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.018224:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:3.0:1787826303.018228:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826303.018247:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.018258:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.018266:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826303.018337:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009be579a reply state 0000000070b78af1 transno 8590016599 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826303.018337:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf2fdca3 reply state 00000000b341084e transno 8590016600 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.018360:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.018362:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.018377:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:0.0:1787826303.018384:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826303.018388:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826303.018388:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:3.0:1787826303.018394:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826303.018407:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826303.018535:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84231:x1874668789821312:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 602us (873us total) trans 8590016600 rc 0/0 00000100:00100000:3.0:1787826303.018545:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111524 00000100:00100000:0.0:1787826303.019965:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84230:x1874668789821568:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 2003us (2225us total) trans 8590016599 rc 0/0 00000100:00100000:0.0:1787826303.019980:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111525 00000100:00100000:1.0:1787826303.033457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.033490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.033533:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.033545:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789821696 00000100:00100000:3.0:1787826303.033562:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789821696 00000100:00100000:2.0:1787826303.033613:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789821824 00000100:00100000:2.0:1787826303.033624:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789821824 00000100:00100000:3.0:1787826303.033647:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789821952 00000100:00100000:3.0:1787826303.033653:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789821952 00000100:00100000:3.0:1787826303.033690:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111526 00000100:00100000:3.0:1787826303.033715:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84230:x1874668789821696:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.033741:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.033770:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc020 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.033888:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc020 expref: 36 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.033906:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc020 expref: 36 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.033929:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:3.0:1787826303.033933:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826303.033938:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc 0) 00000100:00100000:3.0:1787826303.034092:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84230:x1874668789821696:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 379us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.038189:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111527 00000100:00100000:2.0:1787826303.038235:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84232:x1874668789821952:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.038414:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84232:x1874668789821952:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 198us (4877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.038425:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111527 00000100:00100000:2.0:1787826303.038478:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111528 00000100:00100000:2.0:1787826303.038489:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84231:x1874668789821824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.038501:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.038524:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc027 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.038569:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc027 expref: 36 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.040464:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc027 expref: 36 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.040499:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826303.040502:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.040506:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826303.040582:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84231:x1874668789821824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2095us (7092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.040591:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111528 00000100:00100000:3.0:1787826303.044269:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111526 00000100:00100000:1.0:1787826303.045645:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.045743:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789822080 00000100:00100000:2.0:1787826303.045756:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789822080 00000100:00100000:2.0:1787826303.045826:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6293 00000100:00100000:2.0:1787826303.045839:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789822080:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787826303.048453:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968172 is committed 00000100:00100000:2.0:1787826303.049226:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789822080:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 3379us (3578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.049247:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6293 00000100:00100000:1.0:1787826303.066122:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.066181:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.066731:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789822208 00000100:00100000:3.0:1787826303.066745:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789822208 00000100:00100000:3.0:1787826303.067030:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789822336 00000100:00100000:3.0:1787826303.067035:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789822336 00000100:00100000:3.0:1787826303.067070:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6294 00000100:00100000:3.0:1787826303.067083:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789822208:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826303.067699:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826303.067705:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb mtime from disk: 0 -> 1787826222 00002000:00010000:3.0:1787826303.067708:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb atime from disk: 0 -> 1787826222 00002000:00010000:3.0:1787826303.067710:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb ctime from disk: 0 -> 1787826222 00002000:00010000:3.0:1787826303.067713:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826303.068011:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789822208:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 861us (1846us total) trans 4294968190 rc 0/0 00000100:00100000:3.0:1787826303.068023:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6294 00000100:00100000:3.0:1787826303.068053:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6295 00000100:00100000:3.0:1787826303.068063:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789822336:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787826303.068225:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826303.068303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00002000:00010000:3.0:1787826303.068417:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826303.068422:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb mtime from disk: 0 -> 1787826222 00002000:00010000:3.0:1787826303.068424:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb atime from disk: 0 -> 1787826222 00002000:00010000:3.0:1787826303.068426:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb ctime from disk: 0 -> 1787826222 00002000:00010000:3.0:1787826303.068428:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826303.068461:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789822336:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 399us (2278us total) trans 4294968173 rc 0/0 00000100:00100000:3.0:1787826303.068470:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6295 00000100:00100000:2.0:1787826303.071655:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789822592 00000100:00100000:2.0:1787826303.071677:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789822592 00000100:00100000:2.0:1787826303.071773:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111529 00000100:00100000:2.0:1787826303.071785:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84232:x1874668789822592:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.071886:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.071935:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b803 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc00b expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.071965:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:2.0:1787826303.071971:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826303.072016:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.072034:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.072046:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826303.072204:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048160cee reply state 000000000df7e512 transno 8590016601 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.072220:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.072226:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:2.0:1787826303.072231:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826303.072234:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826303.072365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84232:x1874668789822592:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 582us (4062us total) trans 8590016601 rc 0/0 00000100:00100000:2.0:1787826303.072374:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111529 00000100:00100000:2.0:1787826303.078026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.078078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.078112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.078143:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789822848 00000100:00100000:2.0:1787826303.078154:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789822848 00000100:00100000:2.0:1787826303.078207:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789823104 00000100:00100000:2.0:1787826303.078210:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789823104 00000100:00100000:2.0:1787826303.078225:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789823232 00000100:00100000:2.0:1787826303.078228:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789823232 00000100:00100000:2.0:1787826303.078251:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111530 00000100:00100000:2.0:1787826303.078262:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84230:x1874668789822848:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.078353:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078378:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb0 expref: 38 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078390:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078446:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb0 expref: 38 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078463:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb0 expref: 38 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.078488:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778637440:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826303.078617:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0623c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.078645:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111531 00000100:00100000:2.0:1787826303.078654:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84231:x1874668789823104:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.078684:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078695:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf94 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078703:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078721:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf94 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078730:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf94 expref: 38 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.078740:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778637568:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826303.078766:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.078785:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111532 00000100:00100000:2.0:1787826303.078792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84232:x1874668789823232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.078821:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.078836:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc02e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078940:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc02e expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078957:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc02e expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.078979:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:2.0:1787826303.078983:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.078987:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826303.079021:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84232:x1874668789823232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 228us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.079028:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111532 00000100:00100000:3.0:1787826303.085386:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.087083:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778637568:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826303.087122:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.087342:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778637440:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826303.087360:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.087550:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789823360 00000100:00100000:0.0:1787826303.087561:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789823360 00000100:00100000:0.0:1787826303.087974:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6296 00000100:00100000:0.0:1787826303.087986:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789823360:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826303.088201:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826303.088206:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb mtime from disk: 0 -> 1787826222 00002000:00010000:0.0:1787826303.088208:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb atime from disk: 0 -> 1787826222 00002000:00010000:0.0:1787826303.088210:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb ctime from disk: 0 -> 1787826222 00002000:00010000:0.0:1787826303.088212:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826303.088222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.088288:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789823360:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 303us (2920us total) trans 4294968174 rc 0/0 00000100:00100000:0.0:1787826303.088297:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6296 00000100:00100000:2.0:1787826303.088385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.090627:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789823616 00000100:00100000:1.0:1787826303.090646:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789823616 00000100:00100000:3.0:1787826303.090656:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789823488 00000100:00100000:3.0:1787826303.090661:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789823488 00010000:00010000:1.0:1787826303.090700:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf94 expref: 40 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.090700:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb0 expref: 40 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.090754:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3067 00000100:00100000:1.0:1787826303.090767:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789823616:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.090785:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.090793:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf94 expref: 40 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091024:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf94 expref: 40 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091056:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349b6f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbf94 expref: 40 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091076:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:1.0:1787826303.091082:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091094:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091103:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091132:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.091201:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789823616:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 435us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.091209:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3067 00000100:00100000:1.0:1787826303.091234:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3068 00000100:00100000:1.0:1787826303.091240:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789823488:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.091251:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.091257:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb0 expref: 38 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091267:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb0 expref: 38 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091280:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349b746 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb0 expref: 38 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091291:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:1.0:1787826303.091296:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091303:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091419:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.091439:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.091462:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2402:x1874668789823488:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 220us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.091470:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3068 00010000:00010000:1.0:1787826303.092221:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.092224:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.092242:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.092244:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.092461:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.092473:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.092481:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.092488:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.092496:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.092496:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.092520:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.092521:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.092531:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.092537:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.092541:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.092547:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.092561:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826303.092564:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826303.092568:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.092575:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349b842 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.092649:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84231:x1874668789823104:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 13993us (14567us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826303.092659:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111531 00010000:00010000:1.0:1787826303.092711:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:1.0:1787826303.092715:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787826303.092719:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.092735:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349b83b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.092775:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84230:x1874668789822848:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 14514us (14758us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787826303.092784:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111530 00000100:00100000:3.0:1787826303.099307:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.099428:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789823872 00000100:00100000:0.0:1787826303.099442:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789823872 00000100:00100000:0.0:1787826303.099532:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111533 00000100:00100000:0.0:1787826303.099546:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84232:x1874668789823872:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.099638:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.099660:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb7 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.099672:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.099717:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb7 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.099734:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb7 expref: 35 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.099753:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778637696:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826303.099889:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.102522:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.102602:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.102708:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789824000 00000100:00100000:3.0:1787826303.102720:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789824000 00000100:00100000:3.0:1787826303.102786:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789824128 00000100:00100000:3.0:1787826303.102799:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789824128 00000100:00100000:3.0:1787826303.102830:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6297 00000100:00100000:3.0:1787826303.102842:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789824000:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.102924:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.102951:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 13 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.102961:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.102966:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826303.102972:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.103021:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 13 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.103038:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 13 pid: 19335 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.103250:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778637824:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.103490:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826303.103917:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6298 00000100:00100000:3.0:1787826303.103931:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789824128:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.103975:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.103994:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 12 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.104002:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.104005:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826303.104010:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.104042:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 12 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.105732:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 12 pid: 25038 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.105758:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778637952:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.105882:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.108382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.108759:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778637696:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.108801:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.110135:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789824256 00000100:00100000:0.0:1787826303.110150:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789824256 00010000:00010000:0.0:1787826303.110204:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb7 expref: 36 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.110251:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3069 00000100:00100000:0.0:1787826303.110262:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789824256:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.110293:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.110302:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb7 expref: 36 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110318:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb7 expref: 36 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110349:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b769 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbfb7 expref: 36 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110366:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:0.0:1787826303.110372:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110384:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110394:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110433:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.110552:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2402:x1874668789824256:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 291us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.110562:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3069 00010000:00010000:0.0:1787826303.110603:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110611:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110666:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110675:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110682:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110689:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.110694:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110702:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110712:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:0.0:1787826303.110715:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826303.110720:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.110726:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b850 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.110776:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84232:x1874668789823872:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 11233us (11483us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826303.110785:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111533 00000100:00100000:2.0:1787826303.111361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.111971:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789824384 00000100:00100000:2.0:1787826303.111980:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789824384 00010000:00010000:2.0:1787826303.112025:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 14 pid: 19335 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.112128:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3070 00000100:00100000:2.0:1787826303.112139:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789824384:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.112157:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.112246:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 14 pid: 19335 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.112263:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 14 pid: 19335 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.112359:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826303.112365:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826303.112372:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.112386:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.112420:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826303.112481:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789824384:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 343us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.112490:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3070 00000100:00100000:2.0:1787826303.113594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826303.113744:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349b7ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fbffd expref: 13 pid: 19335 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.113766:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778637824:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.113801:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.113816:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.113824:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.113883:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.113892:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.113901:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.113915:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826303.113919:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.113929:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.113947:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.113954:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbbcee0a/0x68019081f349b857 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.114039:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789824000:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 11198us (11528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.114113:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6297 00000100:00100000:3.0:1787826303.114177:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778637952:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.114264:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.114442:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.114594:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789824640 00000100:00100000:3.0:1787826303.114602:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789824640 00000100:00100000:3.0:1787826303.114708:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6299 00000100:00100000:3.0:1787826303.114718:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789824640:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.114771:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.114789:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.114798:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.114803:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826303.114808:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.114848:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.114894:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 13 pid: 8433 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.114913:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778638080:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826303.114917:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789824512 00000100:00100000:0.0:1787826303.114924:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789824512 00010000:00010000:0.0:1787826303.114953:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 14 pid: 25038 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.114990:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3071 00000100:00100000:3.0:1787826303.114998:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826303.115000:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789824512:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.115017:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.115038:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 14 pid: 25038 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.115051:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 14 pid: 25038 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.115072:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349b7f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc004 expref: 14 pid: 25038 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.115086:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826303.115089:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826303.115094:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.115108:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.115463:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.115501:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789824512:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 503us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.115511:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3071 00010000:00010000:3.0:1787826303.116595:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.116613:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.116645:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.116656:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.116666:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.116674:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826303.116679:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.116688:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.117137:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.117147:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071a796f3/0x68019081f349b85e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.117544:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789824128:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 13610us (14933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.117557:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6298 00000100:00100000:1.0:1787826303.119322:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778638080:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826303.119361:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.130057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.130110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.130124:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789824896 00000100:00100000:3.0:1787826303.130137:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789824896 00000100:00100000:3.0:1787826303.130216:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111534 00000100:00100000:0.0:1787826303.130234:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789825024 00000100:00100000:3.0:1787826303.130237:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84230:x1874668789824896:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826303.130238:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789825024 00010000:00010000:0.0:1787826303.130275:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 12 pid: 8433 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.130315:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3072 00000100:00100000:0.0:1787826303.130322:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789825024:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.130335:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.130363:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 12 pid: 8433 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.130367:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130378:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 12 pid: 8433 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.130385:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.130408:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130411:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349b811 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc019 expref: 12 pid: 8433 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130432:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826303.130437:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826303.130444:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130454:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130486:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.130574:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789825024:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 252us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.130583:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3072 00010000:00010000:0.0:1787826303.130619:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130627:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.130639:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130647:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.130651:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc020 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130656:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.130659:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130666:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130673:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826303.130678:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130687:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.130691:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc020 expref: 35 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130699:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.130704:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc020 expref: 35 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.130707:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049f1bea0/0x68019081f349b865 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.130724:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778638208:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826303.130759:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789824640:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 16044us (16318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.130768:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6299 00000100:00100000:3.0:1787826303.130786:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826303.134156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.134319:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789825280 00000100:00100000:3.0:1787826303.134331:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789825280 00000100:00100000:3.0:1787826303.134416:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111535 00000100:00100000:3.0:1787826303.134429:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84231:x1874668789825280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.134604:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.134629:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.134643:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.135788:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.137513:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc027 expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.137542:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.137601:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc027 expref: 37 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.137617:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc027 expref: 37 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.137638:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778638336:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.137790:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.139913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.140140:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778638208:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826303.140176:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.140659:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789825664 00000100:00100000:3.0:1787826303.140677:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789825664 00000100:00100000:3.0:1787826303.140749:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111536 00000100:00100000:3.0:1787826303.140761:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84232:x1874668789825664:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.141141:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.141161:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.141173:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.141410:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.141425:0:45683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc02e expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.141435:0:45683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.141483:0:45683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc02e expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.141498:0:45683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc02e expref: 39 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.141522:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b5680 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778638464:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826303.142076:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.142194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.142678:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789825408 00000100:00100000:3.0:1787826303.142687:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789825408 00010000:00010000:3.0:1787826303.142730:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc020 expref: 40 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.142773:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3073 00000100:00100000:3.0:1787826303.142783:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40510850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2402:x1874668789825408:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826303.142797:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.143037:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc020 expref: 40 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.143055:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc020 expref: 40 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.143081:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b826 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc020 expref: 40 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.143100:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:3.0:1787826303.143107:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.143116:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.143125:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.143162:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826303.143238:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.143247:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826303.143367:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016602 00000001:00080000:1.0:1787826303.143517:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016605 00000001:00080000:1.0:1787826303.143572:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016606 00000100:00100000:1.0:1787826303.143660:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778638592:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787826303.143734:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826303.143758:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.144112:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778638592 00000100:00100000:2.0:1787826303.144120:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778638592 00000100:00100000:2.0:1787826303.144185:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3348 00000100:00100000:2.0:1787826303.144194:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778638592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826303.144300:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778638592:12345-0@lo:1000:mdt00_002.0 Request processed in 107us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.144308:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3348 00000100:00080000:2.0:1787826303.144334:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826303.144368:0:6517:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968188 gen 2 00000004:00080000:2.0:1787826303.144373:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968187 committed transno 4294968188 00000004:00080000:2.0:1787826303.144395:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968188 committed transno 4294968188 00000100:00100000:2.0:1787826303.144425:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778638592:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787826303.144578:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016607 00000100:00100000:2.0:1787826303.144634:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03f840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778638720:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826303.144672:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826303.144694:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0629c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.144711:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778638720 00000100:00100000:2.0:1787826303.144716:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778638720 00000100:00100000:2.0:1787826303.144744:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3349 00000100:00100000:2.0:1787826303.144751:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778638720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826303.145102:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778638720:12345-0@lo:1000:mdt00_002.0 Request processed in 350us (428us total) trans 4294968191 rc 0/0 00000100:00100000:2.0:1787826303.145110:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3349 00000100:00100000:1.0:1787826303.145189:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03f840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778638720:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787826303.145254:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016608 00010000:00010000:1.0:1787826303.145284:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145293:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145301:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145307:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.145312:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145325:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145343:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:1.0:1787826303.145347:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.145353:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145360:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349b873 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145406:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f3499160 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145413:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f3499160 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145418:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f3499160 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145423:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.145425:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f3499160 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145430:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f3499160 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145438:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf8:0x0].0x0 (ffff9bbe16cc5000) 00010000:00010000:1.0:1787826303.145441:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.145443:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f3499160 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145453:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f3499160 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145479:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145492:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145501:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145509:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145516:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145522:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145536:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.145539:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145545:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145551:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf8:0x0].0x0 (ffff9bbe16cc5000) 00010000:00010000:1.0:1787826303.145554:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826303.145556:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145564:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b896 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145574:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145580:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145586:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145590:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.145593:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145598:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145606:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf8:0x0].0x0 (ffff9bbe16cc5000) 00010000:00010000:1.0:1787826303.145607:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826303.145610:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.145616:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349b86c lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.146443:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+44:84230:x1874668789824896:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 16211us (16401us total) trans 8590016609 rc 0/0 00000100:00100000:1.0:1787826303.146456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111534 00000020:00080000:1.0:1787826303.146463:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826303.146702:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40510850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2402:x1874668789825408:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3917us (4506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.146717:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3073 00000100:00100000:1.0:1787826303.147967:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.148145:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.148199:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b5680 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:45683:1874668778638464:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826303.148232:0:45683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.148435:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789825792 00000100:00100000:0.0:1787826303.148445:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789825792 00010000:00010000:0.0:1787826303.148497:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc027 expref: 43 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.148544:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789825920 00000100:00100000:0.0:1787826303.148548:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789825920 00010000:00010000:0.0:1787826303.148562:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc02e expref: 44 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.148587:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3074 00000100:00100000:0.0:1787826303.148598:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41061a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+44:2402:x1874668789825792:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.148618:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.148625:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc027 expref: 44 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.148638:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc027 expref: 44 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.148665:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:0.0:1787826303.148671:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.148682:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.148691:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.148710:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.148774:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41061a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+44:2402:x1874668789825792:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 177us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.148781:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3074 00000100:00100000:0.0:1787826303.148802:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3075 00000100:00100000:0.0:1787826303.149074:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2401:x1874668789825920:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.149087:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.149092:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc02e expref: 43 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.149103:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc02e expref: 43 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.149118:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349b849 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc02e expref: 43 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.149134:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:0.0:1787826303.149138:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.149146:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.149151:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.149170:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.149190:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+42:2401:x1874668789825920:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 121us (1047us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826303.149330:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349b82d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc027 expref: 42 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.149347:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778638336:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.149371:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.149381:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.149387:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826303.149756:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016603 00000001:00080000:3.0:1787826303.150073:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016610 00000001:00080000:3.0:1787826303.150118:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016611 00000100:00100000:3.0:1787826303.150235:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778638848:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826303.150317:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826303.150357:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16caed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826303.150405:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778638848 00000100:00100000:3.0:1787826303.150413:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778638848 00000100:00100000:3.0:1787826303.150484:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3350 00000100:00100000:3.0:1787826303.150492:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6516:x1874668778638848:12345-0@lo:1000:mdt00_001.0 00000100:00080000:2.0:1787826303.150654:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826303.151079:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6516:x1874668778638848:12345-0@lo:1000:mdt00_001.0 Request processed in 587us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.151087:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3350 00000100:00100000:3.0:1787826303.151136:0:6516:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968170 gen 2 00000004:00080000:3.0:1787826303.151143:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968170 committed transno 4294968170 00000100:00100000:3.0:1787826303.151165:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778638848:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787826303.151317:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016612 00000100:00100000:3.0:1787826303.151382:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778638976:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826303.151429:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826303.151447:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.151523:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778638976 00000100:00100000:2.0:1787826303.151592:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778638976 00000100:00100000:2.0:1787826303.151639:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3351 00000100:00100000:2.0:1787826303.151648:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6516:x1874668778638976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826303.151771:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6516:x1874668778638976:12345-0@lo:1000:mdt00_001.0 Request processed in 125us (342us total) trans 4294968175 rc 0/0 00000100:00100000:2.0:1787826303.151778:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3351 00000100:00100000:2.0:1787826303.152288:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1874668778638976:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787826303.152384:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016613 00010000:00010000:2.0:1787826303.152434:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.152446:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.152454:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.152461:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.152466:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.152475:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.152495:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826303.152499:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.152506:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.152513:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349b881 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.152638:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3075 00010000:00010000:0.0:1787826303.152690:0:45683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.152699:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826303.152762:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016604 00000001:00080000:0.0:1787826303.153239:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016615 00000001:00080000:0.0:1787826303.153292:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016616 00000100:00100000:0.0:1787826303.153386:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778639104:0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1787826303.153474:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826303.153514:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826303.153548:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778639104 00000100:00100000:0.0:1787826303.153555:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778639104 00000100:00100000:0.0:1787826303.153601:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3352 00000100:00100000:0.0:1787826303.153610:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45683:x1874668778639104:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1787826303.153695:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45683:x1874668778639104:12345-0@lo:1000:mdt00_009.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.153703:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3352 00000100:00100000:0.0:1787826303.153743:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778639104:0@lo:1000:mdt00_009.0 00010000:00010000:2.0:1787826303.154143:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f3499167 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154155:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f3499167 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154162:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f3499167 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154169:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fa00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.154173:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f3499167 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154182:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f3499167 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154197:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf9:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826303.154201:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.154206:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f3499167 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154213:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f3499167 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154246:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154261:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154273:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154280:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154287:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154294:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154299:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.154302:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154309:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154316:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf9:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826303.154318:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826303.154321:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154327:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349b89d lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154337:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154345:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154352:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154357:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.154361:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154367:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154375:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf9:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826303.154378:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826303.154381:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 2/0,0 mode: --/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.154387:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349b87a lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.154639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84231:x1874668789825280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 20210us (20504us total) trans 8590016614 rc 0/0 00000100:00100000:2.0:1787826303.154650:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111535 00000020:00080000:2.0:1787826303.154655:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000001:00080000:0.0:1787826303.154980:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016617 00000100:00100000:0.0:1787826303.155057:0:45683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778639232:0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1787826303.155110:0:45683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826303.155139:0:45683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.155212:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778639232 00000100:00100000:2.0:1787826303.155219:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778639232 00000100:00100000:2.0:1787826303.155269:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3353 00000100:00100000:2.0:1787826303.155277:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:45683:x1874668778639232:12345-0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1787826303.155424:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:45683:x1874668778639232:12345-0@lo:1000:mdt00_009.0 Request processed in 147us (312us total) trans 4294968176 rc 0/0 00000100:00100000:2.0:1787826303.155432:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3353 00000100:00100000:0.0:1787826303.155514:0:45683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:45683:1874668778639232:0@lo:1000:mdt00_009.0 00000001:00080000:0.0:1787826303.155653:0:45683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016618 00010000:00010000:0.0:1787826303.155679:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155689:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155695:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155701:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.155704:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155711:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155726:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:0.0:1787826303.155729:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826303.155733:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155740:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349b88f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155764:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349916e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155771:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349916e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155776:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349916e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155782:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.155785:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349916e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155791:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349916e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.155799:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe16cc5200) 00010000:00010000:0.0:1787826303.155802:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1787826303.156347:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.156413:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789826176 00000100:00100000:2.0:1787826303.156420:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789826176 00000100:00100000:2.0:1787826303.156468:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2701 00000100:00100000:2.0:1787826303.156478:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84230:x1874668789826176:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826303.156739:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x12c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826303.156786:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016620 00010000:00010000:2.0:1787826303.156833:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157001:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157016:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157025:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157032:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157039:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157063:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826303.157166:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+52:84230:x1874668789826176:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 688us (820us total) trans 8590016621 rc 0/0 00000100:00100000:2.0:1787826303.157175:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2701 00000020:00080000:2.0:1787826303.157180:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787826303.157209:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826303.157216:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157224:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826303.157228:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157236:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157247:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:2.0:1787826303.157250:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826303.157255:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157260:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b8a4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.157273:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.157276:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.157277:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826303.157618:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349916e lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157630:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349916e lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157667:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157677:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157687:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157696:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157702:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157708:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157714:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.157718:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157725:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157734:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe16cc5200) 00010000:00010000:0.0:1787826303.157736:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826303.157740:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157745:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ab lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157756:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157763:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157768:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157773:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.157776:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157783:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.157791:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfa:0x0].0x0 (ffff9bbe16cc5200) 00010000:00010000:0.0:1787826303.157793:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826303.157797:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.158098:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349b888 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xfa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.158343:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+51:84232:x1874668789825664:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 17579us (18434us total) trans 8590016619 rc 0/0 00000100:00100000:0.0:1787826303.158353:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111536 00000020:00080000:0.0:1787826303.158358:0:45683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787826303.159270:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826303.159278:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826303.159461:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9701 count 103 00000040:00080000:2.0:1787826303.159470:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787826303.159740:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b5680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778639360:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787826303.160243:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.165294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.165355:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789826432 00000100:00100000:0.0:1787826303.165369:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789826432 00000100:00100000:0.0:1787826303.165459:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2702 00000100:00100000:0.0:1787826303.165472:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+52:84231:x1874668789826432:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787826303.165945:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x12b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826303.165992:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016622 00010000:00010000:0.0:1787826303.166035:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166057:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166070:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166080:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166086:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166093:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.166116:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:0.0:1787826303.166149:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826303.166169:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.166188:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.166209:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.166257:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84231:x1874668789826432:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 787us (979us total) trans 8590016623 rc 0/0 00000100:00100000:0.0:1787826303.166266:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2702 00000020:00080000:0.0:1787826303.166273:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826303.166292:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789826688 00000100:00100000:0.0:1787826303.166296:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789826688 00000100:00100000:0.0:1787826303.166319:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2703 00000100:00100000:0.0:1787826303.166326:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84232:x1874668789826688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787826303.166452:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x12d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787826303.166468:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016624 00010000:00010000:0.0:1787826303.166494:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166505:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166513:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166521:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166527:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166533:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.166618:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789826816 00000100:00100000:2.0:1787826303.166622:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789826816 00000100:00100000:2.0:1787826303.166658:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789826944 00000100:00100000:2.0:1787826303.166661:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789826944 00000100:00100000:2.0:1787826303.166679:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789827072 00000100:00100000:2.0:1787826303.166682:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789827072 00000100:00100000:2.0:1787826303.166702:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111537 00000100:00100000:2.0:1787826303.166710:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84233:x1874668789826816:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826303.166731:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826303.166824:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84233:x1874668789826816:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 114us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.166832:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111537 00000100:00100000:2.0:1787826303.166874:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111538 00000100:00100000:2.0:1787826303.166881:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84235:x1874668789826944:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826303.166894:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfd:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826303.166935:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84235:x1874668789826944:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 55us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.166942:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111538 00000100:00100000:2.0:1787826303.166955:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111539 00000100:00100000:2.0:1787826303.166961:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84234:x1874668789827072:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826303.166975:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826303.167016:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84234:x1874668789827072:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 55us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.167023:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111539 00000100:00100000:2.0:1787826303.167095:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b5680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778639360:192.168.203.9@tcp:107:hsm_cdtr.0 00010000:00010000:1.0:1787826303.170014:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826303.170035:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.170048:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826303.170053:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.170064:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.170089:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:1.0:1787826303.170093:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826303.170099:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.170106:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349b8b2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.170125:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826303.170130:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.170135:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826303.170139:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.170144:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.170151:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:1.0:1787826303.170154:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826303.170157:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 3/0,0 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.170163:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826303.170165:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826303.170166:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826303.172071:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826303.172093:0:23877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b8b9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.172270:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826303.172447:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84232:x1874668789826688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 6113us (6329us total) trans 8590016625 rc 0/0 00000100:00100000:1.0:1787826303.172461:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2703 00000020:00080000:1.0:1787826303.172468:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826303.173534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.175904:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.176492:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789827200 00000100:00100000:1.0:1787826303.176507:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789827200 00000100:00100000:1.0:1787826303.176592:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789827328 00000100:00100000:1.0:1787826303.176595:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789827328 00000100:00100000:1.0:1787826303.176630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111540 00000100:00100000:3.0:1787826303.176741:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111541 00000100:00100000:3.0:1787826303.176756:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84234:x1874668789827328:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.176933:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84233:x1874668789827200:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.177014:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177035:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177050:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177069:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177077:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177083:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177115:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177123:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177129:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826303.177200:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfb:0x0]: returning size 158 00000004:00200000:1.0:1787826303.177206:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826303.177221:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177236:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177244:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177250:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177262:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177269:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.177274:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177284:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177300:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826303.177304:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826303.177321:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177330:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b8c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177345:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177352:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177358:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177363:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.177367:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177378:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177384:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177386:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xc2c3cee9 (ffff9bbe0bd66700) 00010000:00010000:1.0:1787826303.177388:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826303.177392:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177394:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177412:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349b8c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc2c3cee9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177414:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177428:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177429:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177436:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177436:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177443:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177444:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177448:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.177451:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177456:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177462:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfb:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:3.0:1787826303.177464:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177465:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826303.177468:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177471:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177478:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.177479:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349b8ce lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826303.177504:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfc:0x0]: returning size 158 00000004:00200000:3.0:1787826303.177507:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826303.177513:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177521:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177527:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177533:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177539:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177545:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.177547:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177553:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177562:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826303.177564:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.177567:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177573:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b8d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177584:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177590:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177596:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177600:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.177603:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177609:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177617:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x5103792c (ffff9bbe08124300) 00010000:00010000:3.0:1787826303.177619:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.177622:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177629:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b8dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x5103792c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177645:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177651:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177657:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177662:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.177664:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177670:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177677:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfc:0x0].0x0 (ffff9bbe16cc5c00) 00010000:00010000:3.0:1787826303.177679:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.177682:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.177687:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b8e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.177794:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84233:x1874668789827200:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1152us (4266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.177803:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111540 00000100:00100000:2.0:1787826303.180750:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84234:x1874668789827328:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 3984us (4881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.180768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111541 00000100:00100000:3.0:1787826303.181813:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.181878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.181972:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789827584 00000100:00100000:0.0:1787826303.181985:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789827584 00000100:00100000:0.0:1787826303.182050:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789827712 00000100:00100000:0.0:1787826303.182054:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789827712 00000100:00100000:0.0:1787826303.182080:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111542 00000100:00100000:0.0:1787826303.182091:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84235:x1874668789827584:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.182203:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182229:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182245:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182265:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182273:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182281:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182324:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182333:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182339:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826303.182417:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfd:0x0]: returning size 158 00000004:00200000:0.0:1787826303.182423:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826303.182438:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182454:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182466:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182473:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182481:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182487:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.182492:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182500:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182513:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826303.182516:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826303.182521:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182536:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349b8ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182552:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182558:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182565:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182571:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.182574:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182580:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182586:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xae916491 (ffff9bbf0f565500) 00010000:00010000:0.0:1787826303.182588:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826303.182591:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182596:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349b8f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xae916491 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182611:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182618:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182623:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182628:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.182630:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182636:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182647:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfd:0x0].0x0 (ffff9bbe16cc5300) 00010000:00010000:0.0:1787826303.182649:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826303.182652:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.182657:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349b8f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.182727:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84235:x1874668789827584:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 637us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.182734:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111542 00000100:00100000:0.0:1787826303.182755:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111543 00000100:00100000:0.0:1787826303.182762:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84233:x1874668789827712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.182773:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826303.182783:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b8ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc035 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183445:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183462:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183471:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826303.183483:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfb:0x0]: returning size 158 00010000:00010000:0.0:1787826303.183590:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183598:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183605:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183610:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.183613:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183621:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183632:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfb:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:0.0:1787826303.183635:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826303.183638:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183644:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349b906 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183687:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b8ff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc035 expref: 57 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183698:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826303.183700:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826303.183704:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b8ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc035 expref: 57 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.183715:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:0.0:1787826303.183766:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84233:x1874668789827712:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1004us (1888us total) trans 8590016626 rc 301/301 00000100:00100000:0.0:1787826303.183775:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111543 00000100:00100000:2.0:1787826303.188734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.188787:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789827840 00000100:00100000:2.0:1787826303.188955:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789827840 00000100:00100000:2.0:1787826303.189042:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111544 00000100:00100000:2.0:1787826303.189055:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84233:x1874668789827840:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826303.189105:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826303.189263:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84233:x1874668789827840:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 210us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.189272:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111544 00000100:00100000:3.0:1787826303.192413:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.192651:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789828096 00000100:00100000:2.0:1787826303.192669:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789828096 00000100:00100000:2.0:1787826303.192823:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111545 00000100:00100000:2.0:1787826303.192836:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84235:x1874668789828096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.192904:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.192935:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b914 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc03c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193083:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193101:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193115:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826303.193132:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfd:0x0]: returning size 158 00010000:00010000:2.0:1787826303.193248:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193257:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193264:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193270:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.193275:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193283:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193297:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfd:0x0].0x0 (ffff9bbe16cc5300) 00010000:00010000:2.0:1787826303.193300:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826303.193306:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193416:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b91b lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193468:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b914 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc03c expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193480:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826303.193482:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826303.193487:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b914 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc03c expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.193497:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826303.193586:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84235:x1874668789828096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 754us (1200us total) trans 8590016627 rc 301/301 00000100:00100000:2.0:1787826303.193596:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111545 00000100:00100000:0.0:1787826303.207075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.207159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.207270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.207472:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789828352 00000100:00100000:2.0:1787826303.207486:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789828352 00000100:00100000:2.0:1787826303.207558:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789828736 00000100:00100000:2.0:1787826303.207561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789828736 00000100:00100000:2.0:1787826303.207587:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111546 00000100:00100000:2.0:1787826303.207597:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84234:x1874668789828352:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.207627:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.207656:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b929 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc043 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.207892:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.207911:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.207926:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826303.207940:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfc:0x0]: returning size 158 00010000:00010000:2.0:1787826303.208046:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.208059:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.208068:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.208074:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.208079:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.208088:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.208102:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfc:0x0].0x0 (ffff9bbe16cc5c00) 00010000:00010000:2.0:1787826303.208106:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826303.208112:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.208119:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349b930 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.208167:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b929 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc043 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.208178:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826303.208180:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826303.208184:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b929 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc043 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.208194:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:2.0:1787826303.208281:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84234:x1874668789828352:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 685us (1223us total) trans 8590016628 rc 301/301 00000100:00100000:2.0:1787826303.208291:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111546 00000100:00100000:2.0:1787826303.208685:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789828608 00000100:00100000:2.0:1787826303.208761:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789828608 00000100:00100000:2.0:1787826303.208808:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111547 00000100:00100000:2.0:1787826303.208817:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84235:x1874668789828736:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826303.208848:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfd:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826303.208961:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84235:x1874668789828736:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 145us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.208969:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111547 00000100:00100000:2.0:1787826303.208985:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111548 00000100:00100000:2.0:1787826303.208991:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84233:x1874668789828608:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.209002:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.209018:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b93e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc04a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.213151:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b945 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.213179:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b945 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.213193:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b945 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826303.213209:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12e:0x0]: returning size 0 00010000:00010000:2.0:1787826303.213291:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b93e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc04a expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.213323:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b945 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc04a expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.213333:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:2.0:1787826303.213337:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826303.213341:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826303.213445:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84233:x1874668789828608:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4452us (6173us total) trans 8590016629 rc 0/0 00000100:00100000:2.0:1787826303.213455:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111548 00000100:00100000:1.0:1787826303.221617:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.221888:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789828992 00000100:00100000:3.0:1787826303.221900:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789828992 00000100:00100000:3.0:1787826303.221981:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111549 00000100:00100000:3.0:1787826303.221993:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84233:x1874668789828992:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.222087:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.222130:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349b945 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc04a expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222154:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c800) 00010000:00010000:3.0:1787826303.222168:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826303.222204:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222223:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222235:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222252:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222259:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222266:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222346:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222355:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222363:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222371:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.222376:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222384:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222392:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826303.222404:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.222410:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222416:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b953 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222427:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222433:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222439:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222444:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.222447:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222453:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222464:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x244470bb (ffff9bbe08124300) 00010000:00010000:3.0:1787826303.222466:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.222469:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.222475:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b95a lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x244470bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.222577:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84233:x1874668789828992:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 584us (974us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826303.222586:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111549 00000100:00100000:3.0:1787826303.224352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.224647:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789829120 00000100:00100000:1.0:1787826303.224659:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789829120 00000100:00100000:1.0:1787826303.224722:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111550 00000100:00100000:1.0:1787826303.224734:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84234:x1874668789829120:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826303.224773:0:45683:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfc:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826303.227264:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84234:x1874668789829120:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 2516us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.227281:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111550 00000100:00100000:1.0:1787826303.232015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.232189:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789829248 00000100:00100000:2.0:1787826303.232201:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789829248 00000100:00100000:1.0:1787826303.232266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.232268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111551 00000100:00100000:2.0:1787826303.232280:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84233:x1874668789829248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.232308:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.232340:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b961 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc051 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.232389:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.232390:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789829504 00000100:00100000:1.0:1787826303.232394:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789829504 00010000:00010000:2.0:1787826303.232416:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.232433:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.232436:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111552 00000100:00100000:1.0:1787826303.232443:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+61:84235:x1874668789829504:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.232451:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.232462:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b96f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc058 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.232586:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b961 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc051 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.232606:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc051 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.232616:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826303.232619:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826303.232623:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:2.0:1787826303.232707:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84233:x1874668789829248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 416us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.232715:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111551 00010000:00010000:1.0:1787826303.233253:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b976 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.233265:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b976 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.233275:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b976 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826303.235986:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12f:0x0]: returning size 0 00010000:00010000:1.0:1787826303.236107:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b96f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc058 expref: 63 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.236130:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b976 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc058 expref: 62 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.236141:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0bd66700) 00010000:00010000:1.0:1787826303.236145:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826303.236149:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc 0) 00000100:00100000:1.0:1787826303.236243:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84235:x1874668789829504:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 3798us (3975us total) trans 8590016630 rc 0/0 00000100:00100000:1.0:1787826303.236253:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111552 00000100:00100000:0.0:1787826303.245787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.248384:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789829760 00000100:00100000:3.0:1787826303.248413:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789829760 00000100:00100000:3.0:1787826303.248499:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111553 00000100:00100000:3.0:1787826303.248512:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84233:x1874668789829760:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.248639:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.248663:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.248678:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826303.248924:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000991cf70f reply state 00000000ccf642c4 transno 8590016631 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.248941:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.248951:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:3.0:1787826303.248954:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826303.248959:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826303.249094:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84233:x1874668789829760:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 585us (3322us total) trans 8590016631 rc 0/0 00000100:00100000:3.0:1787826303.249103:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111553 00000100:00100000:0.0:1787826303.250813:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.253864:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789830016 00000100:00100000:3.0:1787826303.253884:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789830016 00000100:00100000:3.0:1787826303.253964:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111554 00000100:00100000:3.0:1787826303.253976:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84235:x1874668789830016:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.254053:0:45682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.254086:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b976 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc058 expref: 64 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254108:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0bd66700) 00010000:00010000:3.0:1787826303.254121:0:45682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826303.254150:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254167:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254178:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254201:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254214:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254221:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254276:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254286:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254294:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254300:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.254305:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254321:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254329:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826303.254332:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.254337:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254343:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b98b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254353:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254360:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254366:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254371:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.254374:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254379:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254385:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x69477f04 (ffff9bbe08124300) 00010000:00010000:3.0:1787826303.254388:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.254390:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.254404:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b992 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x69477f04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.254505:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84235:x1874668789830016:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 530us (3712us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826303.254512:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111554 00000100:00100000:0.0:1787826303.256584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.256732:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789830144 00000100:00100000:1.0:1787826303.256744:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789830144 00000100:00100000:1.0:1787826303.257098:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111555 00000100:00100000:1.0:1787826303.257113:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84233:x1874668789830144:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.257144:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.257172:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc05f expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.257259:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc05f expref: 64 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.257293:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc05f expref: 64 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.257303:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:1.0:1787826303.257307:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.257321:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:1.0:1787826303.257391:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84233:x1874668789830144:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 283us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.257408:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111555 00000100:00100000:3.0:1787826303.259646:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.259696:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789830272 00000100:00100000:2.0:1787826303.259708:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789830272 00000100:00100000:2.0:1787826303.259771:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111556 00000100:00100000:2.0:1787826303.259781:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84235:x1874668789830272:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.259801:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:2.0:1787826303.259820:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.260298:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b9a0 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc066 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.260350:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.260365:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.260379:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.260933:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349b9a0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc066 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.260961:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc066 expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.260970:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:2.0:1787826303.260973:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826303.260978:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826303.261066:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84235:x1874668789830272:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1285us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.261075:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111556 00000100:00100000:2.0:1787826303.261114:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789830528 00000100:00100000:2.0:1787826303.261120:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789830528 00000100:00100000:2.0:1787826303.261217:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111557 00000100:00100000:2.0:1787826303.261228:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84234:x1874668789830528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.261244:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.261261:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b9ae lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc06d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.262277:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b9b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.262298:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.262310:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826303.262323:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x130:0x0]: returning size 0 00010000:00010000:2.0:1787826303.262388:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349b9ae lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc06d expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.262734:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc06d expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.262746:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0fe8cd00) 00010000:00010000:2.0:1787826303.262749:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826303.262752:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:2.0:1787826303.262838:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84234:x1874668789830528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1611us (3034us total) trans 8590016632 rc 0/0 00000100:00100000:2.0:1787826303.262874:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111557 00000100:00100000:0.0:1787826303.271521:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.272221:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789830912 00000100:00100000:1.0:1787826303.272238:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789830912 00000100:00100000:3.0:1787826303.272358:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111558 00000100:00100000:3.0:1787826303.272375:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84235:x1874668789830912:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.272519:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.272540:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.272554:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826303.272744:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067426e10 reply state 00000000f5a9cb01 transno 8590016633 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.272760:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.272768:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:3.0:1787826303.272771:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787826303.272776:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826303.272948:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84235:x1874668789830912:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 576us (1438us total) trans 8590016633 rc 0/0 00000100:00100000:3.0:1787826303.272958:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111558 00000100:00100000:0.0:1787826303.279651:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.279789:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789831040 00000100:00100000:3.0:1787826303.279802:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789831040 00000100:00100000:3.0:1787826303.279911:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111559 00000100:00100000:3.0:1787826303.279924:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84235:x1874668789831040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.279959:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.279988:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc074 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.280074:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc074 expref: 70 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.280092:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc074 expref: 70 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.280104:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:3.0:1787826303.280108:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826303.280113:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc 0) 00000100:00100000:3.0:1787826303.280195:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84235:x1874668789831040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 273us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.280204:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111559 00000100:00100000:1.0:1787826303.280309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.280557:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789830656 00000100:00100000:3.0:1787826303.280563:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789830656 00000100:00100000:3.0:1787826303.280754:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2704 00000100:00100000:3.0:1787826303.280763:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84233:x1874668789830656:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.280936:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84233:x1874668789830656:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 174us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.280944:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2704 00000100:00100000:2.0:1787826303.287634:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.287733:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789831296 00000100:00100000:3.0:1787826303.287750:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789831296 00000100:00100000:3.0:1787826303.287836:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111560 00000100:00100000:3.0:1787826303.288105:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84234:x1874668789831296:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.288186:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.288347:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349b9b5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc06d expref: 70 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288374:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0fe8cd00) 00010000:00010000:3.0:1787826303.288389:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826303.288431:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288449:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288462:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288480:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288489:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288496:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288558:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288566:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288573:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288579:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.288585:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288593:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288603:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826303.288606:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.288611:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288618:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349b9d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288628:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288634:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288640:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288645:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.288649:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288655:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288661:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xdbdaae41 (ffff9bbe08124300) 00010000:00010000:3.0:1787826303.288664:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.288667:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.288673:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349b9d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xdbdaae41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.290109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.290163:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.290541:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789831424 00000100:00100000:0.0:1787826303.290551:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789831424 00000100:00100000:0.0:1787826303.290620:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789831680 00000100:00100000:0.0:1787826303.290624:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789831680 00000100:00100000:0.0:1787826303.290641:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2705 00000100:00100000:0.0:1787826303.290650:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84235:x1874668789831424:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787826303.290807:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84235:x1874668789831424:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 157us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.290816:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2705 00000100:00100000:0.0:1787826303.290962:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2706 00000100:00100000:0.0:1787826303.290970:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84233:x1874668789831680:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826303.291161:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84233:x1874668789831680:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 191us (997us total) trans 8590016634 rc 0/0 00000100:00100000:0.0:1787826303.291169:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2706 00000100:00100000:2.0:1787826303.292068:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84234:x1874668789831296:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 4216us (4448us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826303.292080:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111560 00000100:00100000:2.0:1787826303.299902:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.299956:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.300590:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789831936 00000100:00100000:1.0:1787826303.300604:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789831936 00000100:00100000:1.0:1787826303.300665:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789832064 00000100:00100000:1.0:1787826303.300669:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789832064 00000100:00100000:1.0:1787826303.300695:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111561 00000100:00100000:1.0:1787826303.300707:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84234:x1874668789831936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.300737:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.300771:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9df lrc: 2/0,0 mode: --/PR res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc07b expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.303639:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.303669:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.303689:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.303942:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111562 00000100:00100000:3.0:1787826303.303965:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84233:x1874668789832064:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.304102:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84233:x1874668789832064:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 149us (4144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.304115:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111562 00010000:00010000:1.0:1787826303.305243:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9df lrc: 0/0,0 mode: --/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc07b expref: 73 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.305283:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc07b expref: 71 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.305294:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:1.0:1787826303.305297:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826303.305301:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc 0) 00000100:00100000:1.0:1787826303.306099:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84234:x1874668789831936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5389us (6208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.306110:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111561 00000100:00100000:3.0:1787826303.308220:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.308329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.308417:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789832320 00000100:00100000:1.0:1787826303.308430:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789832320 00000100:00100000:1.0:1787826303.308506:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2707 00000100:00100000:1.0:1787826303.308519:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84235:x1874668789832320:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.309132:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84235:x1874668789832320:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 330us (639us total) trans 8590016635 rc 0/0 00000100:00100000:1.0:1787826303.309143:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2707 00000100:00100000:0.0:1787826303.309336:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789832576 00000100:00100000:0.0:1787826303.309343:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789832576 00000100:00100000:0.0:1787826303.309409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111563 00000100:00100000:0.0:1787826303.309419:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84233:x1874668789832576:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.309434:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826303.309461:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b9ed lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc082 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.309586:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.309605:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc05f expref: 73 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.309616:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.309660:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc05f expref: 73 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.309676:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc05f expref: 73 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.309692:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778639488:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826303.309802:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826303.323811:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.323932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789832832 00000100:00100000:1.0:1787826303.323956:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789832832 00000100:00100000:1.0:1787826303.324033:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111564 00000100:00100000:1.0:1787826303.324044:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84234:x1874668789832832:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.324166:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.324188:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.324202:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826303.324387:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004855c7b0 reply state 0000000068c5f01f transno 8590016636 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.324414:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.324424:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:1.0:1787826303.324427:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826303.324433:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826303.324568:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84234:x1874668789832832:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 525us (772us total) trans 8590016636 rc 0/0 00000100:00100000:1.0:1787826303.324577:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111564 00000100:00100000:3.0:1787826303.333692:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.333775:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.333875:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778639488:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.333913:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.334091:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789833216 00000100:00100000:2.0:1787826303.334091:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789833088 00000100:00100000:2.0:1787826303.334101:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789833088 00000100:00100000:1.0:1787826303.334102:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789833216 00010000:00010000:1.0:1787826303.334155:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc05f expref: 77 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.334173:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111565 00000100:00100000:2.0:1787826303.334185:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84235:x1874668789833088:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.334188:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3076 00000100:00100000:1.0:1787826303.334201:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:2401:x1874668789833216:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.334220:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.334229:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc05f expref: 77 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334244:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc05f expref: 77 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334272:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349b999 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc05f expref: 77 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334290:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:1.0:1787826303.334295:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334308:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334317:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334343:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.334381:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:2401:x1874668789833216:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 182us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.334391:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3076 00010000:00010000:1.0:1787826303.334437:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334445:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826303.334466:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12e:0x0]: returning size 0 00000004:00080000:1.0:1787826303.334701:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc6:0x0], index 0: 0 00010000:00010000:1.0:1787826303.334838:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334888:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334897:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334903:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.334922:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334932:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334953:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:1.0:1787826303.334957:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.334961:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.334969:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349b9f4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.335026:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b9ed lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc082 expref: 76 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.335038:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826303.335041:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826303.335045:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349b9ed lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc082 expref: 76 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.335060:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:2.0:1787826303.335358:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84235:x1874668789833088:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 1172us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.335367:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111565 00000100:00100000:1.0:1787826303.337286:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84233:x1874668789832576:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 27851us (28938us total) trans 8590016637 rc 301/301 00000100:00100000:1.0:1787826303.337302:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111563 00000100:00100000:3.0:1787826303.339095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.339156:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.339306:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789833344 00000100:00100000:2.0:1787826303.339319:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789833344 00000100:00100000:2.0:1787826303.339386:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789833600 00000100:00100000:2.0:1787826303.339390:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789833600 00000100:00100000:1.0:1787826303.339419:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111566 00000100:00100000:1.0:1787826303.339436:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84234:x1874668789833344:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.339463:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.339494:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc089 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.339575:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc089 expref: 76 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.339593:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc089 expref: 76 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.339605:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:1.0:1787826303.339608:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.339613:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:1.0:1787826303.339685:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84234:x1874668789833344:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 254us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.340342:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111567 00000100:00100000:2.0:1787826303.340356:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84235:x1874668789833600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.340372:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.340391:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ba10 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc090 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.340528:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.340543:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc074 expref: 77 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.340551:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.340592:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc074 expref: 77 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.340608:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc074 expref: 77 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.340626:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0884a940 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778639616:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826303.340712:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf01254f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.343301:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111566 00000100:00100000:3.0:1787826303.347806:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.347875:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.347907:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789833856 00000100:00100000:3.0:1787826303.347918:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789833856 00000100:00100000:3.0:1787826303.347980:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789833984 00000100:00100000:3.0:1787826303.347983:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789833984 00000100:00100000:3.0:1787826303.347999:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2708 00000100:00100000:3.0:1787826303.348010:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84233:x1874668789833856:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.348390:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84233:x1874668789833856:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 380us (607us total) trans 8590016638 rc 0/0 00000100:00100000:3.0:1787826303.348409:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2708 00000100:00100000:3.0:1787826303.348431:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2709 00000100:00100000:3.0:1787826303.348438:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84234:x1874668789833984:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.348498:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84234:x1874668789833984:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 61us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.348505:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2709 00000100:00100000:0.0:1787826303.353122:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.353165:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.353249:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0884a940 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778639616:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.353292:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.353329:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789834368 00000100:00100000:3.0:1787826303.353337:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789834368 00000100:00100000:3.0:1787826303.353414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2710 00000100:00100000:3.0:1787826303.353425:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84234:x1874668789834368:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.353715:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84234:x1874668789834368:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 290us (547us total) trans 8590016639 rc 0/0 00000100:00100000:3.0:1787826303.353723:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2710 00000100:00100000:3.0:1787826303.354829:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.356484:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789834112 00000100:00100000:1.0:1787826303.356504:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789834112 00000100:00100000:1.0:1787826303.356579:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111568 00000100:00100000:1.0:1787826303.356592:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84233:x1874668789834112:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.356621:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.356648:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ba1e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc097 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.356744:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ba25 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.356761:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ba25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.356775:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ba25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826303.356830:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12e:0x0]: returning size 0 00000004:00200000:1.0:1787826303.356836:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826303.356874:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ba25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.356916:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ba1e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc097 expref: 81 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.357699:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ba25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc097 expref: 80 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.357714:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:1.0:1787826303.357717:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826303.357721:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826303.357820:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84233:x1874668789834112:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1228us (4712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.357834:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111568 00000100:00100000:1.0:1787826303.357931:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789834496 00000100:00100000:1.0:1787826303.358080:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789834496 00010000:00010000:1.0:1787826303.358118:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc074 expref: 80 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.358153:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3077 00000100:00100000:1.0:1787826303.358164:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789834496:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.358180:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.358188:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc074 expref: 80 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.358202:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc074 expref: 80 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.358227:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349b9ca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc074 expref: 80 pid: 45682 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.358242:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:1.0:1787826303.359159:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359178:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359187:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359232:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.359293:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+79:2401:x1874668789834496:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1127us (4468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.359304:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3077 00010000:00010000:1.0:1787826303.359363:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359371:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826303.359394:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12f:0x0]: returning size 0 00000004:00080000:1.0:1787826303.359615:0:25756:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc7:0x0], index 1: 0 00010000:00010000:1.0:1787826303.359747:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359757:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359766:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359775:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.359781:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359791:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359804:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:1.0:1787826303.359807:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.359813:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359819:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ba17 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359904:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ba10 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc090 expref: 79 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359915:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826303.359918:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826303.359922:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349ba10 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc090 expref: 79 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.359931:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:1.0:1787826303.360628:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84235:x1874668789833600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 20274us (21468us total) trans 8590016640 rc 301/301 00000100:00100000:1.0:1787826303.360638:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111567 00000100:00100000:2.0:1787826303.364183:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.364506:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789834752 00000100:00100000:1.0:1787826303.364521:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789834752 00000100:00100000:1.0:1787826303.364596:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111569 00000100:00100000:1.0:1787826303.364608:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84234:x1874668789834752:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.364760:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84234:x1874668789834752:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 154us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.364768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111569 00000100:00100000:0.0:1787826303.373084:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.373184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.373230:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789835264 00000100:00100000:0.0:1787826303.373238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.373244:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789835264 00000100:00100000:1.0:1787826303.374486:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2711 00000100:00100000:1.0:1787826303.374512:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84235:x1874668789835264:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.374993:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789835392 00000100:00100000:3.0:1787826303.375003:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789835392 00000100:00100000:3.0:1787826303.375083:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6300 00000100:00100000:3.0:1787826303.375092:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789835392:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.375106:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.375133:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0a5 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826303.375164:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826303.375187:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=2941s v=(0 0) 00010000:00010000:3.0:1787826303.375192:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.375204:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0a5 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.375224:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0a5 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.375255:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826303.375348:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789835392:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 257us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.375356:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6300 00000100:00100000:1.0:1787826303.375615:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84235:x1874668789835264:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1113us (2429us total) trans 8590016641 rc 0/0 00000100:00100000:1.0:1787826303.375625:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2711 00000100:00100000:2.0:1787826303.377181:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789835008 00000100:00100000:2.0:1787826303.377203:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789835008 00000100:00100000:2.0:1787826303.377698:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111570 00000100:00100000:2.0:1787826303.377712:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84234:x1874668789835008:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.377737:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.377773:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ba3a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc09e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.378477:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.378500:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc089 expref: 80 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.378511:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.378555:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc089 expref: 80 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.378572:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc089 expref: 80 pid: 12105 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.378590:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0884b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778639744:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826303.378712:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf01254f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.385960:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0884b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778639744:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826303.386013:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.390182:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.390239:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.390274:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.390313:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789835520 00000100:00100000:3.0:1787826303.390326:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789835520 00000100:00100000:1.0:1787826303.390360:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789835648 00000100:00100000:1.0:1787826303.390367:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789835648 00000100:00100000:3.0:1787826303.390391:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789835904 00000100:00100000:3.0:1787826303.390406:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789835904 00010000:00010000:1.0:1787826303.390419:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc089 expref: 83 pid: 12105 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.390463:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3078 00000100:00100000:1.0:1787826303.390481:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+83:2401:x1874668789835648:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.390501:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.390510:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc089 expref: 83 pid: 12105 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.390510:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111571 00000100:00100000:3.0:1787826303.390527:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+83:84235:x1874668789835520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.390538:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc089 expref: 83 pid: 12105 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.390569:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349ba09 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc089 expref: 83 pid: 12105 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.390585:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:1.0:1787826303.390591:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.390603:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.390608:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.390619:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.390634:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ba48 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0ac expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.390652:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826303.390732:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ba4f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.390740:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+83:2401:x1874668789835648:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 264us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.390753:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3078 00010000:00010000:3.0:1787826303.390754:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ba4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.390766:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ba4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.390790:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111572 00000100:00100000:1.0:1787826303.390799:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84233:x1874668789835904:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000004:00200000:3.0:1787826303.390827:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x12f:0x0]: returning size 0 00000004:00200000:3.0:1787826303.390833:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1787826303.390887:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84233:x1874668789835904:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 88us (612us total) trans 0 rc 0/0 00000004:00010000:3.0:1787826303.390887:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ba4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.390901:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111572 00010000:00010000:3.0:1787826303.391212:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ba48 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ac expref: 82 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.391229:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ba4f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ac expref: 81 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.391238:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:3.0:1787826303.391242:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826303.391245:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:3.0:1787826303.391272:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84235:x1874668789835520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 751us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.391280:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111571 00010000:00010000:3.0:1787826303.391938:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.391950:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826303.391972:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x130:0x0]: returning size 0 00000004:00080000:3.0:1787826303.392198:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc7:0x0], index 0: 0 00010000:00010000:3.0:1787826303.392415:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.392424:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.392430:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.392436:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.392441:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.392450:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.392468:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:3.0:1787826303.392471:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826303.392476:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.392482:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349ba41 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.392551:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ba3a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc09e expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.392564:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826303.392566:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826303.392571:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349ba3a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc09e expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.392580:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:3.0:1787826303.392651:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84234:x1874668789835008:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 14942us (19651us total) trans 8590016642 rc 301/301 00000100:00100000:3.0:1787826303.392660:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111570 00000100:00100000:1.0:1787826303.405378:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.405464:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789836032 00000100:00100000:3.0:1787826303.405478:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789836032 00000100:00100000:3.0:1787826303.405551:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6301 00000100:00100000:3.0:1787826303.405561:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84233:x1874668789836032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.405584:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.405607:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0b3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.405650:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0a5 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.405661:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.405667:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.405675:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.405801:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0a5 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.405818:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0a5 expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.405835:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778639872:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.406106:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.412587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.412688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.412742:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789836160 00000100:00100000:0.0:1787826303.412756:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789836160 00000100:00100000:3.0:1787826303.412791:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789836416 00000100:00100000:3.0:1787826303.412797:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789836416 00000100:00100000:3.0:1787826303.412971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2712 00000100:00100000:3.0:1787826303.412984:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84234:x1874668789836416:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.413371:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84234:x1874668789836416:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 389us (796us total) trans 8590016643 rc 0/0 00000100:00100000:3.0:1787826303.413380:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2712 00000100:00100000:0.0:1787826303.419566:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6302 00000100:00100000:0.0:1787826303.419591:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789836160:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.419621:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826303.419652:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0ba expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826303.419687:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826303.419713:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=2941s v=(0 0) 00010000:00010000:0.0:1787826303.419719:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826303.419731:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ba expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.419753:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ba expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.419770:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3a00, rc 0) 00000100:00100000:0.0:1787826303.419877:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789836160:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 296us (7189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.419886:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6302 00000100:00100000:3.0:1787826303.421420:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778639872:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.421472:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.421498:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826303.421553:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84233:x1874668789836032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 15993us (16293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.421566:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6301 00000100:00100000:0.0:1787826303.422033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.422406:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789836544 00000100:00100000:1.0:1787826303.422416:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789836544 00010000:00010000:1.0:1787826303.422470:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0a5 expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.422507:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3079 00000100:00100000:1.0:1787826303.422518:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789836544:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.422537:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.422568:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0a5 expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.422591:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0a5 expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.422621:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd305f64/0x68019081f349ba33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0a5 expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.422639:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826303.422645:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826303.422654:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.422667:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.422723:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.422742:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778640000:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826303.422975:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76ce40 going to sleep for 11 seconds 00000040:00080000:2.0:1787826303.423212:0:54953:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826303.423219:0:54953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826303.423681:0:54953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826303.423692:0:54953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:2.0:1787826303.423895:0:54953:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826303.423898:0:54953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826303.424196:0:54953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826303.424202:0:54953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1787826303.424883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.425106:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789836672 00000100:00100000:3.0:1787826303.425116:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789836672 00000100:00100000:3.0:1787826303.425219:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111573 00000100:00100000:3.0:1787826303.425231:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84234:x1874668789836672:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.425311:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.425338:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ba6b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0c1 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.425450:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ba72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.425468:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ba72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.425484:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ba72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826303.425498:0:54953:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826303.425504:0:54953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000004:00200000:3.0:1787826303.425543:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x130:0x0]: returning size 0 00000004:00200000:3.0:1787826303.425550:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826303.425575:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ba72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.425611:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ba6b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c1 expref: 83 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.425635:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ba72 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c1 expref: 82 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.425654:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:3.0:1787826303.425657:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826303.425662:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606400, rc 0) 00000100:00100000:3.0:1787826303.425751:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84234:x1874668789836672:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 521us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.425770:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111573 00000040:00080000:2.0:1787826303.426653:0:54953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826303.426664:0:54953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:2.0:1787826303.427149:0:54953:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826303.427155:0:54953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826303.427787:0:54953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826303.427988:0:54953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1787826303.429203:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1874668778640000:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826303.429245:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826303.429511:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789836544:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 6992us (7477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.429527:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3079 00000100:00100000:3.0:1787826303.433767:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.433832:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789836928 00000100:00100000:3.0:1787826303.433844:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789836928 00000100:00100000:3.0:1787826303.433948:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111574 00000100:00100000:3.0:1787826303.433960:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84235:x1874668789836928:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.434101:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84235:x1874668789836928:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 143us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.434110:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111574 00000100:00100000:1.0:1787826303.440243:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.440296:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.440344:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789837184 00000100:00100000:0.0:1787826303.440359:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789837184 00002000:00100000:0.0:1787826303.440440:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xc6:0x0] (0->157) req@ffff9bbe12806d00 x1874668789837184/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/0 e 0 to 0 dl 1787826314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826303.440455:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12806d00 with x1874668789837184 ext(0->157) 00002000:00010000:0.0:1787826303.440462:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe12806d00 00000100:00100000:1.0:1787826303.440545:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.440686:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1582 00000100:00100000:0.0:1787826303.440785:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789837184:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.441039:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789837056 00000100:00100000:3.0:1787826303.441044:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789837056 00000100:00100000:3.0:1787826303.441079:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789837312 00000100:00100000:3.0:1787826303.441082:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789837312 00000100:00100000:3.0:1787826303.441104:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6303 00000100:00100000:3.0:1787826303.441112:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789837056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.441130:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.441158:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0c8 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826303.441184:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826303.441205:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=2941s v=(0 0) 00010000:00010000:3.0:1787826303.441210:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.441221:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c8 expref: 15 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.441244:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c8 expref: 15 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.441259:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826303.441462:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789837056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 349us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.441469:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6303 00000100:00100000:3.0:1787826303.441491:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6304 00000100:00100000:3.0:1787826303.441498:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84235:x1874668789837312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.441507:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.441520:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0cf expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.441541:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ba expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.441554:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.441558:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.441562:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 12 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.441599:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ba expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.441614:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ba expref: 12 pid: 8430 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.441630:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778640128:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.441695:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.444083:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2399:x1874668789837184:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 3373us (3914us total) trans 4294968192 rc 0/0 00000100:00100000:2.0:1787826303.444101:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1582 00002000:00100000:2.0:1787826303.444117:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xc6:0x0] (0->157) req@ffff9bbe12806d00 x1874668789837184/t4294968192(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/448 e 0 to 0 dl 1787826314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826303.444130:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12806d00 with x1874668789837184 ext(0->157) 00002000:00010000:2.0:1787826303.444137:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe12806d00 00000100:00100000:1.0:1787826303.449781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.449924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.449963:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789837568 00000100:00100000:1.0:1787826303.449975:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789837568 00000100:00100000:1.0:1787826303.450047:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111575 00000100:00100000:1.0:1787826303.450059:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84234:x1874668789837568:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.450358:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84234:x1874668789837568:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 300us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.450369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111575 00000100:00100000:0.0:1787826303.450958:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778640128:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826303.451002:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 12 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.451028:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc 0) 00000100:00100000:0.0:1787826303.451065:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:84235:x1874668789837312:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9567us (10520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.451074:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6304 00000100:00100000:1.0:1787826303.451160:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789837696 00000100:00100000:1.0:1787826303.451167:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789837696 00010000:00010000:1.0:1787826303.451268:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ba expref: 12 pid: 8430 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.451309:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3080 00000100:00100000:1.0:1787826303.451317:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf40513c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789837696:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.451333:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.451363:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ba expref: 12 pid: 8430 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.451377:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ba expref: 12 pid: 8430 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.451414:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007db86e44/0x68019081f349ba64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ba expref: 12 pid: 8430 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.451427:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826303.451432:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826303.451442:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 11 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.451455:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 11 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.451801:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 11 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.451969:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12804780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778640256:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826303.452044:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.469177:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.469347:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789837824 00000100:00100000:0.0:1787826303.469360:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789837824 00000100:00100000:0.0:1787826303.469442:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111576 00000100:00100000:0.0:1787826303.469454:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84233:x1874668789837824:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787826303.473119:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016643 is committed 00000020:00080000:1.0:1787826303.473203:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0fd09300 refcount 2 committed 0 result 0 batchid 4294970897 00000020:00080000:1.0:1787826303.473209:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0721a800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf40437480 00000020:00080000:1.0:1787826303.473213:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0721ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d247200 00000020:00080000:1.0:1787826303.473242:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0f53d0c0 refcount 2 committed 0 result 0 batchid 4294970896 00000020:00080000:1.0:1787826303.473246:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f53d000 00000020:00080000:1.0:1787826303.473249:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0de29000 00000020:00080000:1.0:1787826303.473261:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0d062180 refcount 2 committed 0 result 0 batchid 4294970895 00000020:00080000:1.0:1787826303.473264:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bcc3700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d062540 00000020:00080000:1.0:1787826303.473266:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf05e83f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d0fb800 00000020:00080000:1.0:1787826303.473291:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970894 batchid updated 00000100:00100000:1.0:1787826303.473456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000020:00080000:0.0:1787826303.473476:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970897 committed batchid 4294970894 00000100:00100000:1.0:1787826303.473549:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12804780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778640256:192.168.203.9@tcp:105: 00000020:00080000:0.0:1787826303.473584:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970894 00010000:00010000:1.0:1787826303.473599:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.473605:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789837952 00000100:00100000:0.0:1787826303.473613:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789837952 00000100:00100000:0.0:1787826303.473670:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6305 00000100:00100000:0.0:1787826303.473680:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:84234:x1874668789837952:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.473939:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf40513c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789837696:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 22621us (24013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.473950:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3080 00000100:00100000:1.0:1787826303.474057:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.474170:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789838080 00000100:00100000:1.0:1787826303.474175:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789838080 00002000:00100000:1.0:1787826303.474215:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc7:0x0] (0->157) req@ffff9bbe12804780 x1874668789838080/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/0 e 0 to 0 dl 1787826314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826303.474226:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12804780 with x1874668789838080 ext(0->157) 00002000:00010000:1.0:1787826303.474233:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe12804780 00000100:00100000:1.0:1787826303.474253:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1583 00000100:00100000:1.0:1787826303.474260:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789838080:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.474868:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.474882:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.474889:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.474897:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.474903:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.474912:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.474935:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12b:0x0].0x0 (ffff9bbe0fe8c100) 00010000:00010000:3.0:1787826303.474938:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.474945:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.474951:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349b81f lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.474975:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.474983:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.474988:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.474993:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.474998:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0d6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.474998:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.475001:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475008:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475015:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12c:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:3.0:1787826303.475018:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.475021:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475025:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349b818 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.475031:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c8 expref: 17 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.475042:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826303.475047:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.475047:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.475053:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475054:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475060:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475064:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.475066:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475071:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475078:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12d:0x0].0x0 (ffff9bbe12458f00) 00010000:00010000:3.0:1787826303.475080:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.475083:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475089:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349b834 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.475091:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c8 expref: 17 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475104:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.475109:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c8 expref: 17 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475110:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475117:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475122:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.475125:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.475126:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778640384:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.475130:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475136:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:3.0:1787826303.475138:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826303.475140:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475146:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349b984 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475154:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475160:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475165:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475170:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.475172:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475177:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475187:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:3.0:1787826303.475189:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826303.475192:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475197:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349b9c3 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475208:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.475211:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787826303.475214:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475220:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475225:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.475227:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475232:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475239:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:3.0:1787826303.475241:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826303.475244:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.475249:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349b9fb lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.475334:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84233:x1874668789837824:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 5881us (6170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.475344:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111576 00000100:00100000:1.0:1787826303.476592:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789838080:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2322us (2524us total) trans 4294968177 rc 0/0 00000100:00100000:1.0:1787826303.476607:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1583 00002000:00100000:1.0:1787826303.476622:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc7:0x0] (0->157) req@ffff9bbe12804780 x1874668789838080/t4294968177(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/448 e 0 to 0 dl 1787826314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826303.476634:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12804780 with x1874668789838080 ext(0->157) 00002000:00010000:1.0:1787826303.476643:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe12804780 00000100:00100000:1.0:1787826303.481065:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.482080:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778640384:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.482129:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.482197:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3800, rc 0) 00000100:00100000:3.0:1787826303.482281:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+17:84234:x1874668789837952:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 8601us (8829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.482292:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6305 00000100:00100000:3.0:1787826303.482337:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789838208 00000100:00100000:3.0:1787826303.482346:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789838208 00000100:00100000:3.0:1787826303.482412:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6306 00000100:00100000:3.0:1787826303.482422:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2399:x1874668789838208:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787826303.483608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.485038:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789838336 00000100:00100000:3.0:1787826303.485055:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789838336 00000100:00100000:3.0:1787826303.485227:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111577 00000100:00100000:3.0:1787826303.485239:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84235:x1874668789838336:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.485424:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84235:x1874668789838336:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 186us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.485432:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111577 00000100:00100000:0.0:1787826303.485707:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.486190:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789838464 00000100:00100000:3.0:1787826303.486199:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789838464 00010000:00010000:3.0:1787826303.486234:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c8 expref: 18 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.486738:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3081 00000100:00100000:3.0:1787826303.486751:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2401:x1874668789838464:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826303.486770:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.486800:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c8 expref: 18 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.487168:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c8 expref: 18 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.487199:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349ba79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c8 expref: 18 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.487219:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.487224:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.487233:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.487245:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.487602:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.487622:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ec780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778640512:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826303.487820:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.488009:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.488343:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789838592 00000100:00100000:3.0:1787826303.488353:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789838592 00000100:00100000:3.0:1787826303.488428:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6307 00000100:00100000:3.0:1787826303.488440:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789838592:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787826303.490244:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968177 is committed 00000001:00080000:1.0:1787826303.490266:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968176 is committed 00000001:00080000:0.0:1787826303.490445:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968192 is committed 00000001:00080000:0.0:1787826303.490457:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968191 is committed 00000100:00100000:0.0:1787826303.490603:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789838208:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 8174us (9545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.490616:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6306 00000100:00100000:0.0:1787826303.492015:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.492135:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ec780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778640512:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826303.492167:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.492227:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789838464:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5479us (6519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.492238:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3081 00000100:00100000:2.0:1787826303.492603:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789838720 00000100:00100000:2.0:1787826303.492614:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789838720 00002000:00100000:2.0:1787826303.492677:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc7:0x0] (0->157) req@ffff9bbf3fcc0f00 x1874668789838720/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/0 e 0 to 0 dl 1787826314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826303.492690:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fcc0f00 with x1874668789838720 ext(0->157) 00002000:00010000:2.0:1787826303.493258:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fcc0f00 00000100:00100000:2.0:1787826303.493298:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1584 00000100:00100000:2.0:1787826303.493310:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789838720:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787826303.494568:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789838720:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1251us (2555us total) trans 4294968193 rc 0/0 00000100:00100000:3.0:1787826303.494568:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789838592:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 6120us (6549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.494581:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1584 00000100:00100000:3.0:1787826303.494581:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6307 00002000:00100000:0.0:1787826303.494593:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc7:0x0] (0->157) req@ffff9bbf3fcc0f00 x1874668789838720/t4294968193(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/448 e 0 to 0 dl 1787826314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826303.494602:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fcc0f00 with x1874668789838720 ext(0->157) 00002000:00010000:0.0:1787826303.494609:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf3fcc0f00 00000100:00100000:0.0:1787826303.494676:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.495244:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789838976 00000100:00100000:3.0:1787826303.495253:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789838976 00000100:00100000:0.0:1787826303.495421:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111578 00000100:00100000:0.0:1787826303.495437:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84233:x1874668789838976:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.495526:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.495567:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ba25 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc097 expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.495587:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826303.495594:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826303.495639:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.495655:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.495672:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826303.495839:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086a21a45 reply state 00000000c1cf003b transno 8590016644 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.495890:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.495897:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826303.495900:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826303.495903:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826303.496015:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84233:x1874668789838976:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 580us (1338us total) trans 8590016644 rc 0/0 00000100:00100000:0.0:1787826303.496023:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111578 00000100:00100000:2.0:1787826303.499330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.499370:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.499422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.499451:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789839104 00000100:00100000:2.0:1787826303.499464:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789839104 00000100:00100000:2.0:1787826303.499521:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789839232 00000100:00100000:2.0:1787826303.499525:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789839232 00000100:00100000:2.0:1787826303.499541:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789839488 00000100:00100000:2.0:1787826303.499543:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789839488 00000100:00100000:2.0:1787826303.499564:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111579 00000100:00100000:2.0:1787826303.499575:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84234:x1874668789839104:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.499752:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84234:x1874668789839104:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 178us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.499760:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111579 00000100:00100000:2.0:1787826303.499781:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111580 00000100:00100000:2.0:1787826303.499788:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84233:x1874668789839232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.499803:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.499828:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0dd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.499923:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0dd expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.499942:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0dd expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.499964:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826303.499969:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.499974:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826303.499997:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84233:x1874668789839232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 209us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.500002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111580 00000100:00100000:2.0:1787826303.500015:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111581 00000100:00100000:2.0:1787826303.500022:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84235:x1874668789839488:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.500067:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.500088:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ba4f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0ac expref: 33 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.500100:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:2.0:1787826303.500104:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826303.500129:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.500139:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.500146:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826303.500293:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002134262e reply state 0000000064b37685 transno 8590016645 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.500307:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.500314:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:2.0:1787826303.500317:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826303.500320:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826303.500370:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84235:x1874668789839488:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 347us (946us total) trans 8590016645 rc 0/0 00000100:00100000:2.0:1787826303.500377:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111581 00000100:00100000:3.0:1787826303.507208:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.507258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.507310:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789839744 00000100:00100000:1.0:1787826303.507323:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789839744 00000100:00100000:3.0:1787826303.507364:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.507412:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111582 00000100:00100000:1.0:1787826303.507424:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84235:x1874668789839744:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.507460:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.507490:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0e4 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.507573:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0e4 expref: 35 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.507592:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0e4 expref: 35 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.507617:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:1.0:1787826303.507621:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.507627:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826303.507709:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84235:x1874668789839744:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 287us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.507717:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111582 00000100:00100000:0.0:1787826303.507965:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789839616 00000100:00100000:0.0:1787826303.507971:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789839616 00000100:00100000:0.0:1787826303.508012:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789839872 00000100:00100000:0.0:1787826303.508015:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789839872 00000100:00100000:0.0:1787826303.508041:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6308 00000100:00100000:0.0:1787826303.508048:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2400:x1874668789839616:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787826303.508114:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6309 00000100:00100000:0.0:1787826303.508121:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789839872:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826303.508283:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc6:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826303.508287:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc6:0x0] updating lvb mtime from disk: 0 -> 1787826222 00002000:00010000:0.0:1787826303.508290:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc6:0x0] updating lvb atime from disk: 0 -> 1787826222 00002000:00010000:0.0:1787826303.508292:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc6:0x0] updating lvb ctime from disk: 0 -> 1787826222 00002000:00010000:0.0:1787826303.508295:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826303.508333:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2401:x1874668789839872:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 212us (968us total) trans 4294968194 rc 0/0 00000100:00100000:0.0:1787826303.508340:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6309 00000001:00080000:0.0:1787826303.511027:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968194 is committed 00000100:00100000:3.0:1787826303.511211:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789839616:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 3156us (4011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.511224:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6308 00000100:00100000:1.0:1787826303.512901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.513441:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789840128 00000100:00100000:3.0:1787826303.513455:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789840128 00000100:00100000:3.0:1787826303.513536:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111583 00000100:00100000:3.0:1787826303.513550:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84233:x1874668789840128:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.513647:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.513678:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc051 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.513689:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 4/0,1 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.513734:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc051 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.513751:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc051 expref: 35 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.513769:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778640640:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.513918:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826303.516032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.516429:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789840256 00000100:00100000:1.0:1787826303.516442:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789840256 00000100:00100000:1.0:1787826303.516512:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6310 00000100:00100000:1.0:1787826303.516523:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2400:x1874668789840256:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787826303.516825:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787826303.516830:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb mtime from disk: 0 -> 1787826222 00002000:00010000:1.0:1787826303.516833:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb atime from disk: 0 -> 1787826222 00002000:00010000:1.0:1787826303.516836:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb ctime from disk: 0 -> 1787826222 00002000:00010000:1.0:1787826303.516839:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787826303.516940:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789840256:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 418us (918us total) trans 4294968178 rc 0/0 00000100:00100000:1.0:1787826303.516948:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6310 00000100:00100000:1.0:1787826303.519424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.519651:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778640640:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.519761:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.519814:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789840384 00000100:00100000:0.0:1787826303.519822:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789840384 00010000:00010000:0.0:1787826303.519906:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc051 expref: 36 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.519945:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3082 00000100:00100000:1.0:1787826303.520070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.520299:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789840640 00000100:00100000:2.0:1787826303.520304:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789840640 00000100:00100000:2.0:1787826303.520344:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111584 00000100:00100000:2.0:1787826303.520354:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84234:x1874668789840640:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.520438:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.520472:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ba72 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x130:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0c1 expref: 37 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.520490:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:2.0:1787826303.520496:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.520539:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789840384:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.520552:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.520558:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc051 expref: 36 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.520572:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc051 expref: 36 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.520586:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349b968 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc051 expref: 36 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.520596:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826303.520601:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.520612:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.520625:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.520651:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.520718:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2402:x1874668789840384:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 183us (1303us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826303.520763:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.520777:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.520785:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826303.520970:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074b29598 reply state 0000000061174721 transno 8590016646 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.520991:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.520998:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:2.0:1787826303.521001:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826303.521004:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826303.521081:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84234:x1874668789840640:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 729us (1011us total) trans 8590016646 rc 0/0 00000100:00100000:2.0:1787826303.521089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111584 00000100:00100000:0.0:1787826303.525529:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3082 00010000:00010000:0.0:1787826303.525604:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.525617:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.525668:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.525676:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.525684:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.525691:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.525696:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.525705:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.525727:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826303.525732:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787826303.525737:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 2/0,0 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.525744:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349baaa lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.525893:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84233:x1874668789840128:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 12344us (13048us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787826303.525903:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111583 00000100:00100000:2.0:1787826303.529563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.529614:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789840896 00000100:00100000:3.0:1787826303.529626:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789840896 00000100:00100000:3.0:1787826303.529765:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111585 00000100:00100000:3.0:1787826303.529778:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84235:x1874668789840896:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.529943:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.529964:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc066 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.529990:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.530033:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc066 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.530050:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc066 expref: 35 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.530067:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778640768:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.530169:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826303.532319:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.532463:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789841024 00000100:00100000:2.0:1787826303.532475:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789841024 00000100:00100000:2.0:1787826303.532547:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111586 00000100:00100000:2.0:1787826303.532560:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84234:x1874668789841024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.532583:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.532611:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0eb expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.532761:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0eb expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.532779:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0eb expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.532801:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:2.0:1787826303.532813:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.532819:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2200, rc 0) 00000100:00100000:2.0:1787826303.532909:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84234:x1874668789841024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 352us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.532917:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111586 00000100:00100000:3.0:1787826303.533614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.533754:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789841152 00000100:00100000:2.0:1787826303.533760:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789841152 00000100:00100000:2.0:1787826303.535808:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6311 00000100:00100000:2.0:1787826303.535833:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789841152:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.535917:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.535943:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.535952:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.535957:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826303.535963:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.536006:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.536020:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 13 pid: 8432 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.536036:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0884a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778640896:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826303.536150:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.539189:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778640768:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826303.539231:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.539444:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.539992:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789841280 00000100:00100000:1.0:1787826303.540001:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789841280 00000100:00100000:2.0:1787826303.540041:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826303.540048:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc066 expref: 37 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.540088:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3083 00000100:00100000:2.0:1787826303.540088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.540098:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2401:x1874668789841280:12345-192.168.203.9@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787826303.540113:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789841536 00000100:00100000:2.0:1787826303.540117:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789841536 00010000:00010000:1.0:1787826303.540118:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.540124:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc066 expref: 37 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540137:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 14 pid: 8432 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540139:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc066 expref: 37 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.540163:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3084 00010000:00010000:1.0:1787826303.540167:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349b9a7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc066 expref: 37 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.540169:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789841536:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.540180:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.540184:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:1.0:1787826303.540189:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540200:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540205:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 14 pid: 8432 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540209:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540215:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 14 pid: 8432 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540233:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826303.540234:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826303.540239:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826303.540243:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540253:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540265:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.540292:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789841280:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 195us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.540300:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3083 00010000:00010000:1.0:1787826303.540332:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540339:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.540349:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789841536:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 180us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.540358:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3084 00010000:00010000:1.0:1787826303.540403:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540412:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349ba5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0b3 expref: 13 pid: 8432 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540416:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540424:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.540424:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0884a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778640896:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826303.540430:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.540435:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540439:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540443:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540448:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540452:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:1.0:1787826303.540455:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826303.540455:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540459:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.540465:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349bab8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540475:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540482:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540488:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540495:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826303.540498:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.540507:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84235:x1874668789840896:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 10733us (10955us total) trans 0 rc -22/-22 00010000:00010000:2.0:1787826303.540508:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.540515:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111585 00010000:00010000:2.0:1787826303.540519:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.540525:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372f2cd6/0x68019081f349bac6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.540572:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789841152:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 4751us (6964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.540581:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6311 00000100:00100000:2.0:1787826303.540595:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789841408 00000100:00100000:2.0:1787826303.540599:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789841408 00000100:00100000:2.0:1787826303.540625:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6312 00000100:00100000:2.0:1787826303.540632:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789841408:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787826303.541065:0:45681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787826303.541070:0:45681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb mtime from disk: 0 -> 1787826222 00002000:00010000:2.0:1787826303.541073:0:45681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb atime from disk: 0 -> 1787826222 00002000:00010000:2.0:1787826303.541076:0:45681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb ctime from disk: 0 -> 1787826222 00002000:00010000:2.0:1787826303.541078:0:45681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787826303.541103:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2399:x1874668789841408:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 471us (1063us total) trans 4294968195 rc 0/0 00000100:00100000:2.0:1787826303.541111:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6312 00000100:00100000:3.0:1787826303.544636:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.544827:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.544840:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789841664 00000100:00100000:1.0:1787826303.544870:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789841664 00000100:00100000:3.0:1787826303.544886:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789841920 00000100:00100000:3.0:1787826303.544889:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789841920 00000100:00100000:1.0:1787826303.544934:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6313 00000100:00100000:3.0:1787826303.544934:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111587 00000100:00100000:1.0:1787826303.544944:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789841664:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.544944:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84234:x1874668789841920:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.545004:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.545015:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.545030:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc07b expref: 35 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.545032:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 10 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.545041:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.545042:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.545046:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826303.545050:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.545082:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 10 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.545082:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc07b expref: 35 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.545099:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 10 pid: 8605 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.545102:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc07b expref: 35 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.545118:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410630c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778641152:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.545118:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778641024:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826303.545909:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826303.549045:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d062300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.549209:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.549361:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789842176 00000100:00100000:3.0:1787826303.549372:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789842176 00000100:00100000:3.0:1787826303.549443:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111588 00000100:00100000:3.0:1787826303.549453:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84233:x1874668789842176:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.549564:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 3/0,1 mode: --/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.549585:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.549599:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.551487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.552069:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410630c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778641152:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826303.552105:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.552545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.552606:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789842304 00010000:00010000:3.0:1787826303.552608:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.552614:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789842304 00010000:00010000:3.0:1787826303.552627:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0dd expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.552636:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.552655:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 11 pid: 8605 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.553080:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789842432 00000100:00100000:0.0:1787826303.553086:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789842432 00010000:00010000:0.0:1787826303.553104:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc07b expref: 38 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.553175:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3085 00000100:00100000:2.0:1787826303.553189:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789842304:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.553208:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826303.553232:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778641024:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826303.553232:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 11 pid: 8605 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553246:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 11 pid: 8605 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.553252:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553272:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000329ea543/0x68019081f349ba80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0cf expref: 11 pid: 8605 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553290:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826303.553295:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826303.553301:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553312:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553344:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826303.553361:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.553369:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.553402:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.553410:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.553419:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.553423:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789842304:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 238us (1949us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826303.553428:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826303.553433:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.553433:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3085 00010000:00010000:1.0:1787826303.553443:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.553456:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.553457:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3086 00000100:00100000:2.0:1787826303.553463:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789842432:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.553471:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349bacd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553474:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.553480:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc07b expref: 38 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553489:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc07b expref: 38 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553503:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349b9e6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x130:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc07b expref: 38 pid: 23845 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553515:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:2.0:1787826303.553520:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.553521:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2402:x1874668789841664:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 8579us (8899us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826303.553529:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.553530:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6313 00010000:00010000:2.0:1787826303.553536:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553553:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826303.553571:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2402:x1874668789842432:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 107us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.553577:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3086 00010000:00010000:2.0:1787826303.553605:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553616:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553652:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553659:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553666:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553671:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.553675:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553682:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553690:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:2.0:1787826303.553702:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826303.553706:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.553715:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bad4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.553756:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84234:x1874668789841920:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 8814us (8929us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826303.553765:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111587 00010000:00010000:3.0:1787826303.555002:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0dd expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.555026:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0dd expref: 35 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.555046:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778641280:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.555143:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf01254f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.556255:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.556356:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789842688 00000100:00100000:3.0:1787826303.556366:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789842688 00000100:00100000:3.0:1787826303.556486:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111589 00000100:00100000:3.0:1787826303.556498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84235:x1874668789842688:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.556608:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.556629:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.556643:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.557133:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.557149:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0e4 expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.557157:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.557196:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0e4 expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.557210:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0e4 expref: 37 pid: 7736 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.557227:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778641408:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.557336:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15bab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.558458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.559324:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789842816 00000100:00100000:2.0:1787826303.559341:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789842816 00000100:00100000:2.0:1787826303.559451:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6314 00000100:00100000:2.0:1787826303.559463:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2400:x1874668789842816:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.559525:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.559551:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.559561:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.559566:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826303.559572:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.559611:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.559622:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 13 pid: 8430 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.559634:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08848f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778641536:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826303.559741:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf06ec9300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.561528:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.561586:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789842944 00000100:00100000:1.0:1787826303.561596:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789842944 00000100:00100000:2.0:1787826303.561630:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778641408:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826303.561643:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0dd expref: 38 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.561663:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.561690:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3087 00000100:00100000:1.0:1787826303.561710:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789842944:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.561729:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.561737:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0dd expref: 38 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.561750:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0dd expref: 38 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.561781:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:1.0:1787826303.561787:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.561799:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.561953:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.561976:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.562047:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789842944:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 337us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.562055:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3087 00010000:00010000:3.0:1787826303.562927:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349ba95 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0dd expref: 37 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.562951:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778641280:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.562974:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.562982:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.562988:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826303.563143:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016647 00000001:00080000:3.0:1787826303.563406:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016649 00000001:00080000:3.0:1787826303.563457:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016650 00000100:00100000:3.0:1787826303.563565:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778641664:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787826303.563626:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826303.563917:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.564113:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08848f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778641536:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826303.564138:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.564227:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778641664 00000100:00100000:0.0:1787826303.564237:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778641664 00000100:00100000:0.0:1787826303.564309:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3354 00000100:00100000:0.0:1787826303.564321:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778641664:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1787826303.564459:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778641664:12345-0@lo:1000:mdt00_006.0 Request processed in 140us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.564469:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3354 00000100:00100000:3.0:1787826303.564484:0:25756:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968191 gen 2 00000004:00080000:3.0:1787826303.564492:0:25756:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968191 committed transno 4294968191 00000100:00100000:3.0:1787826303.564510:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778641664:0@lo:1000:mdt00_006.0 00000001:00080000:3.0:1787826303.564653:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016651 00000100:00100000:2.0:1787826303.565978:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.566091:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.566124:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789843072 00000100:00100000:2.0:1787826303.566134:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789843072 00010000:00010000:2.0:1787826303.566203:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0e4 expref: 40 pid: 7736 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.566247:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789843200 00000100:00100000:2.0:1787826303.566251:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789843200 00010000:00010000:2.0:1787826303.566277:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 14 pid: 8430 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.566312:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3088 00000100:00100000:2.0:1787826303.566331:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+40:2401:x1874668789843072:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.566360:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.566369:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0e4 expref: 40 pid: 7736 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.566391:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0e4 expref: 40 pid: 7736 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.566419:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3089 00010000:00010000:2.0:1787826303.566430:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349baa3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0e4 expref: 40 pid: 7736 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.566431:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789843200:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826303.566442:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.566448:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:2.0:1787826303.566455:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.566466:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.566467:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 14 pid: 8430 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.566476:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.566479:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 14 pid: 8430 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.566497:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051ed6063/0x68019081f349ba87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0d6 expref: 14 pid: 8430 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.566508:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826303.566512:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826303.566516:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826303.566521:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.566531:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.566552:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826303.566570:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789843200:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 144us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.566571:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789843072:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 249us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.566579:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3088 00010000:00010000:1.0:1787826303.566659:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.566670:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.566695:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.566704:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.566712:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.566725:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826303.566730:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.566738:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.566750:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.566757:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349baf7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.566998:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.567014:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826303.567158:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016648 00000001:00080000:2.0:1787826303.567311:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016653 00000001:00080000:2.0:1787826303.567354:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016654 00000100:00100000:2.0:1787826303.567466:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0884ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778641792:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826303.567551:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3089 00000100:00100000:1.0:1787826303.567565:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2400:x1874668789842816:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 8104us (9113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.567574:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6314 00000100:00100000:1.0:1787826303.567683:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12807c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778641920:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787826303.568739:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826303.573376:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778641792 00000100:00100000:3.0:1787826303.573404:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778641792 00000100:00100000:3.0:1787826303.573508:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3355 00000100:00100000:3.0:1787826303.573519:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778641792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826303.573952:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.573980:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826303.574002:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.574019:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778641920 00000100:00100000:2.0:1787826303.574023:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778641920 00000100:00100000:2.0:1787826303.574055:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3356 00000100:00100000:2.0:1787826303.574062:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:25756:x1874668778641920:12345-0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787826303.574245:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778641920:12345-0@lo:1000:mdt00_006.0 Request processed in 183us (264us total) trans 4294968196 rc 0/0 00000100:00100000:2.0:1787826303.574254:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3356 00000100:00100000:3.0:1787826303.574814:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778641792:12345-0@lo:1000:mdt00_002.0 Request processed in 1286us (6070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.574824:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3355 00000100:00100000:3.0:1787826303.576083:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12807c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778641920:0@lo:1000:mdt00_006.0 00000001:00080000:3.0:1787826303.576241:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016652 00010000:00010000:3.0:1787826303.576317:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576331:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576340:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576346:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.576352:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576361:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576384:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:3.0:1787826303.576388:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826303.576406:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576413:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bae2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576446:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f3499175 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576454:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f3499175 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576459:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f3499175 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576465:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.576467:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f3499175 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576473:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f3499175 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576481:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfb:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:3.0:1787826303.576484:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826303.576487:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f3499175 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576493:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f3499175 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576522:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576535:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576546:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576554:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576560:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576565:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576571:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.576573:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576579:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576586:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfb:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:3.0:1787826303.576588:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.576591:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576596:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bafe lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576605:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576610:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576615:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576619:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.576623:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576628:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576634:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfb:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:3.0:1787826303.576636:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826303.576639:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 2/0,0 mode: --/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.576645:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349badb lrc: 0/0,0 mode: --/PW res: [0x200000403:0xfb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.577011:0:6517:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968176 gen 2 00000004:00080000:2.0:1787826303.577020:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968175 committed transno 4294968176 00000004:00080000:2.0:1787826303.577047:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968176 committed transno 4294968176 00000100:00100000:2.0:1787826303.577064:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0884ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778641792:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787826303.577224:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016655 00000100:00100000:2.0:1787826303.577301:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0884ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778642048:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826303.577449:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826303.577495:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.577532:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778642048 00000100:00100000:2.0:1787826303.577541:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778642048 00000100:00100000:2.0:1787826303.577677:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3357 00000100:00100000:2.0:1787826303.577688:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6517:x1874668778642048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826303.577905:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6517:x1874668778642048:12345-0@lo:1000:mdt00_002.0 Request processed in 217us (455us total) trans 4294968179 rc 0/0 00000100:00100000:2.0:1787826303.577914:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3357 00000100:00100000:2.0:1787826303.577962:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0884ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1874668778642048:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787826303.578037:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016657 00010000:00010000:2.0:1787826303.578067:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578080:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578088:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578096:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.578101:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578110:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578127:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:2.0:1787826303.578130:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.578136:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578143:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349baf0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578171:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f3499183 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578178:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f3499183 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578185:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f3499183 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578191:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.578193:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f3499183 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578200:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f3499183 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578213:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfd:0x0].0x0 (ffff9bbe16cc5300) 00010000:00010000:2.0:1787826303.578215:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.578219:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f3499183 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578224:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f3499183 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578250:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578264:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.578268:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+45:84233:x1874668789842176:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 28811us (29061us total) trans 8590016656 rc 0/0 00010000:00010000:2.0:1787826303.578276:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578285:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578292:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.578294:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111588 00010000:00010000:2.0:1787826303.578303:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787826303.578304:0:25756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00010000:00010000:2.0:1787826303.578311:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.578316:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578322:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578549:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfd:0x0].0x0 (ffff9bbe16cc5300) 00010000:00010000:2.0:1787826303.578553:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826303.578557:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578563:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb05 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578646:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578653:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578659:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578665:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.578668:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578675:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578684:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfd:0x0].0x0 (ffff9bbe16cc5300) 00010000:00010000:2.0:1787826303.578687:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826303.578690:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.578695:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bae9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xfd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.578843:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+44:84235:x1874668789842688:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 22345us (22592us total) trans 8590016658 rc 0/0 00000100:00100000:2.0:1787826303.578927:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111589 00000020:00080000:2.0:1787826303.578932:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787826303.580780:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.585563:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789843456 00000100:00100000:1.0:1787826303.585585:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789843456 00000100:00100000:1.0:1787826303.585669:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111590 00000100:00100000:1.0:1787826303.585681:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+44:84234:x1874668789843456:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.585792:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 3/0,1 mode: --/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.585817:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.585834:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.586069:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.586084:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0eb expref: 45 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.586094:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.586140:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0eb expref: 45 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.586156:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0eb expref: 45 pid: 45683 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.586174:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09796d00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778642176:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826303.586295:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.590677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.590720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.590878:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789843712 00000100:00100000:2.0:1787826303.590889:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789843712 00000100:00100000:2.0:1787826303.590948:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789843968 00000100:00100000:2.0:1787826303.590952:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789843968 00000100:00100000:2.0:1787826303.590969:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2713 00000100:00100000:2.0:1787826303.590980:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+47:84233:x1874668789843712:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787826303.591311:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x12e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787826303.591358:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016660 00010000:00010000:2.0:1787826303.591406:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591428:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591442:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591452:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591459:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591471:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591495:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826303.591615:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:84233:x1874668789843712:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 634us (952us total) trans 8590016661 rc 0/0 00000100:00100000:2.0:1787826303.591624:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2713 00000020:00080000:2.0:1787826303.591631:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826303.591649:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2714 00000100:00100000:2.0:1787826303.591656:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84235:x1874668789843968:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.591749:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826303.591759:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826303.591760:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x12f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1787826303.591769:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826303.591774:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826303.591774:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016662 00010000:00010000:0.0:1787826303.591784:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591793:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591803:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591810:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591816:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.591817:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826303.591820:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826303.591822:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.591826:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 1/0,0 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.591828:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.591834:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bb1a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.591847:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826303.591865:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826303.591868:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.591873:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826303.591876:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.591882:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.591889:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:0.0:1787826303.591892:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826303.591894:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.591898:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84235:x1874668789843968:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 243us (1177us total) trans 8590016663 rc 0/0 00010000:00010000:0.0:1787826303.591905:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bb21 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.591906:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2714 00000020:00080000:2.0:1787826303.591909:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826303.591914:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826303.591916:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826303.591917:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826303.592081:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09796d00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778642176:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826303.592109:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.593093:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826303.595807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.596560:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789844096 00000100:00100000:2.0:1787826303.596573:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789844096 00010000:00010000:2.0:1787826303.596625:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0eb expref: 50 pid: 45683 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.596676:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3090 00000100:00100000:2.0:1787826303.596688:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2401:x1874668789844096:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.596721:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.596730:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0eb expref: 50 pid: 45683 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.596746:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0eb expref: 50 pid: 45683 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.596777:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349babf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0eb expref: 50 pid: 45683 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.596799:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:2.0:1787826303.596806:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.596816:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.596825:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.596882:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826303.596951:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2401:x1874668789844096:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 264us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.596959:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3090 00010000:00010000:3.0:1787826303.597166:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.597176:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826303.597380:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016659 00000001:00080000:3.0:1787826303.597533:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016664 00000001:00080000:3.0:1787826303.597570:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016665 00000100:00100000:3.0:1787826303.597669:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778642304:0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1787826303.597736:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826303.597767:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.598372:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778642304 00000100:00100000:2.0:1787826303.598380:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778642304 00000100:00100000:2.0:1787826303.598442:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358 00000100:00100000:2.0:1787826303.598452:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25759:x1874668778642304:12345-0@lo:1000:mdt00_007.0 00000100:00100000:2.0:1787826303.598568:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25759:x1874668778642304:12345-0@lo:1000:mdt00_007.0 Request processed in 118us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.598577:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358 00000100:00100000:3.0:1787826303.598913:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778642304:0@lo:1000:mdt00_007.0 00000001:00080000:3.0:1787826303.599102:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016666 00000100:00100000:3.0:1787826303.599171:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778642432:0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1787826303.599213:0:25759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826303.599241:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf012ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.599443:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778642432 00000100:00100000:2.0:1787826303.599448:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778642432 00000100:00100000:2.0:1787826303.599494:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359 00000100:00100000:2.0:1787826303.599502:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25759:x1874668778642432:12345-0@lo:1000:mdt00_007.0 00000100:00100000:2.0:1787826303.599680:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:25759:x1874668778642432:12345-0@lo:1000:mdt00_007.0 Request processed in 178us (466us total) trans 4294968197 rc 0/0 00000100:00100000:2.0:1787826303.599702:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359 00000100:00100000:1.0:1787826303.600235:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:25759:1874668778642432:0@lo:1000:mdt00_007.0 00000001:00080000:1.0:1787826303.600331:0:25759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016667 00010000:00010000:1.0:1787826303.600373:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600385:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600409:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600416:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.600421:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600429:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600450:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:1.0:1787826303.600453:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.600459:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600467:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bb13 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600511:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349917c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600518:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349917c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600524:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349917c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600529:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ea00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.600532:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349917c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600542:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349917c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600549:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfc:0x0].0x0 (ffff9bbe16cc5c00) 00010000:00010000:1.0:1787826303.600552:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.600555:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349917c lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600560:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349917c lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600587:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600600:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600610:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600617:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600622:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600628:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600633:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.600636:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600642:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600650:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfc:0x0].0x0 (ffff9bbe16cc5c00) 00010000:00010000:1.0:1787826303.600653:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826303.600656:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600661:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349bb28 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600670:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600675:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600681:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.600686:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.600688:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.601150:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.601163:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfc:0x0].0x0 (ffff9bbe16cc5c00) 00010000:00010000:1.0:1787826303.601166:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826303.601169:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 2/0,0 mode: --/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.601179:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bb0c lrc: 0/0,0 mode: --/PW res: [0x200000403:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.601454:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84234:x1874668789843456:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 15770us (20682us total) trans 8590016668 rc 0/0 00000100:00100000:1.0:1787826303.601465:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111590 00000020:00080000:1.0:1787826303.601473:0:25759:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787826303.602172:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826303.602179:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826303.602334:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:2.0:1787826303.602345:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1787826303.602527:0:39161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778642560:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787826303.602606:0:39161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.607164:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.607235:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789844352 00000100:00100000:3.0:1787826303.607247:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789844352 00000100:00100000:1.0:1787826303.607270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.607326:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2715 00000100:00100000:3.0:1787826303.607337:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+54:84234:x1874668789844352:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.607365:0:39161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:39161:1874668778642560:192.168.203.9@tcp:107:hsm_cdtr.0 00000004:00080000:3.0:1787826303.607693:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x130:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826303.607739:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016669 00010000:00010000:3.0:1787826303.607781:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.607818:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.607833:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.607845:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.607879:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.607887:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.607911:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826303.608030:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84234:x1874668789844352:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 694us (882us total) trans 8590016670 rc 0/0 00000100:00100000:3.0:1787826303.608040:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2715 00000020:00080000:3.0:1787826303.608046:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826303.608075:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789844480 00000100:00100000:3.0:1787826303.608080:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789844480 00000100:00100000:3.0:1787826303.608115:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111591 00000100:00100000:3.0:1787826303.608122:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84237:x1874668789844480:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826303.608150:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826303.608229:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84237:x1874668789844480:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 107us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.608236:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111591 00010000:00010000:2.0:1787826303.608445:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826303.608454:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.608462:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826303.608467:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.608480:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.608497:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:2.0:1787826303.608500:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826303.608506:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 1/0,0 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.608513:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb2f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x130:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.608528:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.608531:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.608533:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826303.613376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.613422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.613512:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789844608 00000100:00100000:2.0:1787826303.613525:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789844608 00000100:00100000:2.0:1787826303.613601:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789844736 00000100:00100000:2.0:1787826303.613604:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789844736 00000100:00100000:2.0:1787826303.613643:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111592 00000100:00100000:2.0:1787826303.613656:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84238:x1874668789844608:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826303.613700:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xff:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826303.613715:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111593 00000100:00100000:0.0:1787826303.613728:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84239:x1874668789844736:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826303.613747:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x100:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826303.614085:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84238:x1874668789844608:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 430us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.614094:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111592 00000100:00100000:0.0:1787826303.614252:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84239:x1874668789844736:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 527us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.614260:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111593 00000100:00100000:2.0:1787826303.623492:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.623555:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789844864 00000100:00100000:2.0:1787826303.623564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.623570:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789844864 00000100:00100000:2.0:1787826303.623594:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789844992 00000100:00100000:2.0:1787826303.623599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789844992 00000100:00100000:3.0:1787826303.623650:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111594 00000100:00100000:3.0:1787826303.623663:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84237:x1874668789844864:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.623768:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.623790:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.623805:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.623826:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.623835:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.623844:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.623904:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.623913:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.623920:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826303.623994:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfe:0x0]: returning size 158 00000004:00200000:3.0:1787826303.624000:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826303.624016:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624049:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624058:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624065:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624073:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624080:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.624086:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624097:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624113:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826303.624117:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.624123:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624130:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bb36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624145:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624151:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624157:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624163:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.624167:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624174:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624181:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x43d4017b (ffff9bbe08124000) 00010000:00010000:3.0:1787826303.624183:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.624186:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624196:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bb3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43d4017b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624215:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624222:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624228:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624233:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.624236:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624242:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624250:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfe:0x0].0x0 (ffff9bbe16cc5600) 00010000:00010000:3.0:1787826303.624252:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.624255:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624261:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bb44 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.624619:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84237:x1874668789844864:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 955us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.624631:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111594 00000100:00100000:3.0:1787826303.624664:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111595 00000100:00100000:3.0:1787826303.624676:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84238:x1874668789844992:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.624723:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624738:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624748:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624763:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624771:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624779:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624802:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624810:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624817:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826303.624847:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xff:0x0]: returning size 158 00000004:00200000:3.0:1787826303.624878:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826303.624888:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624900:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624906:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624912:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624918:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624923:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.624927:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624934:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624943:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826303.624946:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.624949:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624955:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bb4b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624966:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624972:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624978:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624983:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.624986:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624991:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.624998:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xa00c553a (ffff9bbe08124100) 00010000:00010000:3.0:1787826303.625000:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.625002:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.625008:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bb52 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa00c553a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.625021:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.625027:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.625032:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.625037:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.625229:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.625243:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.625254:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xff:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826303.625257:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.625261:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.625267:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bb59 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.625391:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84238:x1874668789844992:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 718us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.625410:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111595 00000100:00100000:1.0:1787826303.627704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.627772:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789845120 00000100:00100000:3.0:1787826303.627785:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789845120 00000100:00100000:3.0:1787826303.628199:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111596 00000100:00100000:3.0:1787826303.628215:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84239:x1874668789845120:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.628384:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628418:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628433:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628451:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628465:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628471:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628505:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x100:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628514:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628521:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826303.628579:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x100:0x0]: returning size 158 00000004:00200000:3.0:1787826303.628585:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826303.628601:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628613:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628621:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628628:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628636:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.628641:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628650:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628664:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826303.628667:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.628673:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628680:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bb60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628694:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628699:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628704:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628709:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.628711:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628717:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628723:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc0cb6ca (ffff9bbe08124d00) 00010000:00010000:3.0:1787826303.628725:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.628728:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628737:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bb67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc0cb6ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628752:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628758:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628777:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628781:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.628784:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628790:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628797:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x100:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:3.0:1787826303.628799:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.628802:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 2/0,0 mode: --/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.628807:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb6e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.629793:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84239:x1874668789845120:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1573us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.629810:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111596 00000100:00100000:3.0:1787826303.631100:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.631174:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.631727:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789845632 00000100:00100000:2.0:1787826303.631740:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789845632 00000100:00100000:2.0:1787826303.631813:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789845376 00000100:00100000:2.0:1787826303.631816:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789845376 00000100:00100000:2.0:1787826303.631844:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111597 00000100:00100000:2.0:1787826303.631889:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84237:x1874668789845632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.632036:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.632067:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bb75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0f9 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632208:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632226:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632244:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826303.632258:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xfe:0x0]: returning size 158 00010000:00010000:2.0:1787826303.632370:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632379:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632386:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632404:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.632409:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632418:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632433:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfe:0x0].0x0 (ffff9bbe16cc5600) 00010000:00010000:2.0:1787826303.632437:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826303.632443:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 2/0,0 mode: --/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632449:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bb7c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xfe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632496:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bb75 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0f9 expref: 58 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632513:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826303.632517:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826303.632521:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bb75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0f9 expref: 58 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632531:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826303.632608:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84237:x1874668789845632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 722us (1515us total) trans 8590016671 rc 301/301 00000100:00100000:2.0:1787826303.632618:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111597 00000100:00100000:2.0:1787826303.632648:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111598 00000100:00100000:2.0:1787826303.632656:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+56:84238:x1874668789845376:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.632667:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.632676:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bb8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc0f2 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632751:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632761:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632768:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826303.632778:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xff:0x0]: returning size 158 00010000:00010000:2.0:1787826303.632899:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632983:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632990:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.632996:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.632999:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.633006:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xff:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.633016:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xff:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826303.633018:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826303.633022:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xff:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.633028:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bb91 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xff:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.633054:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bb8a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0f2 expref: 58 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.633064:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826303.633066:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826303.633070:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bb8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc0f2 expref: 58 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.633079:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:2.0:1787826303.633107:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+57:84238:x1874668789845376:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 451us (1932us total) trans 8590016672 rc 301/301 00000100:00100000:2.0:1787826303.633114:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111598 00000100:00100000:2.0:1787826303.645130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.645284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.649047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.653051:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789845888 00000100:00100000:3.0:1787826303.653070:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789845888 00000100:00100000:3.0:1787826303.653152:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789846016 00000100:00100000:3.0:1787826303.653156:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789846016 00000100:00100000:3.0:1787826303.653186:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111599 00000100:00100000:3.0:1787826303.653196:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84239:x1874668789845888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.653223:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.653249:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc100 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653388:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x100:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653417:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653432:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826303.653444:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x100:0x0]: returning size 158 00010000:00010000:3.0:1787826303.653537:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653545:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653553:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653560:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.653566:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653574:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x100:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653588:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x100:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:3.0:1787826303.653592:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826303.653597:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x100:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653604:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bba6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x100:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653650:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb9f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc100 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653662:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826303.653665:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826303.653669:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bb9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc100 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.653680:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00000100:00100000:3.0:1787826303.653764:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84239:x1874668789845888:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 569us (9087us total) trans 8590016673 rc 301/301 00000100:00100000:3.0:1787826303.653771:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111599 00000100:00100000:3.0:1787826303.653798:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111600 00000100:00100000:3.0:1787826303.653806:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84238:x1874668789846016:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826303.653834:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xff:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826303.654222:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84238:x1874668789846016:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 414us (8935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.654231:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111600 00000100:00100000:3.0:1787826303.658270:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789846144 00000100:00100000:2.0:1787826303.658276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.658297:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789846144 00000100:00100000:3.0:1787826303.658363:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789846272 00000100:00100000:3.0:1787826303.658366:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789846272 00000100:00100000:3.0:1787826303.658389:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111601 00000100:00100000:3.0:1787826303.658452:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84237:x1874668789846144:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826303.658506:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0xfe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826303.658651:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84237:x1874668789846144:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 203us (9615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.659025:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111602 00000100:00100000:2.0:1787826303.659168:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84239:x1874668789846272:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826303.659193:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x100:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826303.659258:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+59:84239:x1874668789846272:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 224us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.659266:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111602 00000100:00100000:3.0:1787826303.659596:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111601 00000100:00100000:3.0:1787826303.662278:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.662389:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789846528 00000100:00100000:2.0:1787826303.662409:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789846528 00000100:00100000:2.0:1787826303.662479:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111603 00000100:00100000:2.0:1787826303.662490:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+58:84238:x1874668789846528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.662514:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.662537:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbb4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc107 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.663192:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bbbb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.663210:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bbbb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.663229:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bbbb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826303.663242:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x131:0x0]: returning size 0 00010000:00010000:2.0:1787826303.663304:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbb4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc107 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.663322:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bbbb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc107 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.663332:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826303.663335:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826303.663339:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:2.0:1787826303.663448:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84238:x1874668789846528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 959us (1182us total) trans 8590016674 rc 0/0 00000100:00100000:2.0:1787826303.663458:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111603 00000100:00100000:0.0:1787826303.667548:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.667937:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789846784 00000100:00100000:3.0:1787826303.667951:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789846784 00000100:00100000:3.0:1787826303.668054:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111604 00000100:00100000:3.0:1787826303.668067:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:84239:x1874668789846784:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.668101:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.668128:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bbc9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc10e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.668837:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bbd0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.668888:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.668908:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826303.668920:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x132:0x0]: returning size 0 00010000:00010000:3.0:1787826303.668986:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bbc9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc10e expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.669004:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc10e expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.669013:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe08124d00) 00010000:00010000:3.0:1787826303.669017:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826303.669021:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826303.669107:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84239:x1874668789846784:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1042us (1571us total) trans 8590016675 rc 0/0 00000100:00100000:3.0:1787826303.669116:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111604 00000100:00100000:3.0:1787826303.672610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.672784:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789847040 00000100:00100000:0.0:1787826303.672798:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789847040 00000100:00100000:0.0:1787826303.673135:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111605 00000100:00100000:0.0:1787826303.673149:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84237:x1874668789847040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.673180:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826303.673210:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bbde lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc115 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.673935:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bbe5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.673954:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.673974:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826303.673987:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x133:0x0]: returning size 0 00010000:00010000:0.0:1787826303.674047:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bbde lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc115 expref: 65 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.674068:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc115 expref: 64 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.674079:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbf0f565600) 00010000:00010000:0.0:1787826303.674083:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826303.674086:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:0.0:1787826303.674175:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84237:x1874668789847040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1029us (1579us total) trans 8590016676 rc 0/0 00000100:00100000:0.0:1787826303.674184:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111605 00000040:00080000:0.0:1787826303.680134:0:39210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787826303.680147:0:39210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826303.681107:0:39210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787826303.681124:0:39210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787826303.686510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.686634:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789847296 00000100:00100000:2.0:1787826303.686648:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789847296 00000100:00100000:2.0:1787826303.687097:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111606 00000100:00100000:2.0:1787826303.687110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84238:x1874668789847296:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.687189:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.687225:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bbbb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc107 expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687250:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826303.687261:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826303.687292:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687310:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687321:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687338:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687346:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687353:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687435:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687445:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687452:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687460:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687466:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.687472:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687485:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687494:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826303.687497:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826303.687502:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687509:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bbf3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687519:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687525:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687532:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687537:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.687540:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687546:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687553:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x5e09c590 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826303.687555:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826303.687559:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.687569:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349bbfa lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x5e09c590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.687688:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84238:x1874668789847296:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 580us (1193us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826303.687706:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111606 00000100:00100000:1.0:1787826303.693023:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.693172:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789847680 00000100:00100000:3.0:1787826303.693184:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789847680 00000100:00100000:3.0:1787826303.693310:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111607 00000100:00100000:3.0:1787826303.693324:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84239:x1874668789847680:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.693422:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.693461:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bbd0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc10e expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693485:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe08124d00) 00010000:00010000:3.0:1787826303.693498:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826303.693542:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693559:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693572:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693587:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693593:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693599:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693665:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693673:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693680:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693686:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.693692:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693706:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693716:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826303.693719:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.693725:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693732:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc01 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693741:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693746:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693752:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693757:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.693760:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693766:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693773:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x35aa7197 (ffff9bbe08124100) 00010000:00010000:3.0:1787826303.693775:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.693778:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.693784:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc08 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0x35aa7197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.695390:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84239:x1874668789847680:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 2054us (2365us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826303.695415:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111607 00000100:00100000:0.0:1787826303.695687:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.696551:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789847424 00000100:00100000:3.0:1787826303.696566:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789847424 00000100:00100000:3.0:1787826303.696676:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111608 00000100:00100000:3.0:1787826303.696688:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+62:84238:x1874668789847424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.696725:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.696756:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bc0f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc11c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.696806:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.696821:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.696833:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.697013:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bc0f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc11c expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.697036:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc11c expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.697046:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:3.0:1787826303.697050:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826303.697054:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826303.697841:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84238:x1874668789847424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1150us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.698041:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111608 00000100:00100000:0.0:1787826303.699430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.699470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.699542:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789847808 00000100:00100000:1.0:1787826303.699552:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789847808 00000100:00100000:1.0:1787826303.699614:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789848064 00000100:00100000:1.0:1787826303.699618:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789848064 00000100:00100000:1.0:1787826303.699640:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111609 00000100:00100000:1.0:1787826303.699650:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84239:x1874668789847808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.699675:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.699715:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bc1d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc123 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.699763:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.699780:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.699798:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.700103:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bc1d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc123 expref: 66 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.700126:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc123 expref: 65 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.700136:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:1.0:1787826303.700139:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826303.700144:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7200, rc 0) 00000100:00100000:1.0:1787826303.700210:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84239:x1874668789847808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 561us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.700218:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111609 00000100:00100000:1.0:1787826303.700244:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111610 00000100:00100000:1.0:1787826303.700253:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+64:84237:x1874668789848064:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.700643:0:45683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.700668:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bbe5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x133:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc115 expref: 64 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.700682:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbf0f565600) 00010000:00010000:1.0:1787826303.701058:0:45683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826303.701089:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701109:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701120:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701137:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701144:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701151:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701213:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701221:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701228:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701235:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.701239:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701248:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701256:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826303.701260:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826303.701264:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701271:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bc2b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701370:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701377:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701383:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701389:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826303.701402:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701410:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701418:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xa794b1e5 (ffff9bbe12458000) 00010000:00010000:1.0:1787826303.701420:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826303.701423:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.701428:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc32 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x18:0x0].0xa794b1e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.701568:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+63:84237:x1874668789848064:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1313us (2094us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826303.701577:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111610 00000100:00100000:0.0:1787826303.705155:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.705294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.705568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.705631:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789848320 00000100:00100000:1.0:1787826303.705644:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789848320 00000100:00100000:1.0:1787826303.705877:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789848448 00000100:00100000:1.0:1787826303.705881:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789848448 00000100:00100000:2.0:1787826303.706140:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789848704 00000100:00100000:2.0:1787826303.706145:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789848704 00000100:00100000:2.0:1787826303.706179:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111611 00000100:00100000:2.0:1787826303.706191:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+65:84239:x1874668789848320:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.706310:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.706333:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.706347:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826303.706550:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009218575f reply state 00000000d77c0b9c transno 8590016677 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.706565:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.706574:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:2.0:1787826303.706577:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826303.706581:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826303.706703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84239:x1874668789848320:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 513us (1563us total) trans 8590016677 rc 0/0 00000100:00100000:2.0:1787826303.706712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111611 00000100:00100000:2.0:1787826303.706738:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111612 00000100:00100000:2.0:1787826303.706746:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84237:x1874668789848448:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.706758:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.706775:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc40 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc12a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.706804:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.706813:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.706820:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.707006:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc40 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc12a expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.707029:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc12a expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.707038:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826303.707042:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826303.707045:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:2.0:1787826303.707077:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+67:84237:x1874668789848448:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 332us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.707088:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111612 00000100:00100000:2.0:1787826303.707106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111613 00000100:00100000:2.0:1787826303.707113:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:84238:x1874668789848704:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.707152:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.707163:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.707171:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826303.707248:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a381fbd8 reply state 0000000044ee368b transno 8590016678 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.707258:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.707265:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:2.0:1787826303.707267:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826303.707270:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826303.707310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+68:84238:x1874668789848704:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 197us (1741us total) trans 8590016678 rc 0/0 00000100:00100000:2.0:1787826303.707317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111613 00000100:00100000:0.0:1787826303.721423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.721554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.721806:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789849216 00000100:00100000:1.0:1787826303.721819:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789849216 00000100:00100000:1.0:1787826303.721949:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789848960 00000100:00100000:1.0:1787826303.721953:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789848960 00000100:00100000:1.0:1787826303.721980:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111614 00000100:00100000:1.0:1787826303.721992:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+69:84238:x1874668789849216:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.722028:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.722056:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc138 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.722143:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc138 expref: 70 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.722162:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc138 expref: 70 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.722175:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:1.0:1787826303.722179:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.722184:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826303.722258:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84238:x1874668789849216:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 268us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.722266:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111614 00000100:00100000:2.0:1787826303.722450:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111615 00000100:00100000:2.0:1787826303.722463:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+70:84237:x1874668789848960:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.722552:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.722565:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.722575:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826303.722763:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0539105 reply state 00000000e739d93a transno 8590016679 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.722778:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.722786:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826303.722788:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787826303.722792:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826303.722914:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84237:x1874668789848960:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 456us (1359us total) trans 8590016679 rc 0/0 00000100:00100000:2.0:1787826303.722921:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111615 00000100:00100000:0.0:1787826303.732557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.732669:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789849088 00000100:00100000:2.0:1787826303.732683:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789849088 00000100:00100000:2.0:1787826303.732757:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111616 00000100:00100000:2.0:1787826303.732770:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+71:84239:x1874668789849088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.732801:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.732832:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc131 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.732954:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc131 expref: 72 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.732979:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc131 expref: 72 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.732989:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:2.0:1787826303.732992:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.732997:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:2.0:1787826303.733075:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84239:x1874668789849088:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 308us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.733083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111616 00000100:00100000:1.0:1787826303.741566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.741750:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789849344 00000100:00100000:3.0:1787826303.741766:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789849344 00000100:00100000:3.0:1787826303.741921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2716 00000100:00100000:3.0:1787826303.741934:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84238:x1874668789849344:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.742415:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84238:x1874668789849344:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 481us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.742425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2716 00000100:00100000:1.0:1787826303.743895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.744227:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789849472 00000100:00100000:3.0:1787826303.744238:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789849472 00000100:00100000:3.0:1787826303.744310:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2717 00000100:00100000:3.0:1787826303.744321:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84239:x1874668789849472:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.744485:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84239:x1874668789849472:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 166us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.744494:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2717 00000100:00100000:0.0:1787826303.744536:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.744672:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789849600 00000100:00100000:2.0:1787826303.744678:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789849600 00000100:00100000:2.0:1787826303.744810:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111617 00000100:00100000:2.0:1787826303.744819:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+72:84237:x1874668789849600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.744832:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.744883:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc13f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.744944:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc13f expref: 73 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.744962:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc13f expref: 73 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.744978:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826303.744982:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.744988:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826303.745020:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84237:x1874668789849600:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 203us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.745025:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111617 00000100:00100000:3.0:1787826303.747321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.747482:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789849856 00000100:00100000:1.0:1787826303.747492:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789849856 00000100:00100000:1.0:1787826303.747562:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2718 00000100:00100000:1.0:1787826303.747574:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+73:84238:x1874668789849856:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.748346:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84238:x1874668789849856:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 768us (1030us total) trans 8590016680 rc 0/0 00000100:00100000:1.0:1787826303.748358:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2718 00000100:00100000:3.0:1787826303.749155:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.749633:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789850112 00000100:00100000:2.0:1787826303.749644:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789850112 00000100:00100000:2.0:1787826303.749718:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2719 00000100:00100000:2.0:1787826303.749729:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:84239:x1874668789850112:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.750210:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84239:x1874668789850112:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 482us (1058us total) trans 8590016681 rc 0/0 00000100:00100000:2.0:1787826303.750219:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2719 00000100:00100000:3.0:1787826303.751071:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.751156:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789850240 00000100:00100000:1.0:1787826303.751163:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789850240 00000100:00100000:1.0:1787826303.751215:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2720 00000100:00100000:1.0:1787826303.751225:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84237:x1874668789850240:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.751358:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84237:x1874668789850240:12345-192.168.203.9@tcp:49:lhsmtool_posix.0 Request processed in 134us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.751366:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2720 00000100:00100000:3.0:1787826303.760990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.761052:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.761481:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789850624 00000100:00100000:0.0:1787826303.761495:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789850624 00000100:00100000:0.0:1787826303.761565:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789850752 00000100:00100000:0.0:1787826303.761568:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789850752 00000100:00100000:0.0:1787826303.761618:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111618 00000100:00100000:0.0:1787826303.761631:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84238:x1874668789850624:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.761642:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111619 00000100:00100000:3.0:1787826303.761656:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84239:x1874668789850752:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.761808:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84239:x1874668789850752:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 156us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.761821:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111619 00000100:00100000:3.0:1787826303.761905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.762004:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789851008 00000100:00100000:3.0:1787826303.762009:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789851008 00000100:00100000:0.0:1787826303.762029:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84238:x1874668789850624:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 400us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.762037:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111618 00000100:00100000:3.0:1787826303.762044:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2721 00000100:00100000:3.0:1787826303.762053:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:84237:x1874668789851008:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826303.762271:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84237:x1874668789851008:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 219us (366us total) trans 8590016682 rc 0/0 00000100:00100000:3.0:1787826303.762282:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2721 00000100:00100000:3.0:1787826303.766225:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.766461:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789851264 00000100:00100000:2.0:1787826303.766474:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789851264 00000100:00100000:2.0:1787826303.766560:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111620 00000100:00100000:2.0:1787826303.766572:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84237:x1874668789851264:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.766727:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84237:x1874668789851264:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 156us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.766736:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111620 00000100:00100000:2.0:1787826303.768095:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.768175:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789851520 00000100:00100000:3.0:1787826303.768183:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789851520 00000100:00100000:3.0:1787826303.768239:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111621 00000100:00100000:3.0:1787826303.768251:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84238:x1874668789851520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.768271:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.768298:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc71 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc146 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.768475:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.768495:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc138 expref: 77 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.768505:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.768551:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc138 expref: 77 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.768568:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc138 expref: 77 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.768583:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778642688:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.768705:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826303.781407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.781744:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789851776 00000100:00100000:0.0:1787826303.781757:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789851776 00000100:00100000:0.0:1787826303.781843:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111622 00000100:00100000:0.0:1787826303.781893:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84237:x1874668789851776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.781923:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826303.781951:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349bc7f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc14d expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.782059:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778642688:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826303.782102:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.782111:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.782132:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc13f expref: 79 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.782143:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.782185:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc13f expref: 79 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.782200:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc13f expref: 79 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.782216:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778642816:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826303.782326:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826303.785714:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.785809:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789852032 00000100:00100000:3.0:1787826303.785821:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789852032 00000100:00100000:3.0:1787826303.785921:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111623 00000100:00100000:3.0:1787826303.785932:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84239:x1874668789852032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.785966:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.785994:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bc8d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc154 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.786144:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.786162:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc131 expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.786172:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.786212:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc131 expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.786237:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc131 expref: 81 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.786254:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778642944:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.786377:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826303.787541:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778642816:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826303.787572:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.790081:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.790128:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.790423:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778642944:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.790460:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.790812:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789852288 00000100:00100000:2.0:1787826303.790821:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789852288 00010000:00010000:2.0:1787826303.790907:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc13f expref: 82 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.790952:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789852160 00000100:00100000:2.0:1787826303.790955:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789852160 00010000:00010000:2.0:1787826303.790969:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc138 expref: 83 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.790992:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3091 00000100:00100000:2.0:1787826303.791001:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+83:2401:x1874668789852288:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.791021:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.791028:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc13f expref: 83 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791039:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc13f expref: 83 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791068:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bc6a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc13f expref: 83 pid: 6515 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791088:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826303.791093:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791104:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791113:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791138:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826303.791203:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:2401:x1874668789852288:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 202us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.791211:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3091 00000100:00100000:2.0:1787826303.791232:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3092 00000100:00100000:2.0:1787826303.791238:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:2401:x1874668789852160:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.791246:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.791252:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc138 expref: 81 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791261:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc138 expref: 81 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791275:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bc55 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc138 expref: 81 pid: 25756 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791286:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:2.0:1787826303.791292:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791301:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791301:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791316:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791320:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791342:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1787826303.791349:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x133:0x0]: returning size 0 00000100:00100000:2.0:1787826303.791363:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:2401:x1874668789852160:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 125us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.791371:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3092 00010000:00010000:2.0:1787826303.791390:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.791410:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826303.791425:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x131:0x0]: returning size 0 00000004:00080000:0.0:1787826303.791586:0:7736:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc8:0x0], index 0: 0 00000004:00080000:2.0:1787826303.791587:0:25759:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc8:0x0], index 1: 0 00010000:00010000:0.0:1787826303.791733:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791743:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791751:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791760:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.791767:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791776:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791786:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:0.0:1787826303.791790:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826303.791794:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791801:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bc86 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791913:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349bc7f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc14d expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791924:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826303.791928:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826303.791932:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349bc7f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc14d expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.791942:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:0.0:1787826303.791976:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84237:x1874668789851776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 10124us (10596us total) trans 8590016683 rc 301/301 00000100:00100000:0.0:1787826303.791986:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111622 00010000:00010000:2.0:1787826303.793270:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.793289:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.793296:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.793302:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.793306:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.793314:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.793332:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:2.0:1787826303.793335:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826303.793343:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.793350:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349bc78 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.793425:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc71 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc146 expref: 79 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.793436:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826303.793438:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826303.793441:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349bc71 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc146 expref: 79 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.793450:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00000100:00100000:2.0:1787826303.793522:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84238:x1874668789851520:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 25274us (25435us total) trans 8590016684 rc 301/301 00000100:00100000:2.0:1787826303.793531:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111621 00000100:00100000:1.0:1787826303.793616:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.795902:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789852416 00000100:00100000:2.0:1787826303.795923:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789852416 00010000:00010000:2.0:1787826303.795992:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc131 expref: 78 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.796047:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3093 00000100:00100000:2.0:1787826303.796058:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:2401:x1874668789852416:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.796081:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.796089:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc131 expref: 78 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.796111:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc131 expref: 78 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.796137:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bc63 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc131 expref: 78 pid: 6516 timeout: 3041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.796155:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:2.0:1787826303.796162:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.796174:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.796183:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.796219:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826303.796297:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:2401:x1874668789852416:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 240us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.796306:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3093 00010000:00010000:3.0:1787826303.798153:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798175:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826303.798204:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x132:0x0]: returning size 0 00000004:00080000:3.0:1787826303.798432:0:12105:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc9:0x0], index 1: 0 00010000:00010000:3.0:1787826303.798581:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798592:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798599:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798605:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.798611:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798620:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798638:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:3.0:1787826303.798642:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826303.798648:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798655:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bc94 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798742:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bc8d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc154 expref: 77 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798755:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826303.798758:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826303.798762:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bc8d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc154 expref: 77 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.798773:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607a00, rc 0) 00000100:00100000:3.0:1787826303.798884:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84239:x1874668789852032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 12952us (13197us total) trans 8590016685 rc 301/301 00000100:00100000:3.0:1787826303.798894:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111623 00000100:00100000:1.0:1787826303.799337:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.799409:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789852672 00000100:00100000:2.0:1787826303.799420:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789852672 00000100:00100000:2.0:1787826303.799479:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2722 00000100:00100000:2.0:1787826303.799490:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:84238:x1874668789852672:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.799514:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.799539:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789852928 00000100:00100000:1.0:1787826303.799543:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789852928 00000100:00100000:1.0:1787826303.799568:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2723 00000100:00100000:1.0:1787826303.799575:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+77:84237:x1874668789852928:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.799847:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84238:x1874668789852672:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 359us (512us total) trans 8590016686 rc 0/0 00000100:00100000:2.0:1787826303.799878:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2722 00000100:00100000:1.0:1787826303.800115:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84237:x1874668789852928:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 539us (601us total) trans 8590016687 rc 0/0 00000100:00100000:1.0:1787826303.800124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2723 00000100:00100000:2.0:1787826303.811197:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778643072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826303.811370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826303.811426:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778643072 00000100:00100000:3.0:1787826303.811437:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778643072 00000100:00100000:3.0:1787826303.811507:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360 00000100:00100000:0.0:1787826303.811513:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778643200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826303.811522:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778643072:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826303.811556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1787826303.811571:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1787826303.811594:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778643200 00000100:00100000:2.0:1787826303.811597:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778643200 00000100:00100000:3.0:1787826303.811638:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778643072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.811646:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360 00000100:00100000:0.0:1787826303.811664:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778643072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826303.811896:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361 00000100:00100000:1.0:1787826303.811898:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.811912:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778643200:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826303.811939:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000004:00000024:2.0:1787826303.811939:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:1.0:1787826303.811982:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.811996:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778643200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.812004:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361 00000100:00100000:2.0:1787826303.813603:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778643200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826303.813659:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789853440 00000100:00100000:2.0:1787826303.813667:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789853440 00000100:00100000:2.0:1787826303.813893:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2724 00000100:00100000:2.0:1787826303.813904:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:84239:x1874668789853440:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.814337:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+79:84239:x1874668789853440:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 433us (2353us total) trans 8590016688 rc 0/0 00000100:00100000:2.0:1787826303.814346:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2724 00000100:00100000:2.0:1787826303.814386:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789853056 00000100:00100000:2.0:1787826303.814402:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789853056 00000100:00100000:2.0:1787826303.814435:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789853184 00000100:00100000:2.0:1787826303.814439:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789853184 00000100:00100000:2.0:1787826303.814460:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111624 00000100:00100000:2.0:1787826303.814466:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+80:84237:x1874668789853056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.814480:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.814508:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bcb0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc15b expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.814576:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bcb7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.814592:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.814607:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826303.814639:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x133:0x0]: returning size 0 00000004:00200000:2.0:1787826303.814645:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826303.814661:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.814691:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349bcb0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc15b expref: 82 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.814723:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc15b expref: 81 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.814731:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111625 00010000:00010000:2.0:1787826303.814737:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:2.0:1787826303.814742:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00000100:00100000:0.0:1787826303.814746:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84238:x1874668789853184:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.814753:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00010000:00010000:0.0:1787826303.814757:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826303.814772:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349bcbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc162 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.814784:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84237:x1874668789853056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 317us (2891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.814802:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111624 00010000:00010000:0.0:1787826303.814812:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bcc5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.814826:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.814835:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826303.814888:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x131:0x0]: returning size 0 00000004:00200000:0.0:1787826303.814892:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826303.814902:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.814922:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349bcbe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc162 expref: 82 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.814937:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bcc5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc162 expref: 81 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.814946:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:0.0:1787826303.814951:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826303.814954:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc 0) 00000100:00100000:0.0:1787826303.814981:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84238:x1874668789853184:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 240us (3043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.814988:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111625 00000100:00100000:0.0:1787826303.819296:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.819341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.819352:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789853824 00000100:00100000:2.0:1787826303.819365:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789853824 00000100:00100000:2.0:1787826303.819450:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6315 00000100:00100000:2.0:1787826303.819462:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789853824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.819469:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789853696 00000100:00100000:1.0:1787826303.819475:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789853696 00010000:00010000:2.0:1787826303.819486:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.819517:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc177 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.819522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111626 00000100:00100000:1.0:1787826303.819533:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+81:84239:x1874668789853696:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.819549:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1787826303.819553:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826303.819567:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bcd3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc170 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.819581:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=2941s v=(0 0) 00010000:00010000:2.0:1787826303.819588:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.819600:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc177 expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.819621:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc177 expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.819637:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00010000:00010000:1.0:1787826303.819641:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bcda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.819657:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bcda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.819669:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bcda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826303.819729:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x132:0x0]: returning size 0 00000004:00200000:1.0:1787826303.819734:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826303.819754:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bcda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.819782:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bcd3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc170 expref: 83 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.819809:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bcda lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc170 expref: 82 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.819817:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:1.0:1787826303.819821:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826303.819824:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:2.0:1787826303.819842:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789853824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 381us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.819880:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84239:x1874668789853696:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 319us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.819888:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6315 00000100:00100000:1.0:1787826303.819893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111626 00000100:00100000:2.0:1787826303.821042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.822664:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789853568 00000100:00100000:3.0:1787826303.822684:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789853568 00000100:00100000:3.0:1787826303.822781:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6316 00000100:00100000:3.0:1787826303.822975:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789853568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.822997:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.823022:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc169 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826303.823054:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826303.823079:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=2941s v=(0 0) 00010000:00010000:3.0:1787826303.823083:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.823093:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc169 expref: 13 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.823112:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc169 expref: 13 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.823127:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607a00, rc 0) 00000100:00100000:3.0:1787826303.823206:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789853568:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 237us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.823214:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6316 00000100:00100000:1.0:1787826303.825453:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.825544:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789853952 00000100:00100000:2.0:1787826303.825555:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789853952 00000100:00100000:2.0:1787826303.825621:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6317 00000100:00100000:2.0:1787826303.825631:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2400:x1874668789853952:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.825652:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.825680:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc17e expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826303.825723:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826303.825750:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=2941s v=(0 0) 00010000:00010000:2.0:1787826303.825754:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.825764:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc17e expref: 11 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.825794:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc17e expref: 11 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.825809:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:2.0:1787826303.825901:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789853952:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 272us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.825909:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6317 00000100:00100000:0.0:1787826303.827686:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.827825:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789854208 00000100:00100000:2.0:1787826303.827836:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789854208 00000100:00100000:2.0:1787826303.827962:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111627 00000100:00100000:2.0:1787826303.827976:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84237:x1874668789854208:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.828094:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84237:x1874668789854208:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 122us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.828102:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111627 00000100:00100000:1.0:1787826303.832981:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.833097:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789854464 00000100:00100000:2.0:1787826303.833110:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789854464 00000100:00100000:2.0:1787826303.833196:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111628 00000100:00100000:2.0:1787826303.833207:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84238:x1874668789854464:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.833353:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84238:x1874668789854464:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 148us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.833361:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111628 00000100:00100000:1.0:1787826303.835183:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.835220:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.835307:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789854848 00000100:00100000:3.0:1787826303.835320:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789854848 00000100:00100000:3.0:1787826303.835386:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6318 00000100:00100000:3.0:1787826303.835407:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84237:x1874668789854848:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.835427:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.835451:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc185 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.835491:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc169 expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.835501:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.835507:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826303.835513:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.835551:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc169 expref: 14 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.835566:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc169 expref: 14 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.835583:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778643328:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.835682:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.835781:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789854720 00000100:00100000:2.0:1787826303.835786:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789854720 00000100:00100000:2.0:1787826303.835828:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111629 00000100:00100000:2.0:1787826303.835836:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84239:x1874668789854720:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.835943:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+82:84239:x1874668789854720:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 106us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.835951:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111629 00000100:00100000:1.0:1787826303.840150:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.840366:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789854976 00000100:00100000:2.0:1787826303.840380:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789854976 00000100:00100000:2.0:1787826303.840496:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6319 00000100:00100000:2.0:1787826303.840507:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:84238:x1874668789854976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.840528:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826303.840552:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc18c expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.840597:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc177 expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.840607:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.840612:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.840619:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 12 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.840669:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc177 expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.840685:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc177 expref: 12 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.840713:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778643456:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826303.840834:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.842520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.842570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.842716:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789855104 00000100:00100000:0.0:1787826303.842726:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789855104 00000100:00100000:0.0:1787826303.842798:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6320 00000100:00100000:0.0:1787826303.842810:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84239:x1874668789855104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.842830:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826303.842873:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc193 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.842913:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc17e expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.842923:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826303.842928:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826303.842933:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.842972:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc17e expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.842990:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc17e expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.843005:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778643584:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826303.843085:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.843835:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789855232 00000100:00100000:2.0:1787826303.843844:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789855232 00010000:00010000:2.0:1787826303.843917:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc169 expref: 15 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.843951:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3094 00000100:00100000:2.0:1787826303.843960:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789855232:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.843971:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.843997:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc169 expref: 15 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.844013:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc169 expref: 15 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.844039:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.844042:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.844054:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.844065:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.844104:0:45686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.844117:0:45686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:45686:1874668778643712:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826303.844185:0:45686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e300 going to sleep for 11 seconds 00010000:00010000:3.0:1787826303.845447:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8b4beb8/0x68019081f349bce1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc169 expref: 15 pid: 8432 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.845473:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778643328:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.847350:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.847373:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:2.0:1787826303.847700:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84237:x1874668789854848:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 12285us (12468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.847714:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6318 00000100:00100000:1.0:1787826303.848187:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.848842:0:45686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:45686:1874668778643712:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826303.848888:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826303.848935:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789855232:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4975us (6363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.848947:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3094 00000100:00100000:2.0:1787826303.849010:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789855360 00000100:00100000:2.0:1787826303.849017:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789855360 00010000:00010000:2.0:1787826303.849052:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc177 expref: 15 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.849088:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3095 00000100:00100000:2.0:1787826303.849097:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789855360:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.849114:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.849143:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc177 expref: 15 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.849158:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc177 expref: 15 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.849191:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.849196:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826303.849208:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 15 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.849220:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 15 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.849271:0:45686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 15 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.849296:0:45686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778643840:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826303.849355:0:45686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e480 going to sleep for 11 seconds 00010000:00010000:2.0:1787826303.849402:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d53974da/0x68019081f349bccc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc177 expref: 15 pid: 45681 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.849417:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778643456:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826303.849438:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 14 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.849449:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826303.849472:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+14:84238:x1874668789854976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 8968us (9337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.849481:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6319 00000100:00100000:1.0:1787826303.849728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.850493:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789855488 00000100:00100000:0.0:1787826303.850503:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789855488 00010000:00010000:0.0:1787826303.850541:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc17e expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.850583:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3096 00000100:00100000:0.0:1787826303.850592:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789855488:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.850606:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.850627:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc17e expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.850640:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc17e expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.850662:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826303.850666:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826303.850674:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.850689:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.850733:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 14 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.850747:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778643968:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826303.850991:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787826303.851030:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349bce8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc17e expref: 14 pid: 8605 timeout: 3041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.851044:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778643584:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826303.851067:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.851078:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:0.0:1787826303.851107:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:84239:x1874668789855104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 8299us (8596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.851115:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6320 00000100:00100000:2.0:1787826303.854383:0:45686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778643840:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826303.854427:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826303.854497:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789855360:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5400us (6311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.854510:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3095 00000100:00100000:3.0:1787826303.858976:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.859190:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778643968:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826303.859223:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.859323:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789855488:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 8730us (9593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.859336:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3096 00000100:00100000:0.0:1787826303.860312:0:45404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789855616 00000100:00100000:0.0:1787826303.860325:0:45404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789855616 00002000:00100000:0.0:1787826303.860388:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xc8:0x0] (0->157) req@ffff9bbe17f1e580 x1874668789855616/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/0 e 0 to 0 dl 1787826314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826303.860420:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe17f1e580 with x1874668789855616 ext(0->157) 00002000:00010000:0.0:1787826303.860425:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe17f1e580 00000100:00100000:0.0:1787826303.860464:0:45404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1585 00000100:00100000:0.0:1787826303.860475:0:45404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789855616:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787826303.861587:0:45404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789855616:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1105us (2617us total) trans 4294968198 rc 0/0 00000100:00100000:0.0:1787826303.861599:0:45404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1585 00002000:00100000:0.0:1787826303.861611:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xc8:0x0] (0->157) req@ffff9bbe17f1e580 x1874668789855616/t4294968198(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/448 e 0 to 0 dl 1787826314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826303.861622:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe17f1e580 with x1874668789855616 ext(0->157) 00002000:00010000:0.0:1787826303.861628:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe17f1e580 00000100:00100000:3.0:1787826303.863915:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.863962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.864058:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789855744 00000100:00100000:1.0:1787826303.864070:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789855744 00002000:00100000:1.0:1787826303.864133:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xc8:0x0] (0->157) req@ffff9bbe17f1ed00 x1874668789855744/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/0 e 0 to 0 dl 1787826314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826303.864146:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe17f1ed00 with x1874668789855744 ext(0->157) 00002000:00010000:1.0:1787826303.864152:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe17f1ed00 00000100:00100000:1.0:1787826303.864183:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789855872 00000100:00100000:1.0:1787826303.864187:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789855872 00002000:00100000:1.0:1787826303.864204:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->157) req@ffff9bbe17f1c3c0 x1874668789855872/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/0 e 0 to 0 dl 1787826314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826303.864212:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe17f1c3c0 with x1874668789855872 ext(0->157) 00002000:00010000:1.0:1787826303.864216:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe17f1c3c0 00000100:00100000:1.0:1787826303.864416:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1586 00000100:00100000:1.0:1787826303.864429:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789855744:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.865443:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789855744:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1008us (1532us total) trans 4294968180 rc 0/0 00000100:00100000:1.0:1787826303.865455:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1586 00002000:00100000:1.0:1787826303.865465:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xc8:0x0] (0->157) req@ffff9bbe17f1ed00 x1874668789855744/t4294968180(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/448 e 0 to 0 dl 1787826314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826303.865474:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe17f1ed00 with x1874668789855744 ext(0->157) 00002000:00010000:1.0:1787826303.865480:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe17f1ed00 00000100:00100000:1.0:1787826303.865507:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1587 00000100:00100000:1.0:1787826303.865516:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789855872:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.867450:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789855872:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1921us (3472us total) trans 4294968181 rc 0/0 00000100:00100000:1.0:1787826303.867469:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1587 00002000:00100000:1.0:1787826303.867487:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->157) req@ffff9bbe17f1c3c0 x1874668789855872/t4294968181(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:659/0 lens 648/448 e 0 to 0 dl 1787826314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826303.867498:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe17f1c3c0 with x1874668789855872 ext(0->157) 00002000:00010000:1.0:1787826303.867506:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe17f1c3c0 00000100:00100000:1.0:1787826303.871382:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.871443:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.871483:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.872068:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789856000 00000100:00100000:2.0:1787826303.872082:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789856000 00000100:00100000:2.0:1787826303.872150:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789856128 00000100:00100000:2.0:1787826303.872153:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789856128 00000100:00100000:2.0:1787826303.872170:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789856256 00000100:00100000:2.0:1787826303.872173:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789856256 00000100:00100000:2.0:1787826303.872197:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111630 00000100:00100000:2.0:1787826303.872208:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+84:84237:x1874668789856000:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.872289:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111631 00000100:00100000:2.0:1787826303.872296:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+84:84238:x1874668789856128:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.872326:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111632 00000100:00100000:2.0:1787826303.872332:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+84:84239:x1874668789856256:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.872823:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787826303.875461:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016688 is committed 00000020:00080000:1.0:1787826303.875529:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe16cae780 refcount 2 committed 0 result 0 batchid 4294970900 00000020:00080000:1.0:1787826303.875537:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf06bcdb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16caed80 00000020:00080000:1.0:1787826303.875541:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d0fb800 00000020:00080000:1.0:1787826303.875581:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe16292840 refcount 2 committed 0 result 0 batchid 4294970899 00000020:00080000:1.0:1787826303.875585:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5e800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16292480 00000020:00080000:1.0:1787826303.875589:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3db5ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0dbb5800 00000020:00080000:1.0:1787826303.875601:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0fd09f00 refcount 2 committed 0 result 0 batchid 4294970898 00000020:00080000:1.0:1787826303.875604:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0fd09900 00000020:00080000:1.0:1787826303.875606:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf417c8800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe09c7a000 00000020:00080000:1.0:1787826303.875622:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970897 batchid updated 00000100:00100000:1.0:1787826303.875839:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84239:x1874668789856256:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 3500us (4349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.875882:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111632 00000020:00080000:2.0:1787826303.875961:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970900 committed batchid 4294970897 00000020:00080000:2.0:1787826303.876048:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970897 00010000:00010000:0.0:1787826303.876090:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876104:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876112:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876119:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3200 already unused, calling callback (ffffffffc181e4f0) 00000100:00100000:2.0:1787826303.876124:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84237:x1874668789856000:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 3918us (5038us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826303.876125:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.876132:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111630 00010000:00010000:0.0:1787826303.876134:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876159:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12e:0x0].0x0 (ffff9bbe0fe8c900) 00010000:00010000:0.0:1787826303.876162:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826303.876169:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876175:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3200/0x68019081f349ba8e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.876188:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84238:x1874668789856128:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 3892us (4745us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826303.876203:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.876204:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111631 00010000:00010000:0.0:1787826303.876210:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876215:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876221:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.876224:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876230:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876239:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12f:0x0].0x0 (ffff9bbe0fe8cb00) 00010000:00010000:0.0:1787826303.876242:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826303.876245:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876250:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ba9c lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876269:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876287:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876293:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876299:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.876301:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876307:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876314:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x130:0x0].0x0 (ffff9bbe0bd66a00) 00010000:00010000:0.0:1787826303.876317:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826303.876320:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876326:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349bab1 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x130:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876344:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876350:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876355:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876361:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.876363:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876369:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876376:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:0.0:1787826303.876378:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826303.876381:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876387:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bc39 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876406:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876412:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876418:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876423:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.876426:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876432:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876446:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:0.0:1787826303.876448:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826303.876452:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876458:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bc4e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876470:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876476:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876482:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876488:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.876491:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876496:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876504:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:0.0:1787826303.876506:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826303.876509:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.876515:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bc5c lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.888250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.888385:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789856384 00000100:00100000:0.0:1787826303.888407:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789856384 00000100:00100000:0.0:1787826303.888481:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6321 00000100:00100000:0.0:1787826303.888492:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789856384:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787826303.890941:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968181 is committed 00000001:00080000:0.0:1787826303.890967:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968179 is committed 00000100:00100000:3.0:1787826303.891178:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789856384:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2679us (2947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.891192:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6321 00000100:00100000:2.0:1787826303.893731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.893843:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789856512 00000100:00100000:0.0:1787826303.893901:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789856512 00000100:00100000:0.0:1787826303.893966:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6322 00000100:00100000:0.0:1787826303.893978:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2399:x1874668789856512:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787826303.895756:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968198 is committed 00000001:00080000:0.0:1787826303.895778:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968197 is committed 00000100:00100000:3.0:1787826303.896567:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2399:x1874668789856512:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2584us (2843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.896583:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6322 00000100:00100000:1.0:1787826303.899271:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.899565:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.899639:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789856896 00000100:00100000:3.0:1787826303.899653:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789856896 00000100:00100000:3.0:1787826303.899731:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111633 00000100:00100000:3.0:1787826303.899743:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+31:84239:x1874668789856896:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.899821:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.899907:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bcda lrc: 0/0,0 mode: --/PR res: [0x200000403:0x132:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc170 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.899931:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:3.0:1787826303.899937:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826303.900001:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.900022:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.900033:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826303.900184:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3c1e79e reply state 00000000b1502b9d transno 8590016689 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.900198:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.900205:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:3.0:1787826303.900208:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826303.900211:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826303.900345:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84239:x1874668789856896:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 603us (779us total) trans 8590016689 rc 0/0 00000100:00100000:3.0:1787826303.900354:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111633 00000100:00100000:0.0:1787826303.901462:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.901538:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789857152 00000100:00100000:3.0:1787826303.901546:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789857152 00000100:00100000:3.0:1787826303.901605:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111634 00000100:00100000:3.0:1787826303.901614:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+32:84237:x1874668789857152:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.901667:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.901780:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349bcb7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x133:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc15b expref: 32 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.901808:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826303.901813:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826303.901847:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.901906:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.901916:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826303.902038:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcc002c9 reply state 00000000f9e7ae75 transno 8590016690 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.902051:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.902058:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826303.902060:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826303.902063:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826303.902214:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84237:x1874668789857152:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 599us (756us total) trans 8590016690 rc 0/0 00000100:00100000:3.0:1787826303.902221:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111634 00000100:00100000:2.0:1787826303.902802:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789856640 00000100:00100000:2.0:1787826303.902811:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789856640 00000100:00100000:2.0:1787826303.902879:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6323 00000100:00100000:2.0:1787826303.902888:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789856640:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787826303.902964:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2399:x1874668789856640:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 77us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.902971:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6323 00000100:00100000:2.0:1787826303.904251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.904361:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789857280 00000100:00100000:0.0:1787826303.904370:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789857280 00000100:00100000:0.0:1787826303.904441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111635 00000100:00100000:0.0:1787826303.904450:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+33:84239:x1874668789857280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.904474:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826303.904500:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc19a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.904565:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc19a expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.904582:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc19a expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.904607:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:0.0:1787826303.904612:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826303.904616:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3a00, rc 0) 00000100:00100000:0.0:1787826303.905219:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+34:84239:x1874668789857280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 589us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.905228:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111635 00000100:00100000:1.0:1787826303.913019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.913102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.913200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.913331:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789857792 00000100:00100000:0.0:1787826303.913343:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789857792 00000100:00100000:0.0:1787826303.913426:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6324 00000100:00100000:0.0:1787826303.913438:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789857792:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787826303.913662:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787826303.913666:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb mtime from disk: 0 -> 1787826223 00002000:00010000:0.0:1787826303.913669:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb atime from disk: 0 -> 1787826223 00002000:00010000:0.0:1787826303.913671:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb ctime from disk: 0 -> 1787826223 00002000:00010000:0.0:1787826303.913673:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787826303.913753:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789857792:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 317us (552us total) trans 4294968182 rc 0/0 00000100:00100000:0.0:1787826303.913763:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6324 00000100:00100000:3.0:1787826303.916231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789857408 00000100:00100000:3.0:1787826303.916250:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789857408 00000100:00100000:3.0:1787826303.916333:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789857664 00000100:00100000:3.0:1787826303.916337:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789857664 00000100:00100000:3.0:1787826303.916372:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111636 00000100:00100000:3.0:1787826303.916383:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+35:84237:x1874668789857408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.916422:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826303.916451:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1a1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.916532:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a1 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.916551:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a1 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.916574:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826303.916578:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826303.916583:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606600, rc 0) 00000100:00100000:0.0:1787826303.916687:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111637 00000100:00100000:0.0:1787826303.916707:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84238:x1874668789857664:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.916756:0:23845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.916780:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bcc5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x131:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc162 expref: 36 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.916813:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:0.0:1787826303.916817:0:23845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826303.916844:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.916883:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.916893:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826303.917035:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051e389b8 reply state 0000000026807ebe transno 8590016691 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.917049:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.917056:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:0.0:1787826303.917058:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826303.917060:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826303.917743:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84237:x1874668789857408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1355us (4733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.917754:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111636 00000100:00100000:0.0:1787826303.918100:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84238:x1874668789857664:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1402us (4994us total) trans 8590016691 rc 0/0 00000100:00100000:0.0:1787826303.918108:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111637 00000100:00100000:1.0:1787826303.918399:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.921758:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789858048 00000100:00100000:2.0:1787826303.921778:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789858048 00000100:00100000:2.0:1787826303.921894:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111638 00000100:00100000:2.0:1787826303.921907:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84239:x1874668789858048:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.921996:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.922016:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc123 expref: 36 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.922027:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.922076:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc123 expref: 36 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.922093:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc123 expref: 36 pid: 45683 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.922110:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08848f00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778644096:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826303.922234:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.923584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826303.923628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.923691:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789858304 00000100:00100000:3.0:1787826303.923701:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789858304 00000100:00100000:3.0:1787826303.923767:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6325 00000100:00100000:3.0:1787826303.923779:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789858304:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826303.924097:0:19335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826303.924102:0:19335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb mtime from disk: 0 -> 1787826223 00002000:00010000:3.0:1787826303.924105:0:19335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb atime from disk: 0 -> 1787826223 00002000:00010000:3.0:1787826303.924107:0:19335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb ctime from disk: 0 -> 1787826223 00002000:00010000:3.0:1787826303.924110:0:19335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826303.924176:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789858304:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 399us (545us total) trans 4294968199 rc 0/0 00000100:00100000:3.0:1787826303.924185:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6325 00000100:00100000:1.0:1787826303.924269:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789858176 00000100:00100000:1.0:1787826303.924285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789858176 00000100:00100000:1.0:1787826303.924327:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111639 00000100:00100000:1.0:1787826303.924336:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84238:x1874668789858176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.924352:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826303.924374:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.924444:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a8 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.924460:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a8 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.924481:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:1.0:1787826303.924484:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826303.924488:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc 0) 00000100:00100000:1.0:1787826303.924512:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+38:84238:x1874668789858176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 178us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.924518:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111639 00000100:00100000:1.0:1787826303.928515:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.928604:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789858560 00000100:00100000:0.0:1787826303.928615:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789858560 00010000:00010000:0.0:1787826303.928669:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc123 expref: 38 pid: 45683 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.928722:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3097 00000100:00100000:0.0:1787826303.928734:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2400:x1874668789858560:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.928758:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.928766:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc123 expref: 38 pid: 45683 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.928781:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc123 expref: 38 pid: 45683 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.928823:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:0.0:1787826303.928830:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.928841:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.928878:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.928903:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.928966:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2400:x1874668789858560:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 233us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.928974:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3097 00010000:00010000:2.0:1787826303.929639:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bc24 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x132:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc123 expref: 37 pid: 45683 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.929663:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08848f00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778644096:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826303.929691:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.929703:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.929709:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.929761:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.929769:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.929778:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.929796:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.929801:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.929811:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.929826:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:2.0:1787826303.929830:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826303.929835:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.929842:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd27 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.929967:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84239:x1874668789858048:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 8063us (11577us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826303.929978:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111638 00000100:00100000:1.0:1787826303.933113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.933219:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789858432 00000100:00100000:3.0:1787826303.933231:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789858432 00000100:00100000:3.0:1787826303.933309:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6326 00000100:00100000:3.0:1787826303.933321:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789858432:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787826303.933560:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787826303.933564:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb mtime from disk: 0 -> 1787826223 00002000:00010000:3.0:1787826303.933567:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb atime from disk: 0 -> 1787826223 00002000:00010000:3.0:1787826303.933569:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb ctime from disk: 0 -> 1787826223 00002000:00010000:3.0:1787826303.933572:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787826303.933653:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789858432:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 334us (553us total) trans 4294968183 rc 0/0 00000100:00100000:3.0:1787826303.933662:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6326 00000100:00100000:1.0:1787826303.938012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.938133:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789858688 00000100:00100000:0.0:1787826303.938146:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789858688 00000100:00100000:0.0:1787826303.938228:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6327 00000100:00100000:0.0:1787826303.938241:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789858688:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.938302:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.938336:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.938347:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc9:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826303.938352:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826303.938357:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.938413:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.938431:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 12 pid: 8432 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.938449:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778644224:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826303.938562:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0d0f2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.943526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.943579:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.943668:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789858944 00000100:00100000:3.0:1787826303.943681:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789858944 00000100:00100000:1.0:1787826303.944010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789859200 00000100:00100000:1.0:1787826303.944015:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789859200 00000100:00100000:1.0:1787826303.944135:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111640 00000100:00100000:1.0:1787826303.944147:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84237:x1874668789858944:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.944240:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.944261:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc12a expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.944282:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 4/0,1 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.944330:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc12a expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.944345:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc12a expref: 37 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.944364:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410470c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778644352:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826303.944482:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.945258:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111641 00000100:00100000:2.0:1787826303.945435:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+37:84238:x1874668789859200:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787826303.945497:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.945516:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc11c expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.945530:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.945563:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc11c expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.945574:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc11c expref: 37 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.945586:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778644480:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826303.945664:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826303.948101:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410470c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778644352:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.948144:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.948273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.948327:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.948416:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789859328 00000100:00100000:3.0:1787826303.948425:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789859328 00010000:00010000:3.0:1787826303.948474:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 13 pid: 8432 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.948519:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789859456 00000100:00100000:3.0:1787826303.948523:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789859456 00010000:00010000:3.0:1787826303.948538:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc12a expref: 38 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.948564:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3098 00000100:00100000:3.0:1787826303.948576:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789859328:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826303.948594:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.948623:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 13 pid: 8432 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948639:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 13 pid: 8432 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948674:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826303.948680:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826303.948687:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948699:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948722:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826303.948783:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789859328:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 207us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.948791:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3098 00000100:00100000:3.0:1787826303.948811:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3099 00000100:00100000:3.0:1787826303.948818:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe166412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789859456:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826303.948828:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.948835:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc12a expref: 38 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948881:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc12a expref: 38 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948899:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bc47 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x133:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc12a expref: 38 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948917:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826303.948923:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948932:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948940:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.948958:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826303.948978:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe166412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2401:x1874668789859456:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 160us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.948985:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3099 00010000:00010000:3.0:1787826303.949011:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.949019:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.949068:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.949080:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.949086:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.949093:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826303.949098:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.949106:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.949116:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826303.949119:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787826303.949123:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.949129:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349bd3c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.949171:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84237:x1874668789858944:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 5027us (5661us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787826303.949179:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111640 00010000:00010000:0.0:1787826303.949626:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349bcfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc193 expref: 12 pid: 8432 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.949643:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778644224:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826303.949667:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.949678:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.949686:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.949756:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.949766:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.949773:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.949780:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826303.949783:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.949792:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.949806:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.949813:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003810602f/0x68019081f349bd35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.949975:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789858688:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 11735us (11979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.949985:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6327 00000100:00100000:1.0:1787826303.966249:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.966293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.966352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.966402:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789859968 00000100:00100000:1.0:1787826303.966414:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789859968 00000100:00100000:1.0:1787826303.966488:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6328 00000100:00100000:1.0:1787826303.966500:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789859968:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826303.966563:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.966589:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.966599:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826303.966604:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826303.966610:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.966657:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.966671:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 13 pid: 8433 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826303.966692:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16642d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778644608:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826303.966794:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf0f76ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826303.967326:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789859840 00000100:00100000:3.0:1787826303.967334:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789859840 00000100:00100000:3.0:1787826303.967402:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111642 00000100:00100000:3.0:1787826303.967412:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84239:x1874668789859840:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826303.967507:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x100:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.967525:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x100:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.967537:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x100:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.967731:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.967744:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc19a expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.967751:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.967780:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc19a expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.967792:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc19a expref: 37 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.967805:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778644736:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826303.967891:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.968009:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778644480:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826303.968037:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.968109:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789859584 00000100:00100000:0.0:1787826303.968116:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789859584 00010000:00010000:0.0:1787826303.968148:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc11c expref: 38 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.968194:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3100 00000100:00100000:0.0:1787826303.968203:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe166430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2401:x1874668789859584:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.968217:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826303.968224:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc11c expref: 38 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.968237:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc11c expref: 38 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.968257:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349bc16 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x131:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc11c expref: 38 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.968274:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:0.0:1787826303.968279:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.968287:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.968299:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.968336:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826303.968370:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe166430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2401:x1874668789859584:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 167us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.968378:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3100 00010000:00010000:2.0:1787826303.968384:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.968403:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.968432:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.968440:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.968447:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.968455:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826303.968460:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.968469:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.968480:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:2.0:1787826303.968483:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826303.968487:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.968494:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bd43 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.968538:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+36:84238:x1874668789859200:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 23269us (24958us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826303.968548:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111641 00000100:00100000:1.0:1787826303.977726:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.977971:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826303.978001:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.978294:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789860352 00000100:00100000:3.0:1787826303.978306:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789860352 00010000:00010000:3.0:1787826303.978374:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 14 pid: 8433 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.978431:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789860224 00000100:00100000:3.0:1787826303.978435:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789860224 00010000:00010000:3.0:1787826303.978454:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc19a expref: 36 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.978483:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3101 00000100:00100000:3.0:1787826303.978494:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789860352:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826303.978515:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.978545:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 14 pid: 8433 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.978561:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 14 pid: 8433 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.978598:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826303.978603:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826303.978612:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.978625:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.978651:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826303.978711:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789860352:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 218us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.978720:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3101 00000100:00100000:3.0:1787826303.978780:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3102 00000100:00100000:3.0:1787826303.978801:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16643c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789860224:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826303.978811:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826303.978818:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc19a expref: 36 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.978829:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc19a expref: 36 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.978846:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:3.0:1787826303.978884:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.978893:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.978901:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.978914:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826303.978933:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16643c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2402:x1874668789860224:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 147us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.978939:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3102 00010000:00010000:3.0:1787826303.978990:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349bcef lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc185 expref: 13 pid: 8433 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.979008:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16642d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778644608:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826303.979031:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.979051:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.979072:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.979096:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.979105:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.979115:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.979125:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826303.979129:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.979139:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.979153:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.979168:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c206195b/0x68019081f349bd4a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.979220:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789859968:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 12723us (12867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826303.979229:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6328 00000100:00100000:3.0:1787826303.979248:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789860096 00000100:00100000:3.0:1787826303.979253:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789860096 00010000:00010000:0.0:1787826303.980367:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bd12 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc19a expref: 35 pid: 6515 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.980403:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778644736:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826303.980428:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.980436:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.980442:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826303.980595:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016692 00000001:00080000:0.0:1787826303.982107:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016693 00000001:00080000:0.0:1787826303.982197:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016694 00000100:00100000:0.0:1787826303.982305:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc7840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778644864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826303.982409:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826303.982453:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.982749:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778644864 00000100:00100000:1.0:1787826303.982758:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778644864 00000100:00100000:1.0:1787826303.982832:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3362 00000100:00100000:1.0:1787826303.982843:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0225a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7736:x1874668778644864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826303.982989:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0225a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7736:x1874668778644864:12345-0@lo:1000:mdt00_003.0 Request processed in 147us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.982997:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3362 00000100:00100000:0.0:1787826303.984595:0:7736:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968179 gen 2 00000004:00080000:0.0:1787826303.984608:0:7736:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968179 committed transno 4294968179 00000100:00100000:0.0:1787826303.984637:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc7840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778644864:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787826303.984827:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016695 00000100:00100000:0.0:1787826303.985736:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc7840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778644992:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826303.989180:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826303.989235:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.989249:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6329 00000100:00100000:1.0:1787826303.989262:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778644992 00000100:00100000:2.0:1787826303.989279:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16640780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789860096:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00000100:00100000:1.0:1787826303.989284:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778644992 00010000:00010000:2.0:1787826303.989344:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.989369:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 11 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.989379:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826303.989385:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826303.989401:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.989449:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 11 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.989467:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 11 pid: 45681 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826303.989484:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778645120:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826303.989516:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3363 00000100:00100000:1.0:1787826303.989528:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7736:x1874668778644992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826303.989594:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826303.989777:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7736:x1874668778644992:12345-0@lo:1000:mdt00_003.0 Request processed in 252us (606us total) trans 4294968184 rc 0/0 00000100:00100000:1.0:1787826303.989786:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3363 00000100:00100000:0.0:1787826303.990065:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc7840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7736:1874668778644992:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787826303.990172:0:7736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016696 00010000:00010000:0.0:1787826303.990213:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990224:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990232:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990239:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.990244:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990253:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990270:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:0.0:1787826303.990285:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826303.990291:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990296:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349bd58 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990402:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f3499198 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990410:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f3499198 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990416:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f3499198 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990420:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.990423:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f3499198 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990427:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f3499198 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990435:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x100:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:0.0:1787826303.990438:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826303.990441:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f3499198 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x100:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990446:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f3499198 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x100:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990469:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x100:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990481:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990491:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990499:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990505:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990510:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990515:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.990517:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990523:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990529:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x100:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:0.0:1787826303.990531:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826303.990534:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990539:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bd66 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x100:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990549:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x100:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990555:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x100:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990561:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x100:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990567:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826303.990570:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x100:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990575:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x100:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990582:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x100:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:0.0:1787826303.990584:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826303.990587:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x100:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.990592:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349bd51 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x100:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.990723:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84239:x1874668789859840:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 23311us (24427us total) trans 8590016697 rc 0/0 00000100:00100000:0.0:1787826303.990733:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111642 00000020:00080000:0.0:1787826303.990738:0:7736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826303.992043:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826303.995489:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789860608 00000100:00100000:0.0:1787826303.995520:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789860608 00000100:00100000:0.0:1787826303.995665:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111643 00000100:00100000:0.0:1787826303.995681:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:84237:x1874668789860608:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.995838:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 3/0,1 mode: --/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.995895:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.995924:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826303.996103:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826303.996134:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789860864 00000100:00100000:3.0:1787826303.996139:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789860864 00000100:00100000:3.0:1787826303.996176:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2725 00000100:00100000:3.0:1787826303.996185:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+41:84239:x1874668789860864:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1787826303.996196:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.996212:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a1 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.996224:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.996268:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a1 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.996282:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a1 expref: 41 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826303.996300:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778645248:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826303.996415:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826303.997567:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778645120:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826303.997598:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826304.001404:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x132:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826304.001464:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016699 00010000:00010000:3.0:1787826304.001608:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.001630:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.001644:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.001653:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.001659:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.001677:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.001706:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826304.002621:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+43:84239:x1874668789860864:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 5666us (5749us total) trans 8590016700 rc 0/0 00000100:00100000:3.0:1787826304.002638:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2725 00000020:00080000:3.0:1787826304.002646:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826304.002736:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826304.002794:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789860992 00000100:00100000:0.0:1787826304.002804:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789860992 00010000:00010000:0.0:1787826304.002847:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 12 pid: 45681 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826304.003121:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3103 00000100:00100000:1.0:1787826304.003279:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778645248:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826304.003310:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826304.003434:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789860992:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826304.003459:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826304.003490:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 12 pid: 45681 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.003505:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 12 pid: 45681 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.003535:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349bcf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc18c expref: 12 pid: 45681 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.003554:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826304.003558:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826304.003565:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.003577:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.003658:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826304.003718:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789860992:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 290us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826304.003726:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3103 00010000:00010000:3.0:1787826304.004554:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.004570:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.004603:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.004613:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.004622:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.004631:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826304.004636:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.004646:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.004662:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.004671:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349bd5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826304.005103:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16640780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789860096:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 15832us (27385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826304.005115:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6329 00000100:00100000:0.0:1787826304.005309:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826304.005463:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789861120 00000100:00100000:3.0:1787826304.005472:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789861120 00010000:00010000:3.0:1787826304.005533:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a1 expref: 43 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826304.005571:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3104 00000100:00100000:3.0:1787826304.005583:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2402:x1874668789861120:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826304.005602:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826304.005609:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a1 expref: 43 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.005623:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a1 expref: 43 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.005651:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bd19 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a1 expref: 43 pid: 6516 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.005667:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826304.005674:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.005685:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.005693:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.005721:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826304.005768:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+42:2402:x1874668789861120:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 188us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826304.005775:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3104 00000100:00080000:0.0:1787826304.005829:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826304.006184:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.006193:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826304.006339:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016698 00000001:00080000:3.0:1787826304.006488:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016701 00000001:00080000:3.0:1787826304.006537:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016702 00000100:00100000:3.0:1787826304.006640:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1c780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778645376:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826304.006707:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826304.006797:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826304.007275:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778645376 00000100:00100000:0.0:1787826304.007284:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778645376 00000100:00100000:0.0:1787826304.007335:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364 00000100:00100000:0.0:1787826304.007346:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778645376:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787826304.007508:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778645376:12345-0@lo:1000:mdt00_004.0 Request processed in 165us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826304.007516:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1787826304.007617:0:12105:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968197 gen 2 00010000:00010000:2.0:1787826304.007623:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1787826304.007625:0:12105:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968196 committed transno 4294968197 00010000:00010000:2.0:1787826304.007634:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.007643:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826304.007646:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.007655:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826304.007658:0:12105:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968197 committed transno 4294968197 00010000:00010000:2.0:1787826304.007671:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00000100:00100000:3.0:1787826304.007679:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1c780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778645376:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787826304.007680:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826304.007687:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 1/0,0 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.007693:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349bd7b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.007706:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826304.007707:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826304.007709:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787826304.008292:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016703 00000100:00100000:0.0:1787826304.008371:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778645504:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787826304.008431:0:12105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826304.008499:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826304.008541:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778645504 00000100:00100000:1.0:1787826304.008548:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778645504 00000100:00100000:1.0:1787826304.008624:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3365 00000100:00100000:1.0:1787826304.008635:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:12105:x1874668778645504:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787826304.008835:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:12105:x1874668778645504:12345-0@lo:1000:mdt00_004.0 Request processed in 203us (403us total) trans 4294968200 rc 0/0 00000100:00100000:1.0:1787826304.008844:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3365 00000100:00100000:3.0:1787826304.009457:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12105:1874668778645504:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787826304.009551:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016704 00010000:00010000:3.0:1787826304.009592:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009604:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009612:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009617:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826304.009622:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009630:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009649:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:3.0:1787826304.009653:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826304.009657:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009664:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bd74 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009696:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349918a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009703:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349918a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009709:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349918a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009714:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826304.009718:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349918a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009724:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349918a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009732:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfe:0x0].0x0 (ffff9bbe16cc5600) 00010000:00010000:3.0:1787826304.009735:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826304.009738:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349918a lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.009744:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349918a lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010334:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010353:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010364:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010373:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010379:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010384:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010389:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826304.010403:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010410:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010419:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfe:0x0].0x0 (ffff9bbe16cc5600) 00010000:00010000:2.0:1787826304.010421:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826304.010425:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010431:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bd82 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010441:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010447:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010452:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010458:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826304.010461:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010466:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010473:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xfe:0x0].0x0 (ffff9bbe16cc5600) 00010000:00010000:2.0:1787826304.010474:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826304.010477:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 2/0,0 mode: --/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.010482:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349bd6d lrc: 0/0,0 mode: --/PW res: [0x200000403:0xfe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826304.010712:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84237:x1874668789860608:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 15030us (18673us total) trans 8590016705 rc 0/0 00000100:00100000:2.0:1787826304.010723:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111643 00000020:00080000:2.0:1787826304.010729:0:12105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826304.011992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826304.012655:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789861376 00000100:00100000:3.0:1787826304.012667:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789861376 00000100:00100000:3.0:1787826304.012752:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111644 00000100:00100000:3.0:1787826304.012764:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+46:84238:x1874668789861376:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826304.012917:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.012944:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xff:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.012957:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xff:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.013427:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.013445:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a8 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.013455:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.013499:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a8 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.013516:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a8 expref: 47 pid: 6517 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826304.013535:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778645632:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826304.013654:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826304.016459:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826304.016642:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789861632 00000100:00100000:1.0:1787826304.016654:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789861632 00000100:00100000:1.0:1787826304.016739:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2726 00000100:00100000:1.0:1787826304.016751:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+48:84237:x1874668789861632:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826304.019636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000004:00080000:1.0:1787826304.020044:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x133:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787826304.020083:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016707 00010000:00010000:1.0:1787826304.020127:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020147:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020162:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020173:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020179:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020187:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020208:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826304.020508:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+50:84237:x1874668789861632:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 3757us (4058us total) trans 8590016708 rc 0/0 00000100:00100000:1.0:1787826304.020521:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2726 00000020:00080000:1.0:1787826304.020528:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826304.020569:0:10335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826304.020576:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020588:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826304.020592:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020601:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020618:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:1.0:1787826304.020622:0:10335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826304.020627:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020635:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bd97 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x133:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.020648:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826304.020650:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826304.020652:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826304.021072:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778645632:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826304.021101:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826304.023386:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789861760 00000100:00100000:2.0:1787826304.023413:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789861760 00010000:00010000:2.0:1787826304.023470:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a8 expref: 50 pid: 6517 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826304.023548:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3105 00000100:00100000:2.0:1787826304.023560:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+50:2401:x1874668789861760:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826304.023578:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826304.023586:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a8 expref: 50 pid: 6517 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.023601:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a8 expref: 50 pid: 6517 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.023627:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bd2e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1a8 expref: 50 pid: 6517 timeout: 3042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.023643:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:2.0:1787826304.023648:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.023659:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.023669:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826304.023709:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826304.023794:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2401:x1874668789861760:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 236us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826304.023803:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3105 00010000:00010000:0.0:1787826304.023880:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.023890:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826304.024025:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016706 00000001:00080000:0.0:1787826304.024170:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016709 00000001:00080000:0.0:1787826304.024212:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016710 00000100:00100000:0.0:1787826304.024326:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778645760:0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1787826304.024410:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826304.024449:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826304.024653:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778645760 00000100:00100000:1.0:1787826304.024660:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778645760 00000100:00100000:1.0:1787826304.024710:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:1.0:1787826304.024719:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778645760:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787826304.024822:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778645760:12345-0@lo:1000:mdt00_006.0 Request processed in 104us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.024830:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00000100:00100000:0.0:1787826304.025964:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778645760:0@lo:1000:mdt00_006.0 00000001:00080000:0.0:1787826304.026140:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016711 00000100:00100000:0.0:1787826304.026220:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778645888:0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1787826304.026285:0:25756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826304.026321:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826304.026493:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778645888 00000100:00100000:1.0:1787826304.026499:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778645888 00000100:00100000:1.0:1787826304.026550:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3367 00000100:00100000:1.0:1787826304.026560:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:25756:x1874668778645888:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787826304.026706:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:25756:x1874668778645888:12345-0@lo:1000:mdt00_006.0 Request processed in 134us (419us total) trans 4294968185 rc 0/0 00000100:00100000:1.0:1787826304.026715:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3367 00000100:00100000:0.0:1787826304.028104:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:25756:1874668778645888:0@lo:1000:mdt00_006.0 00000001:00080000:0.0:1787826304.028239:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016712 00010000:00010000:0.0:1787826304.028414:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028428:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028438:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028450:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826304.028456:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028465:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028487:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:0.0:1787826304.028491:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826304.028496:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028504:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bd90 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028535:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f3499191 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028543:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f3499191 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028550:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f3499191 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028555:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826304.028559:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f3499191 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028565:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f3499191 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028579:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xff:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826304.028581:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826304.028585:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f3499191 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028591:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f3499191 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028619:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 3/0,1 mode: --/EX res: [0x200000403:0xff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028634:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028644:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028652:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028658:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028665:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028670:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826304.028673:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028680:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028688:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xff:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826304.028690:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826304.028705:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 2/0,0 mode: --/EX res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028712:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bd9e lrc: 0/0,0 mode: --/EX res: [0x200000403:0xff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028723:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xff:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028730:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xff:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028736:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xff:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028743:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826304.028746:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xff:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028753:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xff:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028761:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xff:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826304.028763:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826304.028767:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xff:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.028773:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349bd89 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xff:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826304.029614:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84238:x1874668789861376:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 16846us (17622us total) trans 8590016713 rc 0/0 00000100:00100000:0.0:1787826304.029628:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111644 00000020:00080000:0.0:1787826304.029635:0:25756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787826304.033513:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826304.033892:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789862016 00000100:00100000:3.0:1787826304.033904:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789862016 00000100:00100000:3.0:1787826304.033982:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2727 00000100:00100000:3.0:1787826304.033994:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+53:84238:x1874668789862016:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787826304.034648:0:23877:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x131:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787826304.034689:0:23877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016714 00010000:00010000:3.0:1787826304.034745:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.034765:0:23877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.034780:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.034790:0:23877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.034798:0:23877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.034804:0:23877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826304.034906:0:23877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826304.035023:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+55:84238:x1874668789862016:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1029us (1521us total) trans 8590016715 rc 0/0 00000100:00100000:3.0:1787826304.035033:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2727 00000020:00080000:3.0:1787826304.035040:0:23877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1787826304.036376:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826304.036387:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00010000:00010000:0.0:1787826304.036449:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826304.036462:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.036474:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826304.036479:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.036492:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.036514:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:0.0:1787826304.036517:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826304.036523:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.036530:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349bda5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826304.036546:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826304.036548:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826304.036550:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787826304.036970:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 64768 count 103 00000040:00080000:2.0:1787826304.036985:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1787826304.320363:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778646144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826304.320478:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826304.320746:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778646144 00000100:00100000:0.0:1787826304.320753:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778646016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826304.320756:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778646144 00000100:00100000:0.0:1787826304.320789:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826304.320914:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778646016 00000100:00100000:1.0:1787826304.320918:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778646016 00000100:00100000:1.0:1787826304.320938:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1787826304.320948:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1874668778646144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826304.320985:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:1.0:1787826304.321040:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1874668778646144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.321048:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1787826304.321070:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:1.0:1787826304.321077:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874668778646016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826304.321094:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826304.321234:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778646144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826304.327478:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874668778646016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6385us (6672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.327498:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1787826304.335194:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778646016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787826304.896732:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787826305.314295:0:55004:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826305.314305:0:55004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826305.314573:0:55004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:1.0:1787826305.314581:0:55004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:1.0:1787826305.314652:0:55004:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826305.314656:0:55004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826305.314924:0:55004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:1.0:1787826305.314930:0:55004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:1.0:1787826305.314985:0:55004:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826305.314988:0:55004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826305.315632:0:55004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:1.0:1787826305.315639:0:55004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:1.0:1787826305.315713:0:55004:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826305.315717:0:55004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826305.316737:0:55004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:1.0:1787826305.316745:0:55004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:1.0:1787826305.920253:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826305.990535:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826305.990575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826305.990608:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826305.990635:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826305.990654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826305.990669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826305.990682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826305.990697:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826305.990716:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826305.990898:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789862144 00000100:00100000:0.0:1787826305.990904:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789862400 00000100:00100000:3.0:1787826305.990907:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789862144 00000100:00100000:0.0:1787826305.990911:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789862400 00000100:00100000:3.0:1787826305.990967:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 773 00000100:00100000:2.0:1787826305.990970:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789862656 00000100:00100000:2.0:1787826305.990977:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789862656 00000100:00100000:3.0:1787826305.990979:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf03f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789862144:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826305.990984:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789862912 00000100:00100000:0.0:1787826305.990989:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789862912 00000100:00100000:2.0:1787826305.991017:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789863168 00000100:00100000:2.0:1787826305.991022:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789863168 00000100:00100000:0.0:1787826305.991023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789862272 00000100:00100000:0.0:1787826305.991028:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789862272 00000100:00100000:3.0:1787826305.991051:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf03f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789862144:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 74us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826305.991057:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789862784 00000100:00100000:3.0:1787826305.991061:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 773 00000100:00100000:0.0:1787826305.991062:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789862784 00000100:00100000:2.0:1787826305.991075:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789862528 00000100:00100000:2.0:1787826305.991080:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789862528 00000100:00100000:0.0:1787826305.991098:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4973 00000100:00100000:3.0:1787826305.991107:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4974 00000100:00100000:2.0:1787826305.991112:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789863040 00000100:00100000:0.0:1787826305.991113:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe166403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789862400:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826305.991117:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789863040 00000100:00100000:3.0:1787826305.991121:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789862912:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826305.991142:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3430 00000100:00100000:2.0:1787826305.991153:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789862656:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826305.991165:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe166403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789862400:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 56us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826305.991173:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4973 00000100:00080000:1.0:1787826305.991187:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826305.991192:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826305.991195:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826305.991198:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826305.991205:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4975 00000100:00100000:0.0:1787826305.991213:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe166421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:2401:x1874668789862272:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826305.991238:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4976 00000100:00100000:1.0:1787826305.991255:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789862784:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826305.993150:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789862912:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 2026us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826305.993162:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4974 00000100:00100000:3.0:1787826305.993215:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3431 00000100:00100000:3.0:1787826305.993229:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16641e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789863168:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826305.993847:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16641e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789863168:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 468us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826305.993879:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3431 00000100:00100000:3.0:1787826305.993906:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3432 00000100:00100000:3.0:1787826305.993916:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789862528:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826305.993952:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789862528:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 39us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826305.993958:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3432 00000100:00100000:3.0:1787826305.993972:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3433 00000100:00100000:3.0:1787826305.993979:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16642d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789863040:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826305.994009:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16642d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789863040:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (3292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826305.994015:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3433 00000100:00100000:2.0:1787826305.994351:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789862656:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3197us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826305.994361:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3430 00000100:00100000:0.0:1787826305.994485:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe166421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:2401:x1874668789862272:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3269us (3811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826305.994494:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4975 00000100:00100000:1.0:1787826305.994631:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789862784:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3383us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826305.994693:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4976 00000040:00080000:0.0:1787826306.112942:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826306.112951:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826306.113164:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:0.0:1787826306.113172:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1787826306.880346:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe166430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778646400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.880457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.880532:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778646912:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.880561:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.880578:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778647424:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.880598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.880627:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787826306.880632:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe166412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778646272:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.880660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.880676:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1874668778646784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.880699:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.880715:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a116940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778647296:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.880732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.880745:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778647808:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.880775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.880807:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778646784 00000100:00100000:2.0:1787826306.880814:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778646784 00000100:00100000:2.0:1787826306.880898:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778647808 00000100:00100000:2.0:1787826306.880901:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778647808 00000100:00100000:2.0:1787826306.880920:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4977 00000100:00100000:2.0:1787826306.880928:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874668778646784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.880981:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874668778646784:12345-0@lo:400:kworker.0 Request processed in 54us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.880988:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4977 00000100:00100000:2.0:1787826306.881006:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4978 00000100:00100000:2.0:1787826306.881012:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778647808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.881034:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778647808:12345-0@lo:400:kworker.0 Request processed in 23us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.881043:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4978 00000100:00080000:2.0:1787826306.881059:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826306.881089:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1874668778646784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.881099:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778647808:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.881353:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778646528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.881403:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.881430:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778647040:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.881453:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.881473:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778647552:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.881494:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.881514:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826306.881519:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778646656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.881538:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.881550:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe100383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778647168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.881571:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.881587:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778647680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.881607:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.881638:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778646912 00000100:00100000:3.0:1787826306.881642:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778646912 00000100:00100000:3.0:1787826306.881679:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778647296 00000100:00100000:3.0:1787826306.881682:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778647296 00000100:00100000:3.0:1787826306.881700:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3434 00000100:00100000:3.0:1787826306.881709:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778646912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.881746:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778646912:12345-0@lo:400:kworker.0 Request processed in 39us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826306.881752:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3434 00000100:00100000:2.0:1787826306.881874:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778646528 00000100:00100000:2.0:1787826306.881878:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778646528 00000100:00100000:2.0:1787826306.881902:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778647040 00000100:00100000:2.0:1787826306.881904:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778647040 00000100:00100000:2.0:1787826306.881918:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778646656 00000100:00100000:2.0:1787826306.881920:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778646656 00000100:00100000:2.0:1787826306.881933:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778647168 00000100:00100000:2.0:1787826306.881935:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778647168 00000100:00100000:2.0:1787826306.881948:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4979 00000100:00100000:2.0:1787826306.881953:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778646528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.881990:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778646528:12345-0@lo:400:kworker.0 Request processed in 37us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.881996:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4979 00000100:00100000:2.0:1787826306.882007:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4980 00000100:00100000:2.0:1787826306.882012:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778647040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.882033:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778647040:12345-0@lo:400:kworker.0 Request processed in 22us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.882038:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4980 00000100:00100000:2.0:1787826306.882047:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4981 00000100:00100000:2.0:1787826306.882052:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778646656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.882072:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778646656:12345-0@lo:400:kworker.0 Request processed in 21us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.882082:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4981 00000100:00100000:2.0:1787826306.882089:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4982 00000100:00100000:2.0:1787826306.882094:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778647168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.882114:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778647168:12345-0@lo:400:kworker.0 Request processed in 20us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.882119:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4982 00000100:00100000:3.0:1787826306.882189:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778647552 00000100:00100000:3.0:1787826306.882193:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778647552 00000100:00100000:3.0:1787826306.882223:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778647680 00000100:00100000:3.0:1787826306.882226:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778647680 00000100:00100000:3.0:1787826306.882241:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3435 00000100:00100000:3.0:1787826306.882247:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778647296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882359:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778647296:12345-0@lo:400:kworker.0 Request processed in 111us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826306.882365:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3435 00000100:00100000:3.0:1787826306.882387:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3436 00000100:00100000:3.0:1787826306.882393:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3643:x1874668778647552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882423:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3643:x1874668778647552:12345-0@lo:400:kworker.0 Request processed in 31us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826306.882428:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3436 00000100:00100000:3.0:1787826306.882439:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3437 00000100:00100000:3.0:1787826306.882445:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3643:x1874668778647680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882471:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3643:x1874668778647680:12345-0@lo:400:kworker.0 Request processed in 26us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826306.882476:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3437 00000100:00100000:3.0:1787826306.882498:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778646272 00000100:00100000:3.0:1787826306.882501:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778646272 00000100:00100000:3.0:1787826306.882533:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1787826306.882539:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf03f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778646272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882570:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf03f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778646272:12345-0@lo:400:kworker.0 Request processed in 31us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826306.882576:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00080000:3.0:1787826306.882644:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826306.882649:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826306.882651:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826306.882653:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826306.882685:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778646656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882697:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe100383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778647168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882710:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778647680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882721:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778646528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882731:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778647040:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882742:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778647552:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882799:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe166412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778646272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882810:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a116940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778647296:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.882823:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778646912:0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.882950:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778646400 00000100:00100000:1.0:1787826306.882955:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778646400 00000100:00100000:1.0:1787826306.882996:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778647424 00000100:00100000:1.0:1787826306.883000:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778647424 00000100:00100000:1.0:1787826306.883022:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:1.0:1787826306.883029:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778646400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.883079:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778646400:12345-0@lo:400:kworker.0 Request processed in 51us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826306.883086:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00000100:00100000:1.0:1787826306.883105:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369 00000100:00100000:1.0:1787826306.883111:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778647424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.883141:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778647424:12345-0@lo:400:kworker.0 Request processed in 31us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826306.883147:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369 00000100:00100000:1.0:1787826306.883186:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe166430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778646400:0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.883199:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778647424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826306.883725:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778647936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826306.883783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.883997:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778647936 00000100:00100000:2.0:1787826306.884003:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778647936 00000100:00100000:2.0:1787826306.884046:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:2.0:1787826306.884053:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778647936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826306.884082:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826306.884341:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778647936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 287us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.884349:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:0.0:1787826306.884423:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778647936:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787826306.944096:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826307.393047:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826307.393073:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778648064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826307.393138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826307.393246:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778648064 00000100:00100000:0.0:1787826307.393254:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778648064 00000100:00100000:0.0:1787826307.393307:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1787826307.393317:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778648064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826307.393346:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826307.393400:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778648064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826307.393407:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1787826307.393543:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778648064:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826307.969956:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826308.928452:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778648192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826308.928522:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826308.928630:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778648192 00000100:00100000:2.0:1787826308.928637:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778648192 00000100:00100000:2.0:1787826308.928688:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:2.0:1787826308.928695:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778648192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826308.928726:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:3.0:1787826308.928777:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778648320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826308.928826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826308.929930:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778648320 00000100:00100000:0.0:1787826308.929938:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778648320 00000100:00100000:0.0:1787826308.929989:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371 00000100:00100000:0.0:1787826308.929998:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778648320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826308.930021:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826308.930070:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778648320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826308.930077:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371 00000100:00100000:3.0:1787826308.930214:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778648320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826308.935638:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778648192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826308.936727:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778648192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8027us (8199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826308.936739:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00010000:00010000:0.0:1787826308.995788:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826309.440006:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826309.440030:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778648448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826309.440095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826309.440284:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778648448 00000100:00100000:2.0:1787826309.440292:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778648448 00000100:00100000:2.0:1787826309.440346:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:2.0:1787826309.440369:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874668778648448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826309.440399:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826309.440449:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874668778648448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826309.440457:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00080000:2.0:1787826309.440479:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826309.440513:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778648448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826309.442227:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778648576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826309.442292:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826309.442389:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778648576 00000100:00100000:2.0:1787826309.442395:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778648576 00000100:00100000:2.0:1787826309.442524:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:2.0:1787826309.442534:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874668778648576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826309.442557:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826309.442600:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874668778648576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826309.442606:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:2.0:1787826309.443457:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778648576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787826309.448972:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826309.782679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826309.783362:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789863296 00000100:00100000:2.0:1787826309.783373:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789863296 00000100:00080000:1.0:1787826309.783509:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826309.785048:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111645 00000100:00100000:2.0:1787826309.785067:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+55:83987:x1874668789863296:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787826309.785182:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+55:83987:x1874668789863296:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 124us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826309.785191:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111645 00000100:00100000:1.0:1787826309.790462:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826309.790627:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789863424 00000100:00100000:2.0:1787826309.790637:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789863424 00000100:00100000:2.0:1787826309.790715:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111646 00000100:00100000:2.0:1787826309.790725:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+23:83987:x1874668789863424:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787826309.790831:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+23:83987:x1874668789863424:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 107us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826309.790839:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111646 00000100:00080000:1.0:1787826309.791104:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:1.0:1787826309.957451:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016715 is committed 00000020:00080000:1.0:1787826309.957476:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe15d38900 refcount 2 committed 0 result 0 batchid 4294970903 00000020:00080000:1.0:1787826309.957482:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0721ae00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe15d38f00 00000020:00080000:1.0:1787826309.957486:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0721a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0dbb4c00 00000020:00080000:1.0:1787826309.957511:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe16292f00 refcount 2 committed 0 result 0 batchid 4294970902 00000020:00080000:1.0:1787826309.957515:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bccb700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe16292480 00000020:00080000:1.0:1787826309.957518:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3bccb000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0de29800 00000020:00080000:1.0:1787826309.957530:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe15d38240 refcount 2 committed 0 result 0 batchid 4294970901 00000020:00080000:1.0:1787826309.957533:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0721aa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe15d38e40 00000020:00080000:1.0:1787826309.957537:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0721ab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d2b9e00 00000020:00080000:1.0:1787826309.957550:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970900 batchid updated 00000020:00080000:2.0:1787826309.957621:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970903 committed batchid 4294970900 00010000:00010000:0.0:1787826309.957639:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957651:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957659:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957671:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826309.957675:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957684:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826309.957693:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970900 00010000:00010000:0.0:1787826309.957702:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x132:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:0.0:1787826309.957706:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826309.957711:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957717:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349bd04 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x132:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957746:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957752:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957758:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957763:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826309.957766:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957771:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957783:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x133:0x0].0x0 (ffff9bbe0fe8ce00) 00010000:00010000:0.0:1787826309.957785:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826309.957787:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957793:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349bd0b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x133:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957804:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957810:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957815:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957820:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826309.957823:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957828:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957835:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x131:0x0].0x0 (ffff9bbe08124000) 00010000:00010000:0.0:1787826309.957837:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826309.957840:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.957845:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bd20 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x131:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826309.958617:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968200 is committed 00000001:00080000:2.0:1787826309.958626:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968199 is committed 00000001:00080000:0.0:1787826309.959880:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968185 is committed 00000001:00080000:0.0:1787826309.959893:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968183 is committed 00010000:00010000:1.0:1787826310.016401:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826311.041236:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826311.119619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826311.119660:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826311.119690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826311.119708:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826311.119733:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826311.119752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826311.119769:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826311.119789:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826311.119809:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826311.119835:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789863936 00000100:00100000:1.0:1787826311.119843:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789863936 00000100:00100000:1.0:1787826311.119919:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789864448 00000100:00100000:1.0:1787826311.119922:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789864448 00000100:00100000:1.0:1787826311.119940:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789864064 00000100:00100000:1.0:1787826311.119943:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789864064 00000100:00100000:1.0:1787826311.119961:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789864576 00000100:00100000:1.0:1787826311.119964:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789864576 00000100:00100000:1.0:1787826311.119981:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3438 00000100:00100000:1.0:1787826311.119990:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789863936:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826311.120063:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789863936:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 74us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.120071:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3438 00000100:00100000:1.0:1787826311.120088:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3439 00000100:00100000:1.0:1787826311.120094:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789864448:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826311.120117:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789864448:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.120124:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3439 00000100:00100000:1.0:1787826311.120134:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3440 00000100:00100000:1.0:1787826311.120140:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789864064:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826311.120161:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789864064:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.120166:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3440 00000100:00100000:1.0:1787826311.120176:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3441 00000100:00100000:1.0:1787826311.120182:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789864576:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826311.120200:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789864576:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 19us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.120207:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3441 00000100:00100000:1.0:1787826311.120236:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789863680 00000100:00100000:1.0:1787826311.120239:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789863680 00000100:00100000:1.0:1787826311.120273:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789864192 00000100:00100000:1.0:1787826311.120276:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789864192 00000100:00100000:1.0:1787826311.120292:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789863808 00000100:00100000:1.0:1787826311.120294:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789863808 00000100:00100000:1.0:1787826311.120307:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789864320 00000100:00100000:1.0:1787826311.120309:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789864320 00000100:00100000:1.0:1787826311.120328:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4983 00000100:00100000:1.0:1787826311.120333:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789863680:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826311.120371:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789863680:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 38us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.120377:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4983 00000100:00100000:1.0:1787826311.120390:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4984 00000100:00100000:1.0:1787826311.120396:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789864192:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826311.120419:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789864192:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.120424:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4984 00000100:00100000:1.0:1787826311.120434:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4985 00000100:00100000:1.0:1787826311.120440:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789863808:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826311.120461:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789863808:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.120467:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4985 00000100:00100000:1.0:1787826311.120478:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4986 00000100:00100000:1.0:1787826311.120485:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789864320:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826311.120506:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789864320:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.120512:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4986 00000100:00100000:1.0:1787826311.120533:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789863552 00000100:00100000:1.0:1787826311.120537:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789863552 00000100:00100000:1.0:1787826311.120559:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 775 00000100:00100000:1.0:1787826311.120565:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf03f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789863552:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826311.120587:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf03f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789863552:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.120593:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 775 00000100:00080000:1.0:1787826311.120631:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826311.120635:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826311.120638:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826311.120640:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1787826311.598194:0:55199:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 100: Set coordinator /proc tunables === 06:25:10 (1787826310) 00000100:00100000:2.0:1787826312.000638:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778649088:0@lo:400:kworker.0 00000100:00100000:2.0:1787826312.000702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826312.000845:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778648704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.000895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826312.000924:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778648704 00000100:00100000:1.0:1787826312.000931:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778648704 00000100:00100000:1.0:1787826312.000974:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1787826312.000983:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf03f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778648704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.001029:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf03f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778648704:12345-0@lo:400:kworker.0 Request processed in 48us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.001037:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1787826312.001211:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778648960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826312.001371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826312.001404:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778649088 00000100:00100000:3.0:1787826312.001409:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778649088 00000100:00100000:0.0:1787826312.001474:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778648960 00000100:00100000:0.0:1787826312.001478:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778648960 00000100:00100000:0.0:1787826312.001501:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4987 00000100:00100000:0.0:1787826312.001508:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778649088:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787826312.001620:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826312.001632:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4988 00000100:00100000:1.0:1787826312.001640:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778648960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.001681:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778648960:12345-0@lo:400:kworker.0 Request processed in 43us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.001687:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4988 00000100:00100000:2.0:1787826312.001882:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778649600:0@lo:400:kworker.0 00000100:00100000:2.0:1787826312.001909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826312.001933:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778648832:0@lo:400:kworker.0 00000100:00100000:2.0:1787826312.001958:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826312.001980:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778649600 00000100:00100000:2.0:1787826312.001984:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778649600 00000100:00100000:2.0:1787826312.002012:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4989 00000100:00100000:2.0:1787826312.002018:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778649600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826312.002051:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778649600:12345-0@lo:400:kworker.0 Request processed in 34us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826312.002058:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4989 00000100:00100000:2.0:1787826312.002076:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778648832 00000100:00100000:2.0:1787826312.002080:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778648832 00000100:00100000:2.0:1787826312.002102:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3372 00000100:00100000:2.0:1787826312.002108:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778648832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826312.002142:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778648832:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826312.002148:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3372 00000100:00100000:1.0:1787826312.002664:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778648704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.002672:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778649216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826312.003364:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778649088:12345-0@lo:400:kworker.0 Request processed in 1853us (2658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826312.003373:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4987 00000100:00100000:1.0:1787826312.003444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826312.003481:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778649728:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.003509:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826312.004177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778649216 00000100:00100000:0.0:1787826312.004185:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778649216 00000100:00100000:2.0:1787826312.004491:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778649600:0@lo:400:kworker.0 00000100:00100000:2.0:1787826312.004501:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778650112:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.004619:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778650240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.004648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826312.004689:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778649728 00000100:00100000:1.0:1787826312.004692:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778649728 00000100:00100000:1.0:1787826312.004722:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3442 00000100:00100000:1.0:1787826312.004737:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778649728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.004782:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778649728:12345-0@lo:400:kworker.0 Request processed in 52us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.004788:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3442 00000100:00100000:1.0:1787826312.004807:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778650240 00000100:00100000:1.0:1787826312.004810:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778650240 00000100:00100000:2.0:1787826312.004879:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826312.004922:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c031680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778649088:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.005715:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4990 00000100:00100000:1.0:1787826312.005741:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778649216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.005797:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778649216:12345-0@lo:400:kworker.0 Request processed in 71us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.005804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4990 00000100:00100000:1.0:1787826312.005823:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4991 00000100:00100000:1.0:1787826312.005830:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778650240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.005878:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778650240:12345-0@lo:400:kworker.0 Request processed in 49us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.005883:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4991 00000100:00100000:1.0:1787826312.005903:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778650112 00000100:00100000:1.0:1787826312.005907:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778650112 00000100:00100000:1.0:1787826312.005935:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3443 00000100:00100000:1.0:1787826312.005942:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778650112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.005977:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778650112:12345-0@lo:400:kworker.0 Request processed in 35us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.005982:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3443 00000100:00100000:1.0:1787826312.006029:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778648960:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.006038:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1874668778649472:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.006069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826312.006090:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778649984:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.006114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826312.006158:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778648832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.006165:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778649344:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.006192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826312.006208:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778649856:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.006246:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826312.006264:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778650368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826312.006300:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826312.006352:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778649984 00000100:00100000:1.0:1787826312.006356:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778649984 00000100:00100000:1.0:1787826312.006379:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778649344 00000100:00100000:1.0:1787826312.006381:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778649344 00000100:00100000:1.0:1787826312.006398:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444 00000100:00100000:1.0:1787826312.006404:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778649984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.006437:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778649984:12345-0@lo:400:kworker.0 Request processed in 33us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.006442:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444 00000100:00100000:1.0:1787826312.006454:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445 00000100:00100000:1.0:1787826312.006460:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778649344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.006490:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778649344:12345-0@lo:400:kworker.0 Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.006494:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445 00000100:00100000:1.0:1787826312.006969:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778649856 00000100:00100000:1.0:1787826312.006974:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778649856 00000100:00100000:1.0:1787826312.007003:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3373 00000100:00100000:1.0:1787826312.007009:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778649856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.007044:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778649856:12345-0@lo:400:kworker.0 Request processed in 35us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.007050:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3373 00000100:00100000:1.0:1787826312.007069:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778650368 00000100:00100000:1.0:1787826312.007072:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778650368 00000100:00100000:1.0:1787826312.007095:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:1.0:1787826312.007101:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778650368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826312.007123:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:1.0:1787826312.007152:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778650368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.007158:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00080000:1.0:1787826312.007183:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826312.007188:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826312.007191:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826312.007200:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778649472 00000100:00100000:1.0:1787826312.007204:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778649472 00000100:00100000:1.0:1787826312.007304:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4992 00000100:00100000:1.0:1787826312.007310:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874668778649472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.007353:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874668778649472:12345-0@lo:400:kworker.0 Request processed in 43us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.007359:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4992 00000100:00080000:1.0:1787826312.007374:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826312.007401:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1874668778649472:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.007410:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968200 gen 2 00000004:00080000:1.0:1787826312.007415:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968200 committed transno 4294968200 00000100:00100000:1.0:1787826312.007430:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778649984:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.007453:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778649344:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.007461:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778649856:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.007487:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778650368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826312.007515:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778649216:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.007690:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778649728:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.007702:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778650240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826312.007798:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968185 gen 2 00000004:00080000:1.0:1787826312.007803:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968184 committed transno 4294968185 00000004:00080000:1.0:1787826312.007814:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968185 committed transno 4294968185 00000100:00100000:1.0:1787826312.007822:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778650112:0@lo:400:kworker.0 00010000:00010000:2.0:1787826312.065120:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826312.512244:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826312.512267:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778650496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826312.512346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826312.512579:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778650496 00000100:00100000:0.0:1787826312.512587:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778650496 00000100:00100000:0.0:1787826312.512638:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1787826312.512648:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778650496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826312.512675:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826312.512728:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778650496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826312.512735:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:2.0:1787826312.512808:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778650496:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826313.088348:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787826313.920010:0:39210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787826313.920020:0:39210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826313.920543:0:39210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787826313.920553:0:39210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787826314.048026:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826314.049941:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778650624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826314.050009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826314.050175:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778650624 00000100:00100000:3.0:1787826314.050182:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778650624 00000100:00100000:3.0:1787826314.050246:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3374 00000100:00100000:3.0:1787826314.050256:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778650624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826314.050290:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1787826314.050345:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778650624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826314.050351:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3374 00000100:00100000:0.0:1787826314.050475:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16079680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778650624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826314.056395:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826314.056418:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778650752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826314.056494:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826314.056551:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778650752 00000100:00100000:2.0:1787826314.056557:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778650752 00000100:00100000:2.0:1787826314.056598:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3375 00000100:00100000:2.0:1787826314.056606:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778650752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826314.056638:0:45684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:2.0:1787826314.056684:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778650752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826314.056691:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3375 00000100:00100000:2.0:1787826314.056749:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778650752:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787826314.112821:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826314.561557:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778650880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826314.561632:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826314.561805:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826314.561813:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778651008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826314.561840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826314.561885:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778650880 00000100:00100000:0.0:1787826314.561891:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778650880 00000100:00100000:0.0:1787826314.561937:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778651008 00000100:00100000:0.0:1787826314.561940:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778651008 00000100:00100000:0.0:1787826314.561958:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:0.0:1787826314.561967:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778650880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826314.561997:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826314.562040:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778650880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826314.562047:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00100000:0.0:1787826314.562064:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:0.0:1787826314.562071:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778651008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826314.562085:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826314.562111:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778651008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826314.562116:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:0.0:1787826314.562154:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778651008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826314.562167:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778650880:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787826314.562354:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826314.562359:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826315.137698:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787826316.099920:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970903 batchid updated 00000020:00080000:2.0:1787826316.100010:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970903 00000020:00080000:2.0:1787826316.100026:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970903 00010000:00010000:0.0:1787826316.160056:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826316.236662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826316.236710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826316.237013:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789864832 00000100:00100000:2.0:1787826316.237023:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789864832 00000100:00100000:2.0:1787826316.237093:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4993 00000100:00100000:2.0:1787826316.237103:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789864832:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826316.237170:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789864832:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 69us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826316.237177:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4993 00000100:00080000:3.0:1787826316.237267:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826316.237447:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789864704 00000100:00100000:0.0:1787826316.237452:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789864704 00000100:00100000:0.0:1787826316.237492:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 777 00000100:00100000:0.0:1787826316.237499:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf03f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789864704:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826316.237528:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf03f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789864704:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826316.237534:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 777 00000100:00100000:1.0:1787826316.242520:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826316.242566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826316.242585:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826316.242605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826316.242624:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826316.242643:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826316.242665:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826316.242692:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789865088 00000100:00100000:1.0:1787826316.242711:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789865088 00000100:00100000:1.0:1787826316.242768:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789865600 00000100:00100000:1.0:1787826316.242772:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789865600 00000100:00100000:1.0:1787826316.242791:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789865216 00000100:00100000:1.0:1787826316.242794:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789865216 00000100:00100000:1.0:1787826316.242811:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789865728 00000100:00100000:1.0:1787826316.242813:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789865728 00000100:00100000:1.0:1787826316.242827:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3446 00000100:00100000:1.0:1787826316.242835:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789865088:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826316.242930:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789865088:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 95us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.242941:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3446 00000100:00100000:1.0:1787826316.242960:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3447 00000100:00100000:1.0:1787826316.242966:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789865600:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826316.242990:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789865600:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.242996:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3447 00000100:00100000:1.0:1787826316.243007:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3448 00000100:00100000:1.0:1787826316.243014:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2400:x1874668789865216:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826316.243035:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2400:x1874668789865216:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.243041:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3448 00000100:00100000:1.0:1787826316.243052:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3449 00000100:00100000:1.0:1787826316.243058:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668789865728:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826316.243078:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668789865728:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 20us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.243083:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3449 00000100:00100000:1.0:1787826316.243101:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789865344 00000100:00100000:1.0:1787826316.243105:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789865344 00000100:00100000:1.0:1787826316.243135:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789864960 00000100:00100000:1.0:1787826316.243138:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789864960 00000100:00100000:1.0:1787826316.243156:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789865472 00000100:00100000:1.0:1787826316.243158:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789865472 00000100:00100000:1.0:1787826316.243176:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4994 00000100:00100000:1.0:1787826316.243183:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+27:2400:x1874668789865344:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826316.243421:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+27:2400:x1874668789865344:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 238us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.243428:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4994 00000100:00100000:1.0:1787826316.243442:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4995 00000100:00100000:1.0:1787826316.243448:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2400:x1874668789864960:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826316.243472:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2400:x1874668789864960:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.243479:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4995 00000100:00100000:1.0:1787826316.243490:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4996 00000100:00100000:1.0:1787826316.243496:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2400:x1874668789865472:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826316.243519:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2400:x1874668789865472:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.243524:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4996 00000100:00080000:1.0:1787826316.243568:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826316.243572:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826316.243575:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826316.243577:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826317.123620:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778651264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.123687:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.123735:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778651776:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.123761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.123779:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe166412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778652288:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.123801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.123830:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787826317.123837:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778651136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.123886:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.123908:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16641e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778651648:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.123934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.123951:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe166430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778652160:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.123972:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.123989:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778652672:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.124038:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16642940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778651392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124061:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.124080:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778651904:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.124126:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778652416:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.124167:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787826317.124173:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16640780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778651520:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.124214:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778652032:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124235:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.124251:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778652544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826317.124324:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778651264 00000100:00100000:3.0:1787826317.124331:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778651264 00000100:00100000:3.0:1787826317.124375:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778652288 00000100:00100000:3.0:1787826317.124379:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778652288 00000100:00100000:3.0:1787826317.124398:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376 00000100:00100000:3.0:1787826317.124407:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778651264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124459:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778651264:12345-0@lo:400:kworker.0 Request processed in 53us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.124468:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376 00000100:00100000:3.0:1787826317.124485:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3377 00000100:00100000:3.0:1787826317.124492:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778652288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124522:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778652288:12345-0@lo:400:kworker.0 Request processed in 30us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.124528:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3377 00000100:00100000:3.0:1787826317.124547:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778651776 00000100:00100000:3.0:1787826317.124550:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778651776 00000100:00100000:3.0:1787826317.124586:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778652160 00000100:00100000:3.0:1787826317.124589:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778652160 00000100:00100000:3.0:1787826317.124609:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778652416 00000100:00100000:3.0:1787826317.124613:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778652416 00000100:00100000:3.0:1787826317.124632:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778652544 00000100:00100000:3.0:1787826317.124635:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778652544 00000100:00100000:3.0:1787826317.124650:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3450 00000100:00100000:3.0:1787826317.124657:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe100383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778651776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124689:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe100383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778651776:12345-0@lo:400:kworker.0 Request processed in 32us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.124695:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3450 00000100:00100000:3.0:1787826317.124707:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3451 00000100:00100000:3.0:1787826317.124713:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778652160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124740:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778652160:12345-0@lo:400:kworker.0 Request processed in 27us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.124746:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3451 00000100:00100000:3.0:1787826317.124757:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3452 00000100:00100000:3.0:1787826317.124764:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778652416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124796:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778652416:12345-0@lo:400:kworker.0 Request processed in 33us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.124802:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3452 00000100:00100000:3.0:1787826317.124813:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3453 00000100:00100000:3.0:1787826317.124820:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778652544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124848:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778652544:12345-0@lo:400:kworker.0 Request processed in 29us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.124875:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3453 00000100:00100000:3.0:1787826317.124897:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778651136 00000100:00100000:3.0:1787826317.124901:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778651136 00000100:00100000:3.0:1787826317.124928:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1787826317.124935:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf03bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778651136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.124966:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf03bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778651136:12345-0@lo:400:kworker.0 Request processed in 31us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.124972:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1787826317.125003:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778651648 00000100:00100000:3.0:1787826317.125006:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778651648 00000100:00100000:3.0:1787826317.125033:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778652672 00000100:00100000:3.0:1787826317.125036:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778652672 00000100:00100000:3.0:1787826317.125054:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4997 00000100:00100000:3.0:1787826317.125060:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778651648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125090:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778651648:12345-0@lo:400:kworker.0 Request processed in 31us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.125096:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4997 00000100:00100000:3.0:1787826317.125106:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778651392 00000100:00100000:3.0:1787826317.125110:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778651392 00000100:00100000:3.0:1787826317.125129:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778651904 00000100:00100000:3.0:1787826317.125133:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778651904 00000100:00100000:3.0:1787826317.125151:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778651520 00000100:00100000:3.0:1787826317.125155:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778651520 00000100:00100000:3.0:1787826317.125167:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778652032 00000100:00100000:3.0:1787826317.125169:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778652032 00000100:00100000:3.0:1787826317.125183:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4998 00000100:00100000:3.0:1787826317.125189:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778652672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125218:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778652672:12345-0@lo:400:kworker.0 Request processed in 28us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.125223:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4998 00000100:00100000:3.0:1787826317.125235:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4999 00000100:00100000:3.0:1787826317.125241:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778651392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125267:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778651392:12345-0@lo:400:kworker.0 Request processed in 27us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.125273:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4999 00000100:00100000:3.0:1787826317.125284:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5000 00000100:00100000:3.0:1787826317.125289:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778651904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125326:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778651904:12345-0@lo:400:kworker.0 Request processed in 37us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.125332:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5000 00000100:00100000:3.0:1787826317.125345:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5001 00000100:00100000:3.0:1787826317.125352:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778651520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125379:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778651520:12345-0@lo:400:kworker.0 Request processed in 29us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.125385:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5001 00000100:00100000:3.0:1787826317.125396:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5002 00000100:00100000:3.0:1787826317.125403:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778652032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125431:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778652032:12345-0@lo:400:kworker.0 Request processed in 29us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826317.125437:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5002 00000100:00080000:3.0:1787826317.125475:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826317.125479:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826317.125481:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826317.125483:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826317.125536:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16640780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778651520:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125548:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778652032:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125559:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778652544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125569:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16642940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778651392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125577:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778651904:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125586:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778652416:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125715:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778651136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125726:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16641e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778651648:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125736:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe166430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778652160:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125746:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778652672:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125756:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778651264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125765:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778651776:0@lo:400:kworker.0 00000100:00100000:3.0:1787826317.125775:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe166412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778652288:0@lo:400:kworker.0 00000100:00100000:2.0:1787826317.130529:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826317.130554:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778652800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826317.130619:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826317.130756:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778652800 00000100:00100000:1.0:1787826317.130764:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778652800 00000100:00100000:1.0:1787826317.130848:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:1.0:1787826317.130881:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778652800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826317.130911:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:1.0:1787826317.130962:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778652800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826317.130970:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:3.0:1787826317.131053:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778652800:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787826317.188369:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787826317.376264:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826317.376272:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826317.376536:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:3.0:1787826317.376545:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1787826317.633052:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826317.633073:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778652928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826317.633138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826317.633197:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778652928 00000100:00100000:2.0:1787826317.633205:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778652928 00000100:00100000:2.0:1787826317.633250:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:2.0:1787826317.633259:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778652928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826317.633288:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826317.633344:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778652928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826317.633351:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00100000:2.0:1787826317.633400:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778652928:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826318.209993:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826319.171843:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778653056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826319.171929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826319.173309:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778653056 00000100:00100000:2.0:1787826319.173321:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778653056 00000100:00100000:3.0:1787826319.175012:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12804b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778653184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826319.175077:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826319.178983:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778653184 00000100:00100000:2.0:1787826319.178997:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778653184 00000100:00100000:2.0:1787826319.180209:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3378 00000100:00100000:2.0:1787826319.180224:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778653056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826319.180422:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:2.0:1787826319.180498:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778653056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 279us (8569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.180505:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3378 00000100:00100000:0.0:1787826319.181454:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3379 00000100:00100000:0.0:1787826319.181469:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778653184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826319.181493:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1787826319.182198:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778653056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826319.185255:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778653184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3781us (10168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826319.185270:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3379 00000100:00100000:3.0:1787826319.185879:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12804b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778653184:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826319.231990:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.681021:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826319.681041:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e68c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778653440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826319.681104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826319.681153:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778653440 00000100:00100000:1.0:1787826319.681159:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778653440 00000100:00100000:1.0:1787826319.681212:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:1.0:1787826319.681220:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778653440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826319.681246:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:3.0:1787826319.681875:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778653312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826319.681914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826319.681958:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778653312 00000100:00100000:3.0:1787826319.681962:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778653312 00000100:00100000:3.0:1787826319.681987:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:3.0:1787826319.681995:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778653312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826319.682014:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:3.0:1787826319.682049:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778653312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826319.682056:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:3.0:1787826319.682097:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778653312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826319.682104:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778653440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826319.682114:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00080000:1.0:1787826319.682350:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826319.682354:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826319.682378:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e68c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778653440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787826320.256234:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826321.283044:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826321.357991:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826321.358037:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826321.358064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826321.358089:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826321.358116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826321.358141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826321.358158:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826321.358175:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826321.358199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826321.358232:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789865984 00000100:00100000:3.0:1787826321.358243:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789865984 00000100:00100000:1.0:1787826321.358460:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789866240 00000100:00100000:1.0:1787826321.358466:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789866240 00000100:00100000:1.0:1787826321.358502:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789866752 00000100:00100000:1.0:1787826321.358505:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789866752 00000100:00100000:1.0:1787826321.358525:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789866368 00000100:00100000:1.0:1787826321.358528:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789866368 00000100:00100000:1.0:1787826321.358547:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789866880 00000100:00100000:1.0:1787826321.358550:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789866880 00000100:00100000:1.0:1787826321.358570:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3454 00000100:00100000:1.0:1787826321.358581:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789866240:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826321.358672:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789866240:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 92us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.358684:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3454 00000100:00100000:1.0:1787826321.358704:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3455 00000100:00100000:1.0:1787826321.358711:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789866752:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826321.358737:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789866752:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.358743:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3455 00000100:00100000:1.0:1787826321.358754:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3456 00000100:00100000:1.0:1787826321.358760:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789866368:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826321.358783:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789866368:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.358790:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3456 00000100:00100000:1.0:1787826321.358801:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3457 00000100:00100000:1.0:1787826321.358807:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789866880:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826321.358829:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789866880:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.358835:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3457 00000100:00100000:1.0:1787826321.359050:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789866496 00000100:00100000:1.0:1787826321.359056:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789866496 00000100:00100000:1.0:1787826321.359084:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789866112 00000100:00100000:1.0:1787826321.359087:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789866112 00000100:00100000:1.0:1787826321.359105:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789866624 00000100:00100000:1.0:1787826321.359108:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789866624 00000100:00100000:1.0:1787826321.359127:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5003 00000100:00100000:1.0:1787826321.359134:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789865984:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826321.359173:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789865984:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 39us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.359179:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5003 00000100:00100000:1.0:1787826321.359193:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5004 00000100:00100000:1.0:1787826321.359200:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789866496:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826321.359223:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789866496:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.359228:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5004 00000100:00100000:1.0:1787826321.359239:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5005 00000100:00100000:1.0:1787826321.359245:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789866112:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826321.359283:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789866112:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.359289:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5005 00000100:00100000:1.0:1787826321.359301:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5006 00000100:00100000:1.0:1787826321.359307:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789866624:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826321.359341:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789866624:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 34us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.359347:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5006 00000100:00080000:1.0:1787826321.359366:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826321.359371:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826321.359373:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826321.359376:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826321.359403:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789865856 00000100:00100000:1.0:1787826321.359407:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789865856 00000100:00100000:1.0:1787826321.359436:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 779 00000100:00100000:1.0:1787826321.359442:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3d6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789865856:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826321.359469:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3d6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789865856:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.359476:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 779 00000100:00100000:1.0:1787826322.240082:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e68de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778653568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826322.240178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.240294:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778653568 00000100:00100000:1.0:1787826322.240303:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778653568 00000100:00100000:1.0:1787826322.240379:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:1.0:1787826322.240388:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778653568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826322.240425:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:1.0:1787826322.240477:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778653568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826322.240485:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00080000:1.0:1787826322.240512:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826322.240818:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e68de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778653568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826322.241026:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778653696:0@lo:400:kworker.0 00000100:00100000:2.0:1787826322.241085:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.241113:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778654208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826322.241139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.241155:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a1061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778654720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826322.241176:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.241195:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787826322.241200:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778653824:0@lo:400:kworker.0 00000100:00100000:2.0:1787826322.241217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.241231:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778654336:0@lo:400:kworker.0 00000100:00100000:2.0:1787826322.241252:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.241283:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778654848:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.241342:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874668778654080:0@lo:400:kworker.0 00000100:00100000:0.0:1787826322.241437:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778654208 00000100:00100000:0.0:1787826322.241444:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778654208 00000100:00100000:0.0:1787826322.241488:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778654336 00000100:00100000:0.0:1787826322.241491:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778654336 00000100:00100000:0.0:1787826322.241511:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5007 00000100:00100000:0.0:1787826322.241519:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778654208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826322.247328:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.247449:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778653696 00000100:00100000:2.0:1787826322.247460:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778653696 00000100:00100000:1.0:1787826322.248006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.248036:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1787826322.248061:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778653696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826322.248135:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778653696:12345-0@lo:400:kworker.0 Request processed in 78us (7048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826322.248143:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1787826322.248819:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a104b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778654592:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.248885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.248908:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3db75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778655104:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.248937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826322.249773:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778654208:12345-0@lo:400:kworker.0 Request processed in 8249us (8626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826322.249788:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5007 00000100:00100000:3.0:1787826322.250043:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778654720 00000100:00100000:3.0:1787826322.250053:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778654720 00000100:00100000:3.0:1787826322.250114:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778653824 00000100:00100000:3.0:1787826322.250118:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778653824 00000100:00100000:3.0:1787826322.250146:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3380 00000100:00100000:3.0:1787826322.250156:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778654720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826322.250221:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778654720:12345-0@lo:400:kworker.0 Request processed in 67us (9043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826322.250228:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3380 00000100:00100000:3.0:1787826322.250242:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3381 00000100:00100000:3.0:1787826322.250249:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778653824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826322.250295:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778653824:12345-0@lo:400:kworker.0 Request processed in 46us (9076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826322.250301:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3381 00000100:00100000:3.0:1787826322.252093:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778653824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826322.252116:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778653696:0@lo:400:kworker.0 00000100:00100000:3.0:1787826322.252135:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778654208:0@lo:400:kworker.0 00000100:00100000:3.0:1787826322.252149:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a1061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778654720:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.252919:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787826322.252937:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778653952:0@lo:400:kworker.0 00000100:00100000:2.0:1787826322.252946:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778654080 00000100:00100000:2.0:1787826322.252956:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778654080 00000100:00100000:3.0:1787826322.253121:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778655104 00000100:00100000:3.0:1787826322.253126:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778655104 00000100:00100000:3.0:1787826322.253166:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5008 00000100:00100000:3.0:1787826322.253177:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778654336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826322.253231:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5009 00000100:00100000:0.0:1787826322.253244:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874668778654080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826322.253254:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778654336:12345-0@lo:400:kworker.0 Request processed in 77us (11999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826322.253262:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5008 00000100:00100000:3.0:1787826322.253297:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5010 00000100:00100000:0.0:1787826322.253304:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874668778654080:12345-0@lo:400:kworker.0 Request processed in 63us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826322.253308:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778655104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826322.253317:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5009 00000100:00100000:3.0:1787826322.253352:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778655104:12345-0@lo:400:kworker.0 Request processed in 46us (4412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826322.253359:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5010 00000100:00100000:3.0:1787826322.253406:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778654336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.253452:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.253483:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874668778654464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.253513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.253537:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf06fb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778654976:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.253565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.253594:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874668778654080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.253606:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3db75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778655104:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.253632:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778653952 00000100:00100000:1.0:1787826322.253636:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778653952 00000100:00100000:1.0:1787826322.254123:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778654464 00000100:00100000:1.0:1787826322.254129:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778654464 00000100:00100000:1.0:1787826322.254166:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5011 00000100:00100000:1.0:1787826322.254174:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778653952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.254230:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778653952:12345-0@lo:400:kworker.0 Request processed in 56us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826322.254237:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5011 00000100:00100000:1.0:1787826322.254255:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5012 00000100:00100000:1.0:1787826322.254262:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874668778654464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.254303:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874668778654464:12345-0@lo:400:kworker.0 Request processed in 42us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826322.254309:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5012 00000100:00100000:1.0:1787826322.254337:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778654848 00000100:00100000:1.0:1787826322.254341:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778654848 00000100:00100000:1.0:1787826322.254371:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778654592 00000100:00100000:1.0:1787826322.254374:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778654592 00000100:00100000:1.0:1787826322.254393:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778654976 00000100:00100000:1.0:1787826322.254396:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778654976 00000100:00100000:1.0:1787826322.254414:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3458 00000100:00100000:1.0:1787826322.254420:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778654848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.254458:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778654848:12345-0@lo:400:kworker.0 Request processed in 39us (7143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826322.254464:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3458 00000100:00100000:1.0:1787826322.254476:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3459 00000100:00100000:1.0:1787826322.254482:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778654592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.254511:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778654592:12345-0@lo:400:kworker.0 Request processed in 30us (5626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826322.254517:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3459 00000100:00100000:1.0:1787826322.254526:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3460 00000100:00100000:1.0:1787826322.254532:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778654976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.254557:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778654976:12345-0@lo:400:kworker.0 Request processed in 25us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826322.254563:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3460 00000100:00080000:1.0:1787826322.254609:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826322.254614:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826322.254616:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826322.254619:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826322.254650:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778653952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.255210:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874668778654464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.255229:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778654976:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.255245:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a104b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778654592:0@lo:400:kworker.0 00000100:00100000:1.0:1787826322.255305:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf06fb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778654848:0@lo:400:kworker.0 00010000:00010000:0.0:1787826322.312911:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826322.753057:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778655232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826322.753132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.753258:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778655232 00000100:00100000:2.0:1787826322.753275:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778655232 00000100:00100000:2.0:1787826322.753326:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1787826322.753335:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778655232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826322.753364:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826322.753412:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778655232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826322.753420:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1787826322.753465:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778655232:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1787826323.137162:0:39210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787826323.137170:0:39210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826323.138014:0:39210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787826323.138026:0:39210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787826323.328783:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826323.414180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826323.414267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826323.416235:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789867008 00000100:00100000:1.0:1787826323.416246:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789867008 00000100:00100000:1.0:1787826323.416341:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789867136 00000100:00100000:1.0:1787826323.416345:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789867136 00000100:00100000:1.0:1787826323.416368:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3382 00000100:00100000:1.0:1787826323.416378:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+28:2399:x1874668789867008:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826323.416411:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826323.416432:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bdac lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1af expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416502:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416517:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416529:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416543:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416551:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416558:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416602:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416610:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416616:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416623:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826323.416627:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416634:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416645:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826323.416659:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826323.416665:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416672:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349bdb3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416692:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416699:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416712:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416717:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826323.416720:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416727:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416734:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x38af5ca0 (ffff9bbe0bd66f00) 00010000:00010000:1.0:1787826323.416736:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826323.416739:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416745:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bdba lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x38af5ca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416774:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bdac lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1af expref: 29 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416784:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826323.416786:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826323.416789:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bdac lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1af expref: 29 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416798:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc -2) 00000100:00100000:1.0:1787826323.416884:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+28:2399:x1874668789867008:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 507us (2712us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826323.416891:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3382 00000100:00100000:1.0:1787826323.416908:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3383 00000100:00100000:1.0:1787826323.416915:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789867136:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826323.416931:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826323.416939:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bdc1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1b6 expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416961:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416969:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416976:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416987:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416993:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.416999:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417015:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417021:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417027:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417037:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826323.417040:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417046:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417054:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826323.417056:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826323.417059:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417065:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bdc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417074:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417080:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417086:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417091:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826323.417094:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417100:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417110:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x314de02a (ffff9bbe0bd66300) 00010000:00010000:1.0:1787826323.417113:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826323.417116:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417122:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bdcf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417140:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bdc1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1b6 expref: 28 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417147:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826323.417149:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826323.417153:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bdc1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1b6 expref: 28 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826323.417160:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc -2) 00000100:00100000:1.0:1787826323.417182:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789867136:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 267us (2925us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826323.417189:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3383 00000100:00080000:3.0:1787826323.419547:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826324.288048:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826324.288071:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778655360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826324.288143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826324.288211:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778655360 00000100:00100000:2.0:1787826324.288218:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778655360 00000100:00100000:2.0:1787826324.288279:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3384 00000100:00100000:2.0:1787826324.288288:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778655360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826324.288320:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:2.0:1787826324.288366:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778655360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826324.288373:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3384 00000100:00100000:2.0:1787826324.288417:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778655360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826324.288534:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778655488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826324.288566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826324.288617:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778655488 00000100:00100000:3.0:1787826324.288631:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778655488 00000100:00100000:3.0:1787826324.288665:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3385 00000100:00100000:3.0:1787826324.288671:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778655488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826324.288690:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1787826324.288724:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778655488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826324.288729:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3385 00000100:00100000:3.0:1787826324.288781:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778655488:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826324.354215:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826324.800450:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826324.800473:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778655616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826324.800541:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826324.800952:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778655616 00000100:00100000:1.0:1787826324.800961:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778655616 00000100:00100000:1.0:1787826324.801019:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:1.0:1787826324.801029:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778655616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826324.801060:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:1.0:1787826324.801112:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778655616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826324.801122:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00080000:1.0:1787826324.801145:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826324.801178:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778655616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826324.801492:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778655744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826324.801528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826324.805096:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778655744 00000100:00100000:0.0:1787826324.805109:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778655744 00000100:00100000:0.0:1787826324.805999:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1787826324.806013:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778655744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826324.806045:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826324.806122:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778655744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (4594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826324.806130:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:2.0:1787826324.806309:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778655744:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787826324.807260:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826325.380470:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826326.400104:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826326.471298:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826326.471378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826326.471401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826326.471491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826326.471520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826326.471562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826326.472172:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789867392 00000100:00100000:0.0:1787826326.472186:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789867392 00000100:00100000:0.0:1787826326.472280:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789867904 00000100:00100000:0.0:1787826326.472284:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789867904 00000100:00100000:0.0:1787826326.472312:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5013 00000100:00100000:0.0:1787826326.472323:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789867392:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826326.472427:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789867392:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 105us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826326.472436:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5013 00000100:00100000:0.0:1787826326.472458:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5014 00000100:00100000:0.0:1787826326.472465:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789867904:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826326.472491:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789867904:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 27us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826326.472497:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5014 00000100:00080000:0.0:1787826326.472520:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826326.472974:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789867648 00000100:00100000:2.0:1787826326.472979:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789867648 00000100:00100000:2.0:1787826326.473019:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789868160 00000100:00100000:2.0:1787826326.473022:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789868160 00000100:00100000:2.0:1787826326.473045:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3461 00000100:00100000:2.0:1787826326.473053:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789867648:12345-192.168.203.9@tcp:400:kworker.0 00000100:00080000:0.0:1787826326.473371:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826326.473412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826326.473439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826326.473464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826326.473486:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789867776 00000100:00100000:0.0:1787826326.473490:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789867776 00000100:00100000:0.0:1787826326.473521:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789868288 00000100:00100000:0.0:1787826326.473524:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789868288 00000100:00100000:2.0:1787826326.473987:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789867648:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 932us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.473997:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3461 00000100:00100000:2.0:1787826326.474019:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3462 00000100:00100000:2.0:1787826326.474029:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789868160:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826326.474058:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789868160:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.474064:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3462 00000100:00100000:0.0:1787826326.474246:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3463 00000100:00100000:0.0:1787826326.474255:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789867776:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826326.474284:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789867776:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826326.474291:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3463 00000100:00100000:0.0:1787826326.474304:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3464 00000100:00100000:0.0:1787826326.474310:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789868288:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826326.474338:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789868288:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826326.474344:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3464 00000100:00100000:0.0:1787826326.474366:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789867520 00000100:00100000:0.0:1787826326.474371:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789867520 00000100:00100000:0.0:1787826326.474406:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789868032 00000100:00100000:0.0:1787826326.474409:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789868032 00000100:00100000:0.0:1787826326.474432:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5015 00000100:00100000:0.0:1787826326.474438:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789867520:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826326.474471:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789867520:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 32us (2908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826326.474482:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5015 00000100:00100000:0.0:1787826326.474494:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5016 00000100:00100000:0.0:1787826326.474501:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789868032:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826326.474542:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789868032:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 41us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826326.474548:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5016 00000100:00080000:0.0:1787826326.474570:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826326.474574:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826326.474938:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789867264 00000100:00100000:2.0:1787826326.474943:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789867264 00000100:00100000:0.0:1787826326.475033:0:38185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 781 00000100:00100000:0.0:1787826326.475042:0:38185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789867264:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826326.475089:0:38185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789867264:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 49us (3568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826326.475096:0:38185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 781 00000100:00100000:2.0:1787826326.984328:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826326.986815:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789868416 00000100:00100000:0.0:1787826326.986833:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789868416 00000100:00100000:0.0:1787826326.986937:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3386 00000100:00100000:0.0:1787826326.986949:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789868416:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826326.986996:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826326.987025:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349bdd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1bd expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.987100:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988294:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988321:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988349:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988359:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988366:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988428:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988435:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988442:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988449:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826326.988454:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988462:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988476:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826326.988480:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826326.988486:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988493:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bddd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988504:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988510:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988516:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988521:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826326.988523:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988529:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988536:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x314de02a (ffff9bbf0f565700) 00010000:00010000:0.0:1787826326.988539:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826326.988542:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988548:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349bde4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x314de02a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988593:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349bdd6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1bd expref: 28 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988610:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826326.988612:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826326.988616:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349bdd6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1bd expref: 28 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.988626:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc -2) 00000100:00100000:0.0:1787826326.988923:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789868416:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 1974us (4608us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826326.988934:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3386 00000100:00100000:0.0:1787826327.360372:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778656000:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.360464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826327.360520:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778656512:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.360543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826327.360559:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778657024:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.360576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826327.360607:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826327.360612:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778656128:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.360648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826327.360668:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778656640:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.360697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826327.360713:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c030b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778657152:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.360732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826327.360765:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778656000 00000100:00100000:0.0:1787826327.360772:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778656000 00000100:00100000:0.0:1787826327.360818:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778657024 00000100:00100000:0.0:1787826327.360821:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778657024 00000100:00100000:0.0:1787826327.360839:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3387 00000100:00100000:0.0:1787826327.360847:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778656000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.361106:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778656000:12345-0@lo:400:kworker.0 Request processed in 258us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826327.361114:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3387 00000100:00100000:0.0:1787826327.361132:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3388 00000100:00100000:0.0:1787826327.361138:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778657024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.361160:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778657024:12345-0@lo:400:kworker.0 Request processed in 23us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826327.361165:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3388 00000100:00100000:0.0:1787826327.361182:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778656512 00000100:00100000:0.0:1787826327.361185:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778656512 00000100:00100000:0.0:1787826327.361220:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778657152 00000100:00100000:0.0:1787826327.361223:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778657152 00000100:00100000:0.0:1787826327.361252:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3465 00000100:00100000:0.0:1787826327.361257:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778656512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.361285:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778656512:12345-0@lo:400:kworker.0 Request processed in 28us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826327.361291:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3465 00000100:00100000:0.0:1787826327.361300:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3466 00000100:00100000:0.0:1787826327.361305:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778657152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.361326:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778657152:12345-0@lo:400:kworker.0 Request processed in 21us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826327.361331:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3466 00000100:00100000:0.0:1787826327.361351:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778656128 00000100:00100000:0.0:1787826327.361355:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778656128 00000100:00100000:0.0:1787826327.361377:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778656640 00000100:00100000:0.0:1787826327.361379:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778656640 00000100:00100000:0.0:1787826327.361396:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5017 00000100:00100000:0.0:1787826327.361402:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778656128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.361432:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778656128:12345-0@lo:400:kworker.0 Request processed in 31us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826327.361438:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5017 00000100:00100000:0.0:1787826327.361448:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5018 00000100:00100000:0.0:1787826327.361454:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778656640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.361479:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778656640:12345-0@lo:400:kworker.0 Request processed in 26us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826327.361485:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5018 00000100:00100000:3.0:1787826327.361824:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778656256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.361937:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.361971:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09796d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778656768:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.361995:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.362014:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778657280:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.362035:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.362058:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787826327.362066:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778655872:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.362095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.362118:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778656384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.362140:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.362159:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c033840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778656896:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.362180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.362198:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778657408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.362219:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.362266:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778656256 00000100:00100000:3.0:1787826327.362271:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778656256 00000100:00100000:3.0:1787826327.362310:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778656768 00000100:00100000:3.0:1787826327.362313:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778656768 00000100:00100000:3.0:1787826327.362331:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778656384 00000100:00100000:3.0:1787826327.362333:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778656384 00000100:00100000:3.0:1787826327.362349:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778657408 00000100:00100000:3.0:1787826327.362352:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778657408 00000100:00100000:3.0:1787826327.362369:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5019 00000100:00100000:3.0:1787826327.362375:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778656256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.362418:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778656256:12345-0@lo:400:kworker.0 Request processed in 43us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.362425:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5019 00000100:00100000:3.0:1787826327.362440:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5020 00000100:00100000:3.0:1787826327.362447:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778656768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.362475:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778656768:12345-0@lo:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.362480:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5020 00000100:00100000:3.0:1787826327.362491:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5021 00000100:00100000:3.0:1787826327.362498:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778656384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.362524:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778656384:12345-0@lo:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.362529:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5021 00000100:00100000:3.0:1787826327.362540:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5022 00000100:00100000:3.0:1787826327.362546:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778657408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.362572:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778657408:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.362578:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5022 00000100:00100000:3.0:1787826327.362596:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778657280 00000100:00100000:3.0:1787826327.362599:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778657280 00000100:00100000:3.0:1787826327.362623:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778656896 00000100:00100000:3.0:1787826327.362626:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778656896 00000100:00100000:3.0:1787826327.362645:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3467 00000100:00100000:3.0:1787826327.362651:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778657280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826327.362809:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3468 00000100:00100000:2.0:1787826327.362821:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778656896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826327.362880:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778656896:12345-0@lo:400:kworker.0 Request processed in 65us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826327.362886:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3468 00000100:00100000:3.0:1787826327.363025:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778657280:12345-0@lo:400:kworker.0 Request processed in 373us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.363033:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3467 00000100:00100000:3.0:1787826327.363053:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778655872 00000100:00100000:3.0:1787826327.363057:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778655872 00000100:00100000:3.0:1787826327.363085:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1787826327.363091:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778655872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.363122:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778655872:12345-0@lo:400:kworker.0 Request processed in 31us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.363128:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1787826327.363210:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778655872:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.363227:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778656384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.363248:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c033840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778656896:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.363259:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778657408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.363269:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778656256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.363279:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09796d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778656768:0@lo:400:kworker.0 00000100:00100000:3.0:1787826327.363289:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778657280:0@lo:400:kworker.0 00000100:00080000:0.0:1787826327.363661:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826327.363668:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826327.363670:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826327.363674:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826327.364011:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778656128:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.364028:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778656640:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.364041:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c030b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778657152:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.364055:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778656000:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.364080:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778656512:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.364093:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778657024:0@lo:400:kworker.0 00000100:00100000:0.0:1787826327.364132:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e68e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778657536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826327.364189:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826327.364888:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778657536 00000100:00100000:2.0:1787826327.364898:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778657536 00000100:00100000:2.0:1787826327.364962:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:2.0:1787826327.364972:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778657536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826327.365006:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826327.365096:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778657536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826327.365103:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00100000:3.0:1787826327.365614:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e68e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778657536:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787826327.425944:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787826327.619556:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826327.619568:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826327.619908:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:0.0:1787826327.619922:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1787826327.872136:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826327.872168:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778657664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826327.872249:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826327.872374:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778657664 00000100:00100000:2.0:1787826327.872383:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778657664 00000100:00100000:2.0:1787826327.872441:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1787826327.872451:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778657664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826327.872477:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826327.872530:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778657664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826327.872538:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:0.0:1787826327.872611:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778657664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826328.016287:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826328.016336:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826328.016368:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789868672 00000100:00100000:0.0:1787826328.016377:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789868672 00000100:00100000:0.0:1787826328.016446:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789868544 00000100:00100000:0.0:1787826328.016450:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789868544 00000100:00100000:0.0:1787826328.016469:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3389 00000100:00100000:0.0:1787826328.016485:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789868672:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826328.016516:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826328.016535:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bdeb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1cb expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787826328.016713:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826328.017592:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3390 00000100:00100000:3.0:1787826328.017609:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2402:x1874668789868544:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826328.017649:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826328.017666:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349bdf2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1c4 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017718:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017733:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017746:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017761:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017767:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017774:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017817:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017824:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017830:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017836:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826328.017840:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017875:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017887:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826328.017890:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826328.017894:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017901:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349bdf9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017914:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017920:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017926:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017930:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826328.017934:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017941:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017948:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x750ec19b (ffff9bbe08124900) 00010000:00010000:3.0:1787826328.017951:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826328.017954:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017963:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be00 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x750ec19b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.017991:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349bdf2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1c4 expref: 28 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.018002:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826328.018004:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826328.018007:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349bdf2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1c4 expref: 28 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.018017:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc -2) 00000100:00100000:3.0:1787826328.018082:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2402:x1874668789868544:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 480us (1745us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826328.018090:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3390 00010000:00010000:0.0:1787826328.018093:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018107:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018116:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018135:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018142:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018148:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018169:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018176:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018182:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018187:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826328.018190:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018196:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018204:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826328.018207:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826328.018210:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018217:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be07 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018240:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018247:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018252:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018256:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826328.018259:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018264:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018271:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x82454460 (ffff9bbf0f565700) 00010000:00010000:0.0:1787826328.018273:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826328.018276:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018282:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be0e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x82454460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018302:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bdeb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1cb expref: 26 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018310:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826328.018312:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826328.018316:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349bdeb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1cb expref: 26 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.018324:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc -2) 00000100:00100000:0.0:1787826328.018372:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789868672:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 1895us (2095us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826328.018380:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3389 00010000:00010000:1.0:1787826328.450299:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826328.518661:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826328.519037:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789868800 00000100:00100000:0.0:1787826328.519047:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789868800 00000100:00100000:0.0:1787826328.519118:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3391 00000100:00100000:0.0:1787826328.519129:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789868800:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826328.519163:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826328.519183:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be15 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1d2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519249:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519263:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519273:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519286:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519293:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519299:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519333:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519340:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519347:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519353:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826328.519357:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519365:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519375:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826328.519378:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826328.519382:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519398:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349be1c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519410:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519417:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519422:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519428:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826328.519430:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519436:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519442:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x2c8dec01 (ffff9bbe12dd8800) 00010000:00010000:0.0:1787826328.519445:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826328.519448:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519453:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349be23 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x2c8dec01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519479:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be15 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1d2 expref: 26 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519489:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:0.0:1787826328.519491:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826328.519495:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349be15 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1d2 expref: 26 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826328.519503:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc -2) 00000100:00100000:0.0:1787826328.519570:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789868800:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 443us (918us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826328.519578:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3391 00000100:00100000:2.0:1787826328.520934:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826328.520968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826328.521043:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789868928 00000100:00100000:3.0:1787826328.521052:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789868928 00000100:00100000:3.0:1787826328.521093:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789869056 00000100:00100000:3.0:1787826328.521096:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789869056 00000100:00100000:3.0:1787826328.521130:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3392 00000100:00100000:3.0:1787826328.521139:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789868928:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826328.521167:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826328.521184:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349be2a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1d9 expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521238:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521255:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521264:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521278:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521284:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521291:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521320:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521326:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521333:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521339:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826328.521343:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521350:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521359:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826328.521363:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826328.521367:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521373:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349be31 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521386:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521391:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521396:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521401:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826328.521403:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521408:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521415:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x15e242c7 (ffff9bbe08124900) 00010000:00010000:3.0:1787826328.521417:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826328.521419:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521424:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349be38 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x15e242c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521447:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349be2a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1d9 expref: 27 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521456:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826328.521458:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826328.521461:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349be2a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1d9 expref: 27 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521469:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc -2) 00000100:00100000:3.0:1787826328.521519:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789868928:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 382us (591us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826328.521533:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3392 00000100:00100000:3.0:1787826328.521550:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3393 00000100:00100000:3.0:1787826328.521558:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789869056:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826328.521574:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826328.521582:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349be3f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1e0 expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521605:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521612:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521688:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521713:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521724:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521730:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521747:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521753:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521759:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521765:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826328.521768:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521774:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521781:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826328.521784:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826328.521787:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521792:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349be46 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521800:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521806:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521811:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521816:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826328.521819:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521824:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521830:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xbff27b22 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826328.521832:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826328.521834:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.521840:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be4d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xbff27b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.522410:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349be3f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1e0 expref: 26 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.522422:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826328.522424:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826328.522428:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349be3f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1e0 expref: 26 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.522444:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606400, rc -2) 00000100:00100000:3.0:1787826328.522478:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789869056:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 921us (1509us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826328.522486:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3393 00000100:00100000:2.0:1787826329.032972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826329.033023:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826329.033055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826329.033083:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789869312 00000100:00100000:2.0:1787826329.033092:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789869312 00000100:00100000:2.0:1787826329.033149:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789869440 00000100:00100000:2.0:1787826329.033152:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789869440 00000100:00100000:2.0:1787826329.033172:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789869184 00000100:00100000:2.0:1787826329.033175:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789869184 00000100:00100000:2.0:1787826329.033190:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3394 00000100:00100000:2.0:1787826329.033199:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2399:x1874668789869312:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826329.033241:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826329.033273:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349be54 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1ee expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033329:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033343:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033355:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033368:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033376:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033382:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033424:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033430:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033436:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033441:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826329.033445:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033451:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033463:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826329.033466:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826329.033471:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033477:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349be5b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033491:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033496:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033502:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033506:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826329.033508:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033513:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033519:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x355ce988 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826329.033521:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826329.033524:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033529:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349be62 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x355ce988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033555:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349be54 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1ee expref: 28 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033564:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826329.033567:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826329.033571:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349be54 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1ee expref: 28 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033580:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3800, rc -2) 00000100:00100000:2.0:1787826329.033637:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2399:x1874668789869312:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 439us (673us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826329.033644:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3394 00000100:00100000:2.0:1787826329.033663:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3395 00000100:00100000:2.0:1787826329.033670:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2401:x1874668789869440:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826329.033686:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826329.033694:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349be69 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1f5 expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033715:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033722:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033728:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033739:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033746:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033752:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033773:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033779:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033784:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033788:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826329.033790:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033795:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033803:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826329.033806:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826329.033808:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033813:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349be70 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033822:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033826:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033831:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033836:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826329.033838:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033843:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033848:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x8bdd67ea (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826329.033875:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826329.033878:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033884:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349be77 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x8bdd67ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033906:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349be69 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1f5 expref: 27 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033913:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826329.033915:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826329.033918:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349be69 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1f5 expref: 27 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.033925:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc -2) 00000100:00100000:2.0:1787826329.033949:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2401:x1874668789869440:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 280us (926us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826329.033956:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3395 00000100:00100000:2.0:1787826329.033970:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3396 00000100:00100000:2.0:1787826329.033976:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789869184:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826329.033989:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826329.033996:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349be7e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1e7 expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034018:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034026:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034033:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034045:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034051:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034057:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034072:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034078:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034084:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034093:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826329.034096:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034101:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034109:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826329.034111:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826329.034113:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034119:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349be85 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034128:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034134:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034139:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034143:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826329.034145:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034150:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034160:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x956a4c56 (ffff9bbe0fe8cb00) 00010000:00010000:2.0:1787826329.034162:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826329.034165:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034169:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349be8c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x956a4c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034187:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349be7e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1e7 expref: 26 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034195:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826329.034197:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826329.034201:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349be7e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1e7 expref: 26 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826329.034209:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2200, rc -2) 00000100:00100000:2.0:1787826329.034245:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789869184:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 269us (1189us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826329.034252:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3396 00000100:00100000:2.0:1787826329.034639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826329.034969:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789869568 00000100:00100000:3.0:1787826329.034989:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789869568 00000100:00100000:3.0:1787826329.035030:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3397 00000100:00100000:3.0:1787826329.035038:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789869568:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826329.035061:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826329.035075:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349be93 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc1fc expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035106:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035115:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035122:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035145:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035153:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035159:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035181:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035187:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035192:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035198:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826329.035201:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035207:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035226:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826329.035228:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826329.035232:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035236:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349be9a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035248:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035253:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035258:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035263:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826329.035266:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035276:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035283:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xa5f984e (ffff9bbe08124f00) 00010000:00010000:3.0:1787826329.035286:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826329.035288:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035294:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349bea1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xa5f984e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035316:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349be93 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1fc expref: 26 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035324:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:3.0:1787826329.035326:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826329.035330:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349be93 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc1fc expref: 26 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826329.035338:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606400, rc -2) 00000100:00100000:3.0:1787826329.035385:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789869568:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 348us (747us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826329.035392:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3397 00000100:00100000:3.0:1787826329.408875:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778657792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826329.409069:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826329.409578:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826329.409589:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778657920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826329.409633:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826329.410228:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778657792 00000100:00100000:0.0:1787826329.410237:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778657792 00000100:00100000:0.0:1787826329.410326:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778657920 00000100:00100000:0.0:1787826329.410330:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778657920 00000100:00100000:1.0:1787826329.410374:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398 00000100:00100000:1.0:1787826329.410384:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778657792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826329.410416:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1787826329.410476:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778657792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826329.410483:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398 00000100:00100000:1.0:1787826329.410501:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3399 00000100:00100000:1.0:1787826329.410506:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778657920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826329.410521:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:1.0:1787826329.410548:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778657920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826329.410553:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3399 00000100:00100000:2.0:1787826329.410616:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778657920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826329.410632:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778657792:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826329.472093:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826329.542431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826329.542467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826329.542715:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789869696 00000100:00100000:1.0:1787826329.542724:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789869696 00000100:00100000:1.0:1787826329.542768:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789869824 00000100:00100000:1.0:1787826329.542771:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789869824 00000100:00100000:1.0:1787826329.542789:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3400 00000100:00100000:1.0:1787826329.542797:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789869696:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826329.542829:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826329.542848:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349bea8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc203 expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.542930:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.542943:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.542954:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.542967:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.542974:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.542980:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543015:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543021:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543026:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543036:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826329.543040:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543048:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543060:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826329.543063:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826329.543068:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543075:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349beaf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543087:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543103:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543110:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543115:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826329.543118:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543123:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543135:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x2d74f5c0 (ffff9bbe0bd66e00) 00010000:00010000:1.0:1787826329.543137:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826329.543140:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543147:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349beb6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x2d74f5c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543173:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349bea8 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc203 expref: 27 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543181:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826329.543183:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826329.543187:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349bea8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc203 expref: 27 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543196:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7000, rc -2) 00000100:00100000:1.0:1787826329.543265:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789869696:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 467us (842us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826329.543273:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3400 00000100:00100000:1.0:1787826329.543291:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3401 00000100:00100000:1.0:1787826329.543298:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789869824:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826329.543314:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826329.543322:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bebd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc20a expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543348:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543356:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543363:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543373:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543378:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543384:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543401:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543407:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543412:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543416:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826329.543419:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543424:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543432:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826329.543434:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826329.543437:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543442:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bec4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543450:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543456:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543462:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543467:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826329.543469:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543475:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543481:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x3ac905df (ffff9bbe0bd66b00) 00010000:00010000:1.0:1787826329.543484:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826329.543486:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543492:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349becb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x3ac905df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543512:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bebd lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc20a expref: 26 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543520:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826329.543523:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826329.543526:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bebd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc20a expref: 26 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826329.543533:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc -2) 00000100:00100000:1.0:1787826329.543558:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789869824:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 262us (1090us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826329.543565:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3401 00000100:00100000:2.0:1787826329.920288:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778658048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826329.920351:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826329.920431:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778658048 00000100:00100000:2.0:1787826329.920438:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778658048 00000100:00100000:2.0:1787826329.920485:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:2.0:1787826329.920493:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778658048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826329.920522:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826329.920565:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778658048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826329.920571:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00080000:2.0:1787826329.920592:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826329.920948:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778658048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826329.928303:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778658176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826329.928387:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826329.929282:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778658176 00000100:00100000:3.0:1787826329.929291:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778658176 00000100:00100000:3.0:1787826329.929352:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:3.0:1787826329.929363:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778658176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826329.929407:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00080000:0.0:1787826329.931880:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826329.940249:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778658176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10879us (11852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826329.940267:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:1.0:1787826329.945269:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c0312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778658176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826330.076359:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826330.076391:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826330.076407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826330.076426:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826330.076455:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789869952 00000100:00100000:2.0:1787826330.076463:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789869952 00000100:00100000:2.0:1787826330.076512:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789870208 00000100:00100000:2.0:1787826330.076515:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789870208 00000100:00100000:2.0:1787826330.076523:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789870080 00000100:00100000:2.0:1787826330.076525:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789870080 00000100:00100000:2.0:1787826330.076533:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789870336 00000100:00100000:2.0:1787826330.076535:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789870336 00000100:00100000:2.0:1787826330.076546:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3402 00000100:00100000:2.0:1787826330.076553:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2402:x1874668789869952:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826330.076585:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787826330.077238:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3403 00000100:00100000:1.0:1787826330.077253:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2402:x1874668789870208:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826330.077275:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826330.077289:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bed9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc21f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077351:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077367:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077381:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077397:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077404:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077410:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077448:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077454:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077460:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077467:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826330.077471:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077479:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077489:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826330.077492:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826330.077497:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077503:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bee0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077516:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077522:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077527:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077532:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826330.077534:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077540:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077546:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xbb57048b (ffff9bbe0bd66b00) 00010000:00010000:1.0:1787826330.077548:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826330.077550:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077556:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349bee7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xbb57048b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077585:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bed9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc21f expref: 29 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.077595:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826330.077597:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826330.077601:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bed9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc21f expref: 29 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078711:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bed2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc211 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078778:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078792:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078802:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078820:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078827:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078834:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078879:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078887:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078893:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078899:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826330.078903:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078909:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078918:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826330.078922:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826330.078925:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078932:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349beee lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078943:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078949:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078953:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078958:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826330.078960:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078965:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078972:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xc1e906be (ffff9bbe0fe8cb00) 00010000:00010000:2.0:1787826330.078974:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826330.078977:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.078983:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349bef5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xc1e906be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079010:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bed2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc211 expref: 30 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079019:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826330.079022:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826330.079025:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bed2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc211 expref: 30 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079034:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc -2) 00010000:00010000:1.0:1787826330.079196:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc -2) 00000100:00100000:2.0:1787826330.079270:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2402:x1874668789869952:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 2715us (2917us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826330.079280:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3402 00000100:00100000:2.0:1787826330.079311:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3404 00000100:00100000:2.0:1787826330.079322:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2400:x1874668789870080:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826330.079347:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826330.079357:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349befc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc218 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079382:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079390:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079397:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079408:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079419:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079425:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079442:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079448:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079454:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079459:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826330.079462:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079467:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079475:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826330.079477:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826330.079480:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079485:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bf03 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079493:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079499:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079505:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079509:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826330.079512:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079518:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079524:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x15cc60a6 (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826330.079526:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826330.079528:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079532:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf0a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x15cc60a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079550:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349befc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc218 expref: 28 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079557:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:2.0:1787826330.079559:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826330.079562:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349befc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc218 expref: 28 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826330.079574:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3800, rc -2) 00000100:00080000:3.0:1787826330.083485:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826330.087743:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2402:x1874668789870208:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 10484us (11339us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826330.087758:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3403 00000100:00100000:1.0:1787826330.087798:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3405 00000100:00100000:1.0:1787826330.087812:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789870336:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826330.087848:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826330.087892:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349bf11 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc226 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.087946:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.087960:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.087972:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.087986:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.087994:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088000:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088049:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088056:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088063:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088068:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826330.088072:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088079:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088091:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826330.088094:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826330.088098:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088104:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf18 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088115:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088121:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088127:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088133:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826330.088136:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088142:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088149:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x4accb913 (ffff9bbe0bd66e00) 00010000:00010000:1.0:1787826330.088151:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826330.088154:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088159:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf1f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x4accb913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088190:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349bf11 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc226 expref: 27 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088199:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826330.088201:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826330.088204:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349bf11 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc226 expref: 27 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.088224:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7000, rc -2) 00000100:00100000:1.0:1787826330.088284:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789870336:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 478us (11856us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826330.088291:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3405 00000100:00100000:2.0:1787826330.098421:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789870080:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 19090us (22000us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826330.098436:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3404 00010000:00010000:1.0:1787826330.497177:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826330.566586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826330.569911:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789870464 00000100:00100000:1.0:1787826330.569927:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789870464 00000100:00100000:1.0:1787826330.569984:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3406 00000100:00100000:1.0:1787826330.569994:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789870464:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826330.570029:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826330.570049:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf26 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc22d expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570370:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570385:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570398:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570412:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570420:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570427:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570467:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570475:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570488:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570494:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826330.570498:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570507:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570520:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826330.570523:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826330.570528:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570535:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349bf2d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570547:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570554:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570561:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570566:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826330.570569:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570580:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570588:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0xee424977 (ffff9bbe0bd66e00) 00010000:00010000:1.0:1787826330.570590:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826330.570593:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570611:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349bf34 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0xee424977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570642:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf26 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc22d expref: 26 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570653:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9bbe12c67000) 00010000:00010000:1.0:1787826330.570655:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826330.570659:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349bf26 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc22d expref: 26 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826330.570668:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc -2) 00000100:00100000:1.0:1787826330.570835:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789870464:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 841us (4257us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826330.570844:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3406 00010000:00010000:2.0:1787826331.522486:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826331.590150:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826331.590198:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826331.590240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826331.590260:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789870592 00000100:00100000:1.0:1787826331.590267:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826331.590273:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789870592 00000100:00100000:1.0:1787826331.590288:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826331.590313:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826331.590338:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 783 00000100:00100000:1.0:1787826331.590339:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826331.590351:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789870592:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826331.590365:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826331.590387:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826331.590435:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789870592:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826331.590436:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789870720 00000100:00100000:3.0:1787826331.590442:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789870720 00000100:00100000:0.0:1787826331.590447:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 783 00000100:00100000:3.0:1787826331.590478:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789870848 00000100:00100000:3.0:1787826331.590482:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789870848 00000100:00100000:0.0:1787826331.590502:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789870976 00000100:00100000:0.0:1787826331.590507:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789870976 00000100:00100000:3.0:1787826331.590513:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789871232 00000100:00100000:3.0:1787826331.590518:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789871232 00000100:00100000:0.0:1787826331.590547:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789871104 00000100:00100000:3.0:1787826331.590549:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789871360 00000100:00100000:0.0:1787826331.590552:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789871104 00000100:00100000:3.0:1787826331.590555:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789871360 00000100:00100000:0.0:1787826331.590586:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789871488 00000100:00100000:0.0:1787826331.590591:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789871488 00000100:00100000:3.0:1787826331.590593:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5023 00000100:00100000:3.0:1787826331.590603:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789870720:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826331.590621:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789871616 00000100:00100000:0.0:1787826331.590626:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789871616 00000100:00100000:0.0:1787826331.590661:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3469 00000100:00100000:0.0:1787826331.590669:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789870976:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826331.596229:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3470 00000100:00100000:1.0:1787826331.596248:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789871104:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826331.596335:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789871104:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 94us (6046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826331.596343:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3470 00000100:00100000:1.0:1787826331.596366:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3471 00000100:00100000:1.0:1787826331.596374:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789871488:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826331.596402:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789871488:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 29us (6065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826331.596408:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3471 00000100:00100000:1.0:1787826331.596421:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3472 00000100:00100000:1.0:1787826331.596427:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789871616:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826331.596450:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789871616:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (6063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826331.596457:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3472 00000100:00100000:0.0:1787826331.598074:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5024 00000100:00100000:0.0:1787826331.598093:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf06fb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789870848:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826331.598526:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf06fb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789870848:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 66us (7885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826331.598536:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5024 00000100:00100000:0.0:1787826331.598563:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5025 00000100:00100000:0.0:1787826331.598571:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789871232:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826331.598758:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789871232:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 182us (8439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826331.598766:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5025 00000100:00100000:0.0:1787826331.598782:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5026 00000100:00100000:0.0:1787826331.598800:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41275e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789871360:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826331.598830:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41275e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789871360:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 42us (8466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826331.598836:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5026 00000100:00100000:0.0:1787826331.598965:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789870976:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 8296us (8724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826331.598973:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3469 00000100:00080000:0.0:1787826331.599051:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826331.599058:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826331.599062:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826331.599064:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826331.600507:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789870720:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 9899us (10301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826331.600519:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5023 00000100:00100000:3.0:1787826332.486768:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778658304:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.486803:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778658432:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.486849:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826332.486884:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826332.486944:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778658944:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.486951:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778658816:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.486978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826332.486993:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826332.487020:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778659328:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.487059:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826332.487091:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778659840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.487115:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826332.487176:0:38185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778658304 00000100:00100000:3.0:1787826332.487182:0:38185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778658304 00000100:00100000:2.0:1787826332.487230:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778659456:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.487245:0:38185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1787826332.487256:0:38185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778658304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.487264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826332.487294:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778659968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826332.487312:0:38185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778658304:12345-0@lo:400:kworker.0 Request processed in 57us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.487321:0:38185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1787826332.487326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826332.487361:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778658816 00000100:00100000:2.0:1787826332.487363:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778658560:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.487381:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778658816 00000100:00100000:2.0:1787826332.487391:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826332.487418:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778659072:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.487430:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778659840 00000100:00100000:3.0:1787826332.487435:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778659840 00000100:00100000:2.0:1787826332.487446:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826332.488460:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778658944 00000100:00100000:0.0:1787826332.488468:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778658944 00000100:00100000:0.0:1787826332.488509:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778659328 00000100:00100000:0.0:1787826332.488513:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778659328 00000100:00100000:2.0:1787826332.488655:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778659584:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.488697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826332.488720:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826332.488727:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778658688:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.488752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826332.488826:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778658560 00000100:00100000:3.0:1787826332.488831:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778658560 00000100:00100000:3.0:1787826332.488889:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778659072 00000100:00100000:3.0:1787826332.488892:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778659072 00000100:00100000:3.0:1787826332.488918:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5027 00000100:00100000:3.0:1787826332.488926:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778658816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.488973:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778658816:12345-0@lo:400:kworker.0 Request processed in 48us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.488980:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5027 00000100:00100000:3.0:1787826332.488998:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5028 00000100:00100000:3.0:1787826332.489005:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778659840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.489037:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778659584 00000100:00100000:0.0:1787826332.489042:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778659584 00000100:00100000:3.0:1787826332.489052:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778659840:12345-0@lo:400:kworker.0 Request processed in 47us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.489059:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5028 00000100:00100000:0.0:1787826332.489073:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3473 00000100:00100000:3.0:1787826332.489078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5029 00000100:00100000:0.0:1787826332.489086:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778658944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.489090:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778658560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.489138:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778658560:12345-0@lo:400:kworker.0 Request processed in 53us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.489144:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5029 00000100:00100000:0.0:1787826332.489149:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778658944:12345-0@lo:400:kworker.0 Request processed in 65us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.489156:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5030 00000100:00100000:0.0:1787826332.489160:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3473 00000100:00100000:3.0:1787826332.489165:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778659072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.489182:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3474 00000100:00100000:0.0:1787826332.489205:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778659328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.489211:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778659072:12345-0@lo:400:kworker.0 Request processed in 45us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.489219:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5030 00000100:00080000:3.0:1787826332.489246:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826332.489251:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778659328:12345-0@lo:400:kworker.0 Request processed in 59us (2189us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826332.489252:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826332.489256:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826332.489259:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826332.489264:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3474 00000100:00100000:0.0:1787826332.489284:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3475 00000100:00100000:0.0:1787826332.489293:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778659584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.489308:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778659840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.489323:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778658304:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.489331:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778659584:12345-0@lo:400:kworker.0 Request processed in 39us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.489338:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778658816:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.489342:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3475 00000100:00100000:3.0:1787826332.489352:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778659328:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.489389:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778658944:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.490166:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778658432 00000100:00100000:3.0:1787826332.490174:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778658432 00000100:00100000:3.0:1787826332.490228:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778659456 00000100:00100000:3.0:1787826332.490231:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778659456 00000100:00100000:3.0:1787826332.490250:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3407 00000100:00100000:3.0:1787826332.490257:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778658432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.490304:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778658432:12345-0@lo:400:kworker.0 Request processed in 48us (3422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.490311:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3407 00000100:00100000:3.0:1787826332.490323:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3408 00000100:00100000:3.0:1787826332.490328:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778659456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.490357:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778659456:12345-0@lo:400:kworker.0 Request processed in 29us (3093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.490363:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3408 00000100:00100000:0.0:1787826332.493723:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778658432:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.493742:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778659456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.497286:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778659200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.497349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826332.497379:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778659712:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.497406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826332.497445:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778658560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.497457:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778659072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.497467:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778659584:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.497581:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778658688 00000100:00100000:0.0:1787826332.497588:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778658688 00000100:00100000:0.0:1787826332.497651:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778659200 00000100:00100000:0.0:1787826332.497654:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778659200 00000100:00100000:0.0:1787826332.497682:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5031 00000100:00100000:0.0:1787826332.497690:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778658688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.497741:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778658688:12345-0@lo:400:kworker.0 Request processed in 51us (8988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826332.497748:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5031 00000100:00100000:0.0:1787826332.497764:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5032 00000100:00100000:0.0:1787826332.497770:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778659200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.497794:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778659200:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826332.497803:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5032 00000100:00100000:0.0:1787826332.497820:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778659712 00000100:00100000:0.0:1787826332.497824:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778659712 00000100:00100000:0.0:1787826332.497872:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3476 00000100:00100000:0.0:1787826332.497879:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17086d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778659712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.497907:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17086d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778659712:12345-0@lo:400:kworker.0 Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826332.497912:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3476 00000100:00080000:0.0:1787826332.497926:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826332.497930:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826332.497933:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826332.497980:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778659968 00000100:00100000:0.0:1787826332.497984:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778659968 00000100:00100000:0.0:1787826332.498009:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1787826332.498017:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17086580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778659968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826332.498039:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826332.498076:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17086580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778659968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (10751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826332.498082:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1787826332.498125:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778659968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826332.498211:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778658688:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.498224:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778659200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.498234:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778659712:0@lo:400:kworker.0 00010000:00010000:1.0:1787826332.546714:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826332.993035:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17084780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778660096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826332.993211:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826332.993325:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778660096 00000100:00100000:2.0:1787826332.993333:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778660096 00000100:00100000:2.0:1787826332.993388:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:2.0:1787826332.993397:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778660096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826332.993425:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826332.993471:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778660096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826332.993478:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:0.0:1787826332.993555:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17084780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778660096:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1787826333.376072:0:39210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787826333.376081:0:39210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826333.376893:0:39210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787826333.376903:0:39210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787826333.569039:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826334.530049:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826334.530086:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778660224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826334.530157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826334.532041:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778660224 00000100:00100000:0.0:1787826334.532054:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778660224 00000100:00100000:0.0:1787826334.532483:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3409 00000100:00100000:0.0:1787826334.532493:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778660224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826334.532530:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826334.532754:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778660224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 263us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826334.532762:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3409 00000100:00100000:0.0:1787826334.532816:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778660224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826334.533528:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778660352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826334.533584:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826334.535534:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778660352 00000100:00100000:3.0:1787826334.535544:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778660352 00000100:00100000:3.0:1787826334.535597:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3410 00000100:00100000:3.0:1787826334.535607:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778660352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826334.535640:0:45684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:3.0:1787826334.535735:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778660352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826334.535742:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3410 00000100:00100000:1.0:1787826334.535773:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778660352:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826334.600094:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826335.041797:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826335.041819:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778660480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826335.042153:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778660608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826335.042213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.042283:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778660608 00000100:00100000:0.0:1787826335.042291:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778660608 00000100:00100000:3.0:1787826335.042294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.042334:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778660480 00000100:00100000:0.0:1787826335.042338:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778660480 00000100:00080000:3.0:1787826335.042339:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826335.042359:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00080000:3.0:1787826335.042360:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826335.042369:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778660608:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826335.042370:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:3.0:1787826335.042377:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778660480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826335.042396:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00002000:00000024:3.0:1787826335.042396:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:3.0:1787826335.042437:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778660480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.042445:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:3.0:1787826335.042487:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778660480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826335.043390:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778660608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1018us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.043399:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:2.0:1787826335.043755:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778660608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787826335.616300:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826336.641070:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826336.720637:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826336.720676:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826336.720697:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826336.720717:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826336.720736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826336.720757:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826336.720775:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826336.720792:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826336.720827:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826336.720875:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789871744 00000100:00100000:2.0:1787826336.720884:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789871744 00000100:00100000:2.0:1787826336.720930:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 785 00000100:00100000:2.0:1787826336.720939:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789871744:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826336.721004:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789871744:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 66us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.721012:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 785 00000100:00100000:2.0:1787826336.721043:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789872000 00000100:00100000:2.0:1787826336.721046:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789872000 00000100:00100000:2.0:1787826336.721080:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789872512 00000100:00100000:2.0:1787826336.721083:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789872512 00000100:00100000:2.0:1787826336.721101:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789871872 00000100:00100000:2.0:1787826336.721104:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789871872 00000100:00100000:2.0:1787826336.721122:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789872384 00000100:00100000:2.0:1787826336.721124:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789872384 00000100:00100000:2.0:1787826336.721142:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5033 00000100:00100000:2.0:1787826336.721148:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789872000:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826336.721193:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789872000:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 44us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.721201:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5033 00000100:00100000:2.0:1787826336.721214:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5034 00000100:00100000:2.0:1787826336.721219:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789872512:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826336.721247:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789872512:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.721253:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5034 00000100:00100000:2.0:1787826336.721263:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5035 00000100:00100000:2.0:1787826336.721269:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789871872:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826336.721302:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789871872:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 33us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.721308:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5035 00000100:00100000:2.0:1787826336.721320:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5036 00000100:00100000:2.0:1787826336.721325:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789872384:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826336.721351:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789872384:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.721356:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5036 00000100:00100000:2.0:1787826336.721375:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789872256 00000100:00100000:2.0:1787826336.721378:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789872256 00000100:00100000:2.0:1787826336.721406:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789872768 00000100:00100000:2.0:1787826336.721410:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789872768 00000100:00100000:2.0:1787826336.721426:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789872128 00000100:00100000:2.0:1787826336.721429:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789872128 00000100:00100000:2.0:1787826336.721444:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789872640 00000100:00100000:2.0:1787826336.721447:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789872640 00000100:00100000:2.0:1787826336.721470:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3477 00000100:00100000:2.0:1787826336.721476:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2402:x1874668789872256:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826336.721506:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2402:x1874668789872256:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 30us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.721515:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3477 00000100:00100000:2.0:1787826336.721527:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3478 00000100:00100000:2.0:1787826336.721533:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789872768:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826336.721553:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789872768:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.721558:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3478 00000100:00100000:2.0:1787826336.721568:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3479 00000100:00100000:2.0:1787826336.721573:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789872128:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826336.721594:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789872128:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.721599:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3479 00000100:00100000:2.0:1787826336.721608:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3480 00000100:00100000:2.0:1787826336.721614:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789872640:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826336.721632:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789872640:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 18us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.721638:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3480 00000100:00080000:2.0:1787826336.721821:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826336.721825:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826336.721827:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826336.721829:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826337.601628:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778660736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826337.601735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.601839:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778660736 00000100:00100000:0.0:1787826337.601866:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778660736 00000100:00100000:0.0:1787826337.601940:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1787826337.601951:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778660736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826337.601990:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826337.602044:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778660736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.602052:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00080000:0.0:1787826337.602077:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826337.602121:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778660736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826337.610400:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778660992:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.610498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826337.610562:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874668778661504:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.610594:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826337.610621:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778662016:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.610648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826337.610679:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787826337.610686:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778660864:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.610719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826337.610740:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778661376:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.610762:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826337.610779:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778661888:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.610801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826337.610835:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778661504 00000100:00100000:3.0:1787826337.610843:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778661504 00000100:00100000:3.0:1787826337.610932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778661376 00000100:00100000:3.0:1787826337.610936:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778661376 00000100:00100000:3.0:1787826337.610964:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5037 00000100:00100000:3.0:1787826337.610975:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874668778661504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.611035:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874668778661504:12345-0@lo:400:kworker.0 Request processed in 63us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826337.611043:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5037 00000100:00100000:3.0:1787826337.611063:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5038 00000100:00100000:3.0:1787826337.611070:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778661376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.611099:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778661376:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826337.611105:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5038 00000100:00100000:3.0:1787826337.611126:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778662016 00000100:00100000:3.0:1787826337.611129:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778662016 00000100:00100000:3.0:1787826337.611174:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3481 00000100:00100000:3.0:1787826337.611181:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe166412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778662016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.611214:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe166412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778662016:12345-0@lo:400:kworker.0 Request processed in 34us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826337.611220:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3481 00000100:00100000:3.0:1787826337.611274:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778661376:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.611286:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874668778661504:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.611294:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778662016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.613381:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778661120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.613482:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.613534:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778661632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.613561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.613594:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778662144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.613624:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.613656:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826337.613665:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778661248:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.613690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.613711:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778661760:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.613734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.613755:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778662272:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.613781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.613827:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778660992 00000100:00100000:0.0:1787826337.613835:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778660992 00000100:00100000:0.0:1787826337.613918:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778661888 00000100:00100000:0.0:1787826337.613923:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778661888 00000100:00100000:0.0:1787826337.613949:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3411 00000100:00100000:0.0:1787826337.613959:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778660992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614037:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778660992:12345-0@lo:400:kworker.0 Request processed in 79us (3540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.614045:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3411 00000100:00100000:0.0:1787826337.614064:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3412 00000100:00100000:0.0:1787826337.614071:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe166430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778661888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614103:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe166430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778661888:12345-0@lo:400:kworker.0 Request processed in 33us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.614109:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3412 00000100:00100000:0.0:1787826337.614130:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778660864 00000100:00100000:0.0:1787826337.614134:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778660864 00000100:00100000:0.0:1787826337.614180:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1787826337.614188:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778660864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614224:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778660864:12345-0@lo:400:kworker.0 Request processed in 38us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.614231:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00080000:0.0:1787826337.614272:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826337.614279:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826337.614282:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826337.614297:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778662144 00000100:00100000:0.0:1787826337.614301:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778662144 00000100:00100000:0.0:1787826337.614339:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778661760 00000100:00100000:0.0:1787826337.614342:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778661760 00000100:00100000:0.0:1787826337.614367:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3482 00000100:00100000:0.0:1787826337.614374:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778662144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614414:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778662144:12345-0@lo:400:kworker.0 Request processed in 40us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.614423:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3482 00000100:00100000:0.0:1787826337.614437:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3483 00000100:00100000:0.0:1787826337.614443:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778661760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614471:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778661760:12345-0@lo:400:kworker.0 Request processed in 29us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.614478:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3483 00000100:00100000:0.0:1787826337.614496:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778661120 00000100:00100000:0.0:1787826337.614499:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778661120 00000100:00100000:0.0:1787826337.614526:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778661632 00000100:00100000:0.0:1787826337.614529:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778661632 00000100:00100000:0.0:1787826337.614551:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778661248 00000100:00100000:0.0:1787826337.614554:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778661248 00000100:00100000:0.0:1787826337.614574:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778662272 00000100:00100000:0.0:1787826337.614578:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778662272 00000100:00100000:0.0:1787826337.614600:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5039 00000100:00100000:0.0:1787826337.614606:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778661120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614641:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778661120:12345-0@lo:400:kworker.0 Request processed in 36us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.614648:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5039 00000100:00100000:0.0:1787826337.614661:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5040 00000100:00100000:0.0:1787826337.614668:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778661632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614696:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778661632:12345-0@lo:400:kworker.0 Request processed in 31us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.614702:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5040 00000100:00100000:0.0:1787826337.614712:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5041 00000100:00100000:0.0:1787826337.614718:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778661248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614748:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778661248:12345-0@lo:400:kworker.0 Request processed in 30us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.614754:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5041 00000100:00100000:0.0:1787826337.614764:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5042 00000100:00100000:0.0:1787826337.614770:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778662272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614802:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778662272:12345-0@lo:400:kworker.0 Request processed in 32us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.614809:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5042 00000100:00080000:0.0:1787826337.614890:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826337.614893:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826337.614895:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826337.614939:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778661248:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614952:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778661760:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614966:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778662272:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614978:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778661120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.614989:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778661632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.615000:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778662144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.615070:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778660864:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.615084:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778661888:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.615099:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778660992:0@lo:400:kworker.0 00010000:00010000:1.0:1787826337.666732:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787826337.857104:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826337.857117:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826337.857412:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:1.0:1787826337.857423:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1787826338.115167:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826338.115193:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778662400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826338.115256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826338.115342:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778662400 00000100:00100000:0.0:1787826338.115351:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778662400 00000100:00100000:0.0:1787826338.115467:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1787826338.115477:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778662400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826338.115508:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826338.115692:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778662400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 216us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826338.115700:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:2.0:1787826338.116427:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778662400:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826338.690257:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826339.648049:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826339.648073:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778662528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826339.648157:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826339.648301:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778662528 00000100:00100000:0.0:1787826339.648309:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778662528 00000100:00100000:0.0:1787826339.648374:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3413 00000100:00100000:0.0:1787826339.648383:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778662528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826339.648417:0:45684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826339.648466:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778662528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826339.648473:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3413 00000100:00100000:0.0:1787826339.648515:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778662528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826339.648840:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826339.650815:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778662656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826339.650903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826339.650992:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778662656 00000100:00100000:0.0:1787826339.650999:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778662656 00000100:00100000:0.0:1787826339.651052:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3414 00000100:00100000:0.0:1787826339.651061:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778662656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826339.651092:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:0.0:1787826339.651153:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778662656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826339.651160:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3414 00000100:00100000:0.0:1787826339.651204:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778662656:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826339.718526:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826340.164418:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778662784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826340.164489:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826340.164558:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778662784 00000100:00100000:0.0:1787826340.164566:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778662784 00000100:00100000:0.0:1787826340.164626:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:0.0:1787826340.164636:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778662784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826340.164664:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826340.164709:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778662784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826340.164716:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00080000:0.0:1787826340.164736:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826340.164768:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778662784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826340.168097:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826340.168120:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778662912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826340.168196:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826340.172345:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778662912 00000100:00100000:2.0:1787826340.172360:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778662912 00000100:00100000:2.0:1787826340.172444:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:2.0:1787826340.172456:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778662912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826340.172486:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826340.172563:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778662912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (4366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826340.172571:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:1.0:1787826340.172814:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe097943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778662912:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787826340.173222:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826340.736026:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826341.761278:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826341.833072:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826341.833115:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826341.833160:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826341.833182:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789873152 00000100:00100000:0.0:1787826341.833192:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789873152 00000100:00100000:3.0:1787826341.833256:0:38185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789872896 00000100:00100000:0.0:1787826341.833262:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5043 00000100:00100000:3.0:1787826341.833263:0:38185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789872896 00000100:00100000:0.0:1787826341.833277:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789873152:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826341.833303:0:38185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 787 00000100:00100000:3.0:1787826341.833313:0:38185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789872896:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826341.833355:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789873152:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.833363:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5043 00000100:00100000:1.0:1787826341.833384:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789873408 00000100:00080000:0.0:1787826341.833386:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826341.833390:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789873408 00000100:00080000:0.0:1787826341.833418:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826341.833440:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3484 00000100:00100000:1.0:1787826341.833448:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789873408:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826341.833548:0:38185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789872896:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 237us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826341.833555:0:38185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 787 00000100:00100000:2.0:1787826341.836326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826341.836556:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789873664 00000100:00100000:0.0:1787826341.836566:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789873664 00000100:00100000:2.0:1787826341.836622:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826341.836650:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826341.836671:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826341.836689:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826341.836704:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789873024 00000100:00100000:0.0:1787826341.836709:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789873024 00000100:00100000:2.0:1787826341.836717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826341.836741:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789873536 00000100:00100000:0.0:1787826341.836745:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789873536 00000100:00100000:2.0:1787826341.836751:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789873920 00000100:00100000:2.0:1787826341.836757:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789873920 00000100:00100000:2.0:1787826341.836789:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789873280 00000100:00100000:2.0:1787826341.836792:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789873280 00000100:00100000:2.0:1787826341.836810:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789873792 00000100:00100000:2.0:1787826341.836813:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789873792 00000100:00100000:2.0:1787826341.836830:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3485 00000100:00100000:2.0:1787826341.836840:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789873920:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826341.836842:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5044 00000100:00100000:0.0:1787826341.836877:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789873664:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826341.836928:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789873920:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826341.836935:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3485 00000100:00100000:2.0:1787826341.836952:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3486 00000100:00100000:2.0:1787826341.836958:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789873280:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826341.837103:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789873408:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3654us (3941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826341.837112:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3484 00000100:00100000:1.0:1787826341.837151:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3487 00000100:00100000:0.0:1787826341.837155:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789873664:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 301us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826341.837164:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789873792:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826341.837167:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5044 00000100:00100000:0.0:1787826341.837187:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5045 00000100:00100000:0.0:1787826341.837195:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789873024:12345-192.168.203.9@tcp:400:kworker.0 00000100:00080000:3.0:1787826341.837264:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826341.837269:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826341.837272:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826341.837273:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826341.840567:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789873280:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3596us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826341.840582:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3486 00000100:00100000:3.0:1787826341.840954:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5046 00000100:00100000:3.0:1787826341.840971:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789873536:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826341.841125:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789873792:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3963us (4406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826341.841144:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3487 00000100:00100000:0.0:1787826341.841559:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789873024:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 4362us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.841569:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5045 00000100:00100000:3.0:1787826341.843349:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789873536:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 2377us (6650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826341.843362:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5046 00000100:00100000:0.0:1787826342.720591:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778663040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.720674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.720785:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778663040 00000100:00100000:3.0:1787826342.720802:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778663040 00000100:00100000:3.0:1787826342.720882:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1787826342.720892:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778663040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826342.721596:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778663424:0@lo:400:kworker.0 00000100:00100000:1.0:1787826342.721638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826342.721678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778663424 00000100:00100000:1.0:1787826342.721682:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778663424 00000100:00100000:1.0:1787826342.721723:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5047 00000100:00100000:1.0:1787826342.721731:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778663424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826342.721770:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778663424:12345-0@lo:400:kworker.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826342.721777:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5047 00000100:00100000:1.0:1787826342.721827:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778663424:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.724898:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778663040:12345-0@lo:400:kworker.0 Request processed in 3999us (4215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.724912:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00080000:3.0:1787826342.724973:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826342.725517:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778663168:0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.725572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826342.725598:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778663680:0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.725620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826342.725651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778664192:0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.725671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826342.725694:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826342.725700:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778663296:0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.725725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826342.725879:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778663808:0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.725903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826342.725920:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778664320:0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.725939:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826342.725968:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778663680 00000100:00100000:2.0:1787826342.725974:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778663680 00000100:00100000:2.0:1787826342.726020:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778664320 00000100:00100000:2.0:1787826342.726023:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778664320 00000100:00100000:2.0:1787826342.726046:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3488 00000100:00100000:2.0:1787826342.726054:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778663680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.726101:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778663680:12345-0@lo:400:kworker.0 Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826342.726107:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3488 00000100:00100000:2.0:1787826342.726137:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3489 00000100:00100000:2.0:1787826342.726143:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778664320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.726168:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778664320:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826342.726173:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3489 00000100:00100000:2.0:1787826342.726211:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778664320:0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.726222:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778663680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.726312:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778663936:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.726342:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.726369:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778664448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.726389:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.726411:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826342.726417:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778663552:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.726439:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.726455:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778664064:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.726476:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.726492:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778664576:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.726515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.726538:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778664448 00000100:00100000:3.0:1787826342.726542:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778664448 00000100:00100000:3.0:1787826342.726567:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778664064 00000100:00100000:3.0:1787826342.726570:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778664064 00000100:00100000:3.0:1787826342.726592:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3490 00000100:00100000:3.0:1787826342.726598:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16641e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778664448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.726641:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16641e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778664448:12345-0@lo:400:kworker.0 Request processed in 43us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.726647:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3490 00000100:00100000:3.0:1787826342.726659:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3491 00000100:00100000:3.0:1787826342.726665:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778664064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.726692:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778664064:12345-0@lo:400:kworker.0 Request processed in 28us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.726698:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3491 00000100:00080000:3.0:1787826342.726714:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826342.726717:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826342.729637:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778663040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.730089:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778663168 00000100:00100000:0.0:1787826342.730096:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778663168 00000100:00100000:0.0:1787826342.730150:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778664192 00000100:00100000:0.0:1787826342.730152:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778664192 00000100:00100000:0.0:1787826342.730170:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3415 00000100:00100000:0.0:1787826342.730178:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778663168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.730249:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778663168:12345-0@lo:400:kworker.0 Request processed in 72us (4677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826342.730256:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3415 00000100:00100000:0.0:1787826342.730271:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3416 00000100:00100000:0.0:1787826342.730277:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778664192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.730299:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778664192:12345-0@lo:400:kworker.0 Request processed in 23us (4628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826342.730307:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3416 00000100:00100000:0.0:1787826342.730329:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778663296 00000100:00100000:0.0:1787826342.730333:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778663296 00000100:00100000:0.0:1787826342.730368:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778663808 00000100:00100000:0.0:1787826342.730371:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778663808 00000100:00100000:0.0:1787826342.730399:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778663936 00000100:00100000:0.0:1787826342.730402:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778663936 00000100:00100000:0.0:1787826342.730421:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778663552 00000100:00100000:0.0:1787826342.730423:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778663552 00000100:00100000:0.0:1787826342.730443:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778664576 00000100:00100000:0.0:1787826342.730446:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778664576 00000100:00100000:0.0:1787826342.730540:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5048 00000100:00100000:0.0:1787826342.730549:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778663296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.730580:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778663296:12345-0@lo:400:kworker.0 Request processed in 33us (4854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826342.730586:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5048 00000100:00100000:0.0:1787826342.730597:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5049 00000100:00100000:0.0:1787826342.730602:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778663808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.730706:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778663808:12345-0@lo:400:kworker.0 Request processed in 23us (4721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826342.730761:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5049 00000100:00100000:0.0:1787826342.730775:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5050 00000100:00100000:0.0:1787826342.730781:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778663936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.730899:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5051 00000100:00100000:2.0:1787826342.730909:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778663552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826342.730946:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778663552:12345-0@lo:400:kworker.0 Request processed in 39us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826342.730952:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5051 00000100:00100000:2.0:1787826342.730966:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5052 00000100:00100000:0.0:1787826342.730967:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778663936:12345-0@lo:400:kworker.0 Request processed in 186us (4624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826342.730972:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778664576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.730973:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5050 00000100:00100000:2.0:1787826342.731000:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778664576:12345-0@lo:400:kworker.0 Request processed in 29us (4485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826342.731006:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5052 00000100:00100000:0.0:1787826342.731071:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826342.731086:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778664704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826342.731138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826342.731178:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826342.731182:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826342.731204:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778664704 00000100:00100000:0.0:1787826342.731210:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778664704 00000100:00100000:0.0:1787826342.731238:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:0.0:1787826342.731244:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778664704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826342.731266:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826342.731299:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778664704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826342.731305:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:0.0:1787826342.731339:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778664704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826342.731378:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778663296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.731390:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778663808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.731402:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778663168:0@lo:400:kworker.0 00000100:00100000:0.0:1787826342.731413:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778664192:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.732098:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778664064:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.732137:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778664576:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.732149:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778663936:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.732160:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778664448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.732184:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778663552:0@lo:400:kworker.0 00010000:00010000:1.0:1787826342.784080:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826343.238720:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778664832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826343.238797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826343.239980:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778664832 00000100:00100000:3.0:1787826343.239989:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778664832 00000100:00100000:3.0:1787826343.240042:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:3.0:1787826343.240051:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778664832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826343.240082:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:3.0:1787826343.240397:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778664832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 346us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826343.240405:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00100000:0.0:1787826343.240475:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778664832:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1787826343.616114:0:39210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787826343.616132:0:39210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826343.616656:0:39210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787826343.616668:0:39210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787826343.808110:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826344.771115:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826344.771137:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778664960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826344.771217:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826344.771914:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778664960 00000100:00100000:1.0:1787826344.771923:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778664960 00000100:00100000:1.0:1787826344.771974:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3417 00000100:00100000:1.0:1787826344.771983:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778664960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826344.772017:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:1.0:1787826344.772071:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778664960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826344.772079:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3417 00000100:00100000:0.0:1787826344.772482:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778665088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826344.772520:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826344.772576:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778664960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826344.772735:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778665088 00000100:00100000:1.0:1787826344.772739:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778665088 00000100:00100000:1.0:1787826344.772773:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3418 00000100:00100000:1.0:1787826344.772780:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778665088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826344.772804:0:45684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1787826344.772877:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778665088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826344.772883:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3418 00000100:00100000:2.0:1787826344.772957:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778665088:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826344.833561:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826345.283095:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826345.283127:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778665216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826345.283192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826345.283252:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778665216 00000100:00100000:0.0:1787826345.283259:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778665216 00000100:00100000:0.0:1787826345.283308:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:0.0:1787826345.283317:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778665216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826345.283345:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826345.283398:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778665216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826345.283404:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00080000:0.0:1787826345.283425:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826345.283463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778665216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826345.284546:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778665344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826345.284593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826345.284738:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778665344 00000100:00100000:0.0:1787826345.284745:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778665344 00000100:00100000:0.0:1787826345.284797:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:0.0:1787826345.284805:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778665344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826345.284827:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826345.284893:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778665344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826345.284900:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00080000:3.0:1787826345.285045:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826345.285085:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778665344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787826345.859081:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826346.882241:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826346.956022:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826346.956083:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826346.956130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826346.956155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826346.956173:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826346.956192:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826346.956211:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826346.956232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826346.956287:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826346.956337:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789874560 00000100:00100000:2.0:1787826346.956350:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789874560 00000100:00100000:2.0:1787826346.956421:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789875072 00000100:00100000:2.0:1787826346.956425:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789875072 00000100:00100000:2.0:1787826346.956445:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789874432 00000100:00100000:2.0:1787826346.956447:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789874432 00000100:00100000:2.0:1787826346.956462:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789874944 00000100:00100000:2.0:1787826346.956464:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789874944 00000100:00100000:2.0:1787826346.956481:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3492 00000100:00100000:2.0:1787826346.956491:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789874560:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826346.956583:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789874560:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 93us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.956592:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3492 00000100:00100000:2.0:1787826346.956618:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3493 00000100:00100000:2.0:1787826346.956625:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789875072:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826346.956650:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789875072:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.956656:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3493 00000100:00100000:2.0:1787826346.956667:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3494 00000100:00100000:2.0:1787826346.956672:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789874432:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826346.956696:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789874432:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.956702:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3494 00000100:00100000:2.0:1787826346.956712:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3495 00000100:00100000:2.0:1787826346.956717:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789874944:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826346.956736:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789874944:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 20us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.956742:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3495 00000100:00080000:2.0:1787826346.956770:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826346.956775:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826346.957360:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789874304 00000100:00100000:3.0:1787826346.957368:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789874304 00000100:00100000:3.0:1787826346.957418:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789874816 00000100:00100000:3.0:1787826346.957421:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789874816 00000100:00100000:3.0:1787826346.957441:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789874176 00000100:00100000:3.0:1787826346.957445:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789874176 00000100:00100000:3.0:1787826346.957465:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789874688 00000100:00100000:3.0:1787826346.957468:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789874688 00000100:00100000:3.0:1787826346.957487:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5053 00000100:00100000:3.0:1787826346.957495:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789874304:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826346.957786:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5054 00000100:00100000:0.0:1787826346.957798:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789874816:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826346.957925:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789874048 00000100:00100000:1.0:1787826346.957935:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789874048 00000100:00100000:1.0:1787826346.958574:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 789 00000100:00100000:1.0:1787826346.958594:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789874048:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826346.959281:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789874304:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 1781us (3191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826346.959294:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5053 00000100:00100000:3.0:1787826346.959326:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5055 00000100:00100000:3.0:1787826346.959336:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789874176:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826346.959381:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789874176:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 43us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826346.959382:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789874816:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 1580us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826346.959389:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5055 00000100:00100000:3.0:1787826346.959401:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5056 00000100:00100000:0.0:1787826346.959411:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5054 00000100:00100000:3.0:1787826346.959413:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789874688:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826346.959438:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789874688:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826346.959444:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5056 00000100:00080000:3.0:1787826346.960347:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826346.960356:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826346.963772:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789874048:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 5168us (7748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826346.963791:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 789 00000040:00080000:1.0:1787826347.072484:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826347.072498:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826347.072805:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 103 00000040:00080000:1.0:1787826347.072813:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1787826347.841499:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826347.841529:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778665472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826347.841614:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.842179:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778665472 00000100:00100000:3.0:1787826347.842190:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778665472 00000100:00100000:3.0:1787826347.842276:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1787826347.842288:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778665472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826347.842327:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:3.0:1787826347.842393:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778665472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.842402:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1787826347.842661:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778665472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826347.842994:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778665856:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843073:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874668778666368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843127:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778666880:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843172:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787826347.843178:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778665728:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843223:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1874668778666240:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843244:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843261:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778666752:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843311:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778665856 00000100:00100000:3.0:1787826347.843316:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778665856 00000100:00100000:3.0:1787826347.843358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778666368 00000100:00100000:3.0:1787826347.843362:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778666368 00000100:00100000:3.0:1787826347.843384:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778666240 00000100:00100000:3.0:1787826347.843387:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778666240 00000100:00100000:3.0:1787826347.843409:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5057 00000100:00100000:3.0:1787826347.843417:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778665856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843460:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778665856:12345-0@lo:400:kworker.0 Request processed in 45us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.843471:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5057 00000100:00100000:3.0:1787826347.843488:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5058 00000100:00100000:3.0:1787826347.843493:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874668778666368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843521:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874668778666368:12345-0@lo:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.843526:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5058 00000100:00100000:3.0:1787826347.843537:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5059 00000100:00100000:3.0:1787826347.843543:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874668778666240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843568:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874668778666240:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.843574:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5059 00000100:00100000:3.0:1787826347.843597:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778665728 00000100:00100000:3.0:1787826347.843601:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778665728 00000100:00100000:3.0:1787826347.843627:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3419 00000100:00100000:3.0:1787826347.843633:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778665728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843666:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778665728:12345-0@lo:400:kworker.0 Request processed in 33us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.843671:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3419 00000100:00100000:3.0:1787826347.843692:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778665600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843723:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843747:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778666112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843771:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843790:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778666624:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843811:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843831:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787826347.843837:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1874668778665984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843881:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843899:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778666496:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.843961:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778667008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.843983:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826347.844010:0:38185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778665600 00000100:00100000:3.0:1787826347.844014:0:38185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778665600 00000100:00100000:3.0:1787826347.844045:0:38185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1787826347.844051:0:38185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf11610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778665600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844097:0:38185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf11610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778665600:12345-0@lo:400:kworker.0 Request processed in 34us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.844104:0:38185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1787826347.844136:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778666112 00000100:00100000:3.0:1787826347.844139:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778666112 00000100:00100000:3.0:1787826347.844164:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778665984 00000100:00100000:3.0:1787826347.844167:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778665984 00000100:00100000:3.0:1787826347.844182:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778667008 00000100:00100000:3.0:1787826347.844185:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778667008 00000100:00100000:3.0:1787826347.844198:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5060 00000100:00100000:3.0:1787826347.844203:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778666112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844230:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778666112:12345-0@lo:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.844235:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5060 00000100:00100000:3.0:1787826347.844245:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5061 00000100:00100000:3.0:1787826347.844250:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874668778665984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844274:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874668778665984:12345-0@lo:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.844279:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5061 00000100:00100000:3.0:1787826347.844287:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5062 00000100:00100000:3.0:1787826347.844293:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778667008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844314:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778667008:12345-0@lo:400:kworker.0 Request processed in 21us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.844319:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5062 00000100:00100000:3.0:1787826347.844354:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778665728:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844366:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1874668778666240:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844377:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778665856:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844386:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874668778666368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844439:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1874668778665984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844449:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778667008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844456:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778665600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844464:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778666112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844640:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778666624 00000100:00100000:3.0:1787826347.844645:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778666624 00000100:00100000:3.0:1787826347.844668:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3420 00000100:00100000:3.0:1787826347.844674:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778666624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826347.844712:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778666624:12345-0@lo:400:kworker.0 Request processed in 38us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826347.844722:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3420 00000100:00100000:3.0:1787826347.844753:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778666624:0@lo:400:kworker.0 00000100:00100000:2.0:1787826347.845138:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778666880 00000100:00100000:2.0:1787826347.845143:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778666880 00000100:00100000:2.0:1787826347.845182:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778666752 00000100:00100000:2.0:1787826347.845186:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778666752 00000100:00100000:2.0:1787826347.845207:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778666496 00000100:00100000:2.0:1787826347.845210:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778666496 00000100:00100000:2.0:1787826347.845229:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3496 00000100:00100000:2.0:1787826347.845236:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778666880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826347.845277:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778666880:12345-0@lo:400:kworker.0 Request processed in 43us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826347.845284:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3496 00000100:00100000:2.0:1787826347.845295:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3497 00000100:00100000:2.0:1787826347.845300:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778666752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826347.845326:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778666752:12345-0@lo:400:kworker.0 Request processed in 27us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826347.845332:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3497 00000100:00100000:2.0:1787826347.845340:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3498 00000100:00100000:2.0:1787826347.845345:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778666496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826347.845375:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778666496:12345-0@lo:400:kworker.0 Request processed in 30us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826347.845381:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3498 00000100:00100000:2.0:1787826347.845413:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778666752:0@lo:400:kworker.0 00000100:00100000:2.0:1787826347.845424:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778666880:0@lo:400:kworker.0 00000100:00080000:2.0:1787826347.845448:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826347.845453:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826347.845455:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826347.845457:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826347.845469:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778666496:0@lo:400:kworker.0 00010000:00010000:0.0:1787826347.912470:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826348.352126:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778667136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826348.352260:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826348.352363:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778667136 00000100:00100000:0.0:1787826348.352372:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778667136 00000100:00100000:0.0:1787826348.352428:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:0.0:1787826348.352437:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778667136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826348.352471:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826348.352533:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778667136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826348.352542:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00100000:0.0:1787826348.352599:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778667136:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826348.930439:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826349.888136:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778667264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826349.888251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826349.888261:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e80a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778667392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826349.888337:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778667264 00000100:00100000:1.0:1787826349.888347:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778667264 00000100:00100000:1.0:1787826349.888414:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3421 00000100:00100000:1.0:1787826349.888425:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778667264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826349.888476:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826349.894622:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826349.894966:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778667392 00000100:00100000:3.0:1787826349.894978:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778667392 00000100:00100000:3.0:1787826349.895053:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3422 00000100:00100000:3.0:1787826349.895065:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778667392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826349.895126:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:3.0:1787826349.895235:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778667392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (3515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826349.895244:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3422 00000100:00100000:1.0:1787826349.897982:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778667264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9547us (9719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826349.898068:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3421 00000100:00100000:3.0:1787826349.898118:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778667264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826349.901563:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e80a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778667392:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787826349.955741:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826350.400057:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826350.400089:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778667520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826350.400157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826350.400222:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778667520 00000100:00100000:0.0:1787826350.400228:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778667520 00000100:00100000:0.0:1787826350.400281:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:0.0:1787826350.400291:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778667520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826350.400322:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826350.400366:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778667520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826350.400373:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00080000:0.0:1787826350.400392:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826350.400422:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778667520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826350.409640:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826350.409661:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778667648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826350.409724:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826350.409780:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778667648 00000100:00100000:0.0:1787826350.409787:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778667648 00000100:00100000:0.0:1787826350.409836:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:0.0:1787826350.409845:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778667648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826350.409894:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826350.409937:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778667648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826350.409943:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00080000:0.0:1787826350.409980:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826350.410010:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778667648:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787826350.982043:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826352.000686:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826352.075047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826352.075106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826352.075138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826352.075168:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826352.075191:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826352.075219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826352.075235:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789875200 00000100:00100000:3.0:1787826352.075248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826352.075251:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789875200 00000100:00100000:3.0:1787826352.075281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826352.075317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826352.075330:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 791 00000100:00100000:2.0:1787826352.075342:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789875200:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.075359:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789875712 00000100:00100000:3.0:1787826352.075368:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789875712 00000100:00100000:2.0:1787826352.075429:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789875200:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 87us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826352.075438:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 791 00000100:00100000:3.0:1787826352.075450:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789876224 00000100:00100000:3.0:1787826352.075456:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789876224 00000100:00100000:3.0:1787826352.075493:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789875584 00000100:00100000:3.0:1787826352.075497:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789875584 00000100:00100000:3.0:1787826352.075523:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789876096 00000100:00100000:3.0:1787826352.075526:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789876096 00000100:00100000:3.0:1787826352.075551:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3499 00000100:00100000:3.0:1787826352.075561:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2402:x1874668789875712:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.075641:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2402:x1874668789875712:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 82us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.075650:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3499 00000100:00100000:3.0:1787826352.075668:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3500 00000100:00100000:3.0:1787826352.075675:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789876224:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.075704:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789876224:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.075711:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3500 00000100:00100000:3.0:1787826352.075724:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3501 00000100:00100000:3.0:1787826352.075731:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789875584:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.075757:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789875584:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.075764:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3501 00000100:00100000:3.0:1787826352.075775:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3502 00000100:00100000:3.0:1787826352.075783:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789876096:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.075812:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789876096:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.075818:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3502 00000100:00100000:3.0:1787826352.075840:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789875456 00000100:00100000:3.0:1787826352.075845:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789875456 00000100:00100000:3.0:1787826352.075921:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789875968 00000100:00100000:3.0:1787826352.075925:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789875968 00000100:00100000:3.0:1787826352.075945:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789875328 00000100:00100000:3.0:1787826352.075947:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789875328 00000100:00100000:3.0:1787826352.075965:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789875840 00000100:00100000:3.0:1787826352.075968:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789875840 00000100:00100000:3.0:1787826352.075991:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5063 00000100:00100000:3.0:1787826352.075998:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789875456:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.076032:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789875456:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 34us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.076039:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5063 00000100:00100000:3.0:1787826352.076068:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5064 00000100:00100000:3.0:1787826352.076077:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789875968:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.076106:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789875968:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.076113:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5064 00000100:00100000:3.0:1787826352.076128:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5065 00000100:00100000:3.0:1787826352.076136:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789875328:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.076168:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789875328:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 34us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.076175:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5065 00000100:00100000:3.0:1787826352.076189:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5066 00000100:00100000:3.0:1787826352.076196:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789875840:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.076224:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789875840:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 29us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.076232:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5066 00000100:00080000:3.0:1787826352.076279:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826352.076285:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826352.076288:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826352.076293:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826352.960461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778667904:0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.960525:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778667776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826352.960716:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778668032:0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.963391:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826352.963461:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778668288:0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.963494:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826352.963519:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778668800:0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.963542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826352.963562:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778669312:0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.963584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826352.963634:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778667776 00000100:00100000:2.0:1787826352.963641:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778667776 00000100:00100000:2.0:1787826352.963694:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:2.0:1787826352.963703:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778667776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826352.963733:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826352.963777:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778667776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826352.963784:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:2.0:1787826352.963805:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778668288 00000100:00100000:2.0:1787826352.963809:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778668288 00000100:00100000:2.0:1787826352.963836:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778668800 00000100:00100000:2.0:1787826352.963839:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778668800 00000100:00100000:2.0:1787826352.964015:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5067 00000100:00100000:2.0:1787826352.964024:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778668288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.964071:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778668288:12345-0@lo:400:kworker.0 Request processed in 49us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826352.964077:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5067 00000100:00100000:2.0:1787826352.964088:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5068 00000100:00100000:2.0:1787826352.964094:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778668800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.964122:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778668800:12345-0@lo:400:kworker.0 Request processed in 28us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826352.964127:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5068 00000100:00100000:2.0:1787826352.964149:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778669312 00000100:00100000:2.0:1787826352.964153:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778669312 00000100:00100000:2.0:1787826352.964181:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3503 00000100:00100000:2.0:1787826352.964187:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778669312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.964216:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778669312:12345-0@lo:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826352.964222:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3503 00000100:00080000:2.0:1787826352.964238:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826352.964242:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826352.964244:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826352.964246:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826352.964295:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778667776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826352.964308:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778668288:0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.964320:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778668800:0@lo:400:kworker.0 00000100:00100000:2.0:1787826352.964333:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778669312:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826352.967082:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1874668778668416:0@lo:400:kworker.0 00000100:00100000:3.0:1787826352.967101:0:38188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778667904 00000100:00100000:3.0:1787826352.967111:0:38188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778667904 00000100:00100000:0.0:1787826352.967133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826352.967160:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778668928:0@lo:400:kworker.0 00000100:00100000:3.0:1787826352.967186:0:38188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:0.0:1787826352.967192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826352.967201:0:38188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778667904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967216:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778669440:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826352.967269:0:38188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778667904:12345-0@lo:400:kworker.0 Request processed in 71us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.967278:0:38188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:0.0:1787826352.967290:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778667904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967322:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874668778668160:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826352.967372:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874668778668672:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967394:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826352.967412:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778669184:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967433:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826352.967477:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778668416 00000100:00100000:0.0:1787826352.967481:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778668416 00000100:00100000:0.0:1787826352.967517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778669440 00000100:00100000:0.0:1787826352.967520:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778669440 00000100:00100000:0.0:1787826352.967535:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778668160 00000100:00100000:0.0:1787826352.967537:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778668160 00000100:00100000:0.0:1787826352.967551:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778668672 00000100:00100000:0.0:1787826352.967553:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778668672 00000100:00100000:0.0:1787826352.967569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5069 00000100:00100000:0.0:1787826352.967575:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874668778668416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967611:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874668778668416:12345-0@lo:400:kworker.0 Request processed in 36us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.967617:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5069 00000100:00100000:0.0:1787826352.967630:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5070 00000100:00100000:0.0:1787826352.967636:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778669440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967664:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778669440:12345-0@lo:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.967670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5070 00000100:00100000:0.0:1787826352.967683:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5071 00000100:00100000:0.0:1787826352.967689:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874668778668160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967721:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874668778668160:12345-0@lo:400:kworker.0 Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.967726:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5071 00000100:00100000:0.0:1787826352.967737:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5072 00000100:00100000:0.0:1787826352.967743:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874668778668672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967770:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874668778668672:12345-0@lo:400:kworker.0 Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.967776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5072 00000100:00100000:0.0:1787826352.967793:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778668928 00000100:00100000:0.0:1787826352.967796:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778668928 00000100:00100000:0.0:1787826352.967821:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778669184 00000100:00100000:0.0:1787826352.967823:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778669184 00000100:00100000:0.0:1787826352.967843:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504 00000100:00100000:0.0:1787826352.967868:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778668928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.967982:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778668928:12345-0@lo:400:kworker.0 Request processed in 132us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.967989:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504 00000100:00100000:0.0:1787826352.968001:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3505 00000100:00100000:0.0:1787826352.968008:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778669184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.968036:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778669184:12345-0@lo:400:kworker.0 Request processed in 30us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.968042:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3505 00000100:00100000:0.0:1787826352.968104:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874668778668160:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.968114:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874668778668672:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.968122:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778669184:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.968151:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1874668778668416:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.968161:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778668928:0@lo:400:kworker.0 00000100:00100000:0.0:1787826352.968170:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778669440:0@lo:400:kworker.0 00000100:00080000:2.0:1787826352.968413:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826352.968418:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826352.968420:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826352.968422:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826352.969312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826352.969347:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778668032 00000100:00100000:1.0:1787826352.969354:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778668032 00000100:00100000:1.0:1787826352.969396:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3423 00000100:00100000:1.0:1787826352.969405:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778668032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826352.969452:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778668032:12345-0@lo:400:kworker.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826352.969458:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3423 00000100:00100000:1.0:1787826352.969495:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778668032:0@lo:400:kworker.0 00000100:00100000:1.0:1787826352.969504:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778668544:0@lo:400:kworker.0 00000100:00100000:1.0:1787826352.969529:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826352.969548:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778669056:0@lo:400:kworker.0 00000100:00100000:1.0:1787826352.969571:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826352.969591:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778669056 00000100:00100000:1.0:1787826352.969594:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778669056 00000100:00100000:1.0:1787826352.969618:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3424 00000100:00100000:1.0:1787826352.969624:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe02259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778669056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826352.969653:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe02259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778669056:12345-0@lo:400:kworker.0 Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826352.969658:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3424 00000100:00100000:1.0:1787826352.969893:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778669056:0@lo:400:kworker.0 00000100:00100000:3.0:1787826352.972646:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778668544 00000100:00100000:3.0:1787826352.972656:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778668544 00000100:00100000:3.0:1787826352.972718:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3506 00000100:00100000:3.0:1787826352.972728:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e80a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778668544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826352.972815:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e80a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778668544:12345-0@lo:400:kworker.0 Request processed in 88us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.972822:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3506 00000100:00100000:1.0:1787826352.973023:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778668544:0@lo:400:kworker.0 00010000:00010000:3.0:1787826353.024233:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826353.473139:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778669568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826353.473220:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826353.473380:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778669568 00000100:00100000:2.0:1787826353.473389:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778669568 00000100:00100000:2.0:1787826353.473441:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:2.0:1787826353.473450:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778669568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826353.473480:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826353.473546:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778669568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826353.473553:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00100000:3.0:1787826353.473738:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778669568:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1787826353.856150:0:39210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787826353.856159:0:39210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826353.856724:0:39210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787826353.856733:0:39210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787826354.048781:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826355.009561:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778669696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826355.009624:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826355.009691:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826355.009698:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778669824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826355.009720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826355.009744:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778669696 00000100:00100000:3.0:1787826355.009749:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778669696 00000100:00100000:3.0:1787826355.009785:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778669824 00000100:00100000:3.0:1787826355.009787:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778669824 00000100:00100000:3.0:1787826355.009804:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3425 00000100:00100000:3.0:1787826355.009811:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778669696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826355.009871:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1787826355.009909:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778669696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826355.009925:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3425 00000100:00100000:3.0:1787826355.009941:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3426 00000100:00100000:3.0:1787826355.009947:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778669824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826355.009960:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:3.0:1787826355.009986:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778669824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826355.009991:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3426 00000100:00100000:3.0:1787826355.010031:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778669824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826355.010068:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778669696:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826355.072379:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826355.520198:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826355.520222:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778669952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826355.520289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826355.520570:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778669952 00000100:00100000:2.0:1787826355.520576:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778669952 00000100:00100000:2.0:1787826355.520631:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:2.0:1787826355.520641:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778669952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826355.520669:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826355.520716:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778669952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826355.520724:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00080000:2.0:1787826355.520745:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826355.520781:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778669952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826355.520871:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778670080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826355.520907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826355.521695:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778670080 00000100:00100000:2.0:1787826355.521701:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778670080 00000100:00100000:2.0:1787826355.521789:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:2.0:1787826355.521798:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778670080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826355.521820:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826355.521895:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778670080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826355.521902:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:1.0:1787826355.521989:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778670080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787826355.526073:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787826356.106618:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826357.120085:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826357.190869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826357.190913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826357.190924:0:38185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789876352 00000100:00100000:1.0:1787826357.190933:0:38185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789876352 00000100:00100000:3.0:1787826357.190935:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789876480 00000100:00100000:3.0:1787826357.190938:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789876480 00000100:00100000:1.0:1787826357.190976:0:38185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 793 00000100:00100000:3.0:1787826357.190976:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5073 00000100:00100000:1.0:1787826357.190985:0:38185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789876352:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826357.190985:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789876480:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826357.191054:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789876480:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826357.191065:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5073 00000100:00080000:3.0:1787826357.191086:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826357.204956:0:38185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789876352:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 13961us (14101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826357.204971:0:38185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 793 00000100:00100000:3.0:1787826357.204978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826357.205104:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826357.205181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826357.205204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826357.205633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826357.205647:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789876864 00000100:00100000:1.0:1787826357.205654:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789876864 00000100:00100000:1.0:1787826357.205709:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789877376 00000100:00100000:1.0:1787826357.205712:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789877376 00000100:00100000:1.0:1787826357.205883:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3507 00000100:00100000:1.0:1787826357.205893:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789876864:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826357.205945:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789876864:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 54us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826357.205951:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3507 00000100:00100000:1.0:1787826357.205965:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3508 00000100:00100000:1.0:1787826357.205971:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789877376:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826357.205990:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789877376:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826357.205998:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3508 00000100:00100000:3.0:1787826357.206134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826357.206201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826357.206376:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789876608 00000100:00100000:3.0:1787826357.206380:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789876608 00000100:00100000:3.0:1787826357.206412:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789877120 00000100:00100000:3.0:1787826357.206415:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789877120 00000100:00100000:3.0:1787826357.206431:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789876992 00000100:00100000:3.0:1787826357.206433:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789876992 00000100:00100000:3.0:1787826357.206453:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5074 00000100:00100000:3.0:1787826357.206460:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789876608:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826357.206494:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789876608:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 36us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826357.206500:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5074 00000100:00100000:3.0:1787826357.206512:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5075 00000100:00100000:3.0:1787826357.206518:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789877120:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826357.206556:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789877120:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 39us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826357.206562:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5075 00000100:00100000:3.0:1787826357.206573:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5076 00000100:00100000:3.0:1787826357.206580:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789876992:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826357.206603:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+27:2402:x1874668789876992:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826357.206621:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5076 00000100:00100000:1.0:1787826357.207014:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789876736 00000100:00100000:1.0:1787826357.207020:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789876736 00000100:00100000:1.0:1787826357.207059:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789877248 00000100:00100000:1.0:1787826357.207062:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789877248 00000100:00100000:1.0:1787826357.207080:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3509 00000100:00100000:1.0:1787826357.207087:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789876736:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826357.207117:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789876736:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826357.207123:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3509 00000100:00100000:1.0:1787826357.207138:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3510 00000100:00100000:1.0:1787826357.207145:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789877248:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826357.207168:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789877248:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826357.207174:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3510 00000100:00080000:3.0:1787826357.207317:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826357.207322:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826357.207324:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826357.207326:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787826357.312002:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826357.312013:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826357.312827:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9704 count 52 00000040:00080000:3.0:1787826357.312838:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1787826358.080146:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778670208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826358.080223:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826358.080330:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778670208 00000100:00100000:2.0:1787826358.080338:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778670208 00000100:00100000:2.0:1787826358.080403:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:2.0:1787826358.080423:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778670208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826358.080451:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826358.080496:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778670208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826358.080503:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00080000:3.0:1787826358.080652:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826358.080721:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778670208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826358.081992:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778670592:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826358.082083:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778671104:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082104:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826358.082118:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778671616:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826358.082160:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787826358.082166:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778670720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826358.082212:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778671232:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826358.082251:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778671744:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082271:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826358.082299:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778670592 00000100:00100000:2.0:1787826358.082304:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778670592 00000100:00100000:2.0:1787826358.082336:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778671104 00000100:00100000:2.0:1787826358.082339:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778671104 00000100:00100000:2.0:1787826358.082357:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778670720 00000100:00100000:2.0:1787826358.082359:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778670720 00000100:00100000:2.0:1787826358.082373:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778671744 00000100:00100000:2.0:1787826358.082376:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778671744 00000100:00100000:2.0:1787826358.082391:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5077 00000100:00100000:2.0:1787826358.082397:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778670592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082449:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778670592:12345-0@lo:400:kworker.0 Request processed in 52us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826358.082455:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5077 00000100:00100000:2.0:1787826358.082468:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5078 00000100:00100000:2.0:1787826358.082474:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778671104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082498:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778671104:12345-0@lo:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826358.082503:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5078 00000100:00100000:2.0:1787826358.082512:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5079 00000100:00100000:2.0:1787826358.082528:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778670720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082551:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778670720:12345-0@lo:400:kworker.0 Request processed in 23us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826358.082556:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5079 00000100:00100000:2.0:1787826358.082566:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5080 00000100:00100000:2.0:1787826358.082571:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778671744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.082769:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778671744:12345-0@lo:400:kworker.0 Request processed in 196us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826358.082775:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5080 00000100:00100000:2.0:1787826358.082794:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778671616 00000100:00100000:2.0:1787826358.082797:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778671616 00000100:00100000:2.0:1787826358.082820:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778671232 00000100:00100000:2.0:1787826358.082823:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778671232 00000100:00100000:2.0:1787826358.082842:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3511 00000100:00100000:2.0:1787826358.082848:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778671616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826358.082986:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778670464:0@lo:400:kworker.0 00000100:00100000:0.0:1787826358.083028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826358.083046:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1874668778670976:0@lo:400:kworker.0 00000100:00100000:0.0:1787826358.083066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826358.083087:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778671488:0@lo:400:kworker.0 00000100:00100000:0.0:1787826358.083107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826358.083126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787826358.083132:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778670336:0@lo:400:kworker.0 00000100:00100000:0.0:1787826358.083159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826358.083179:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1874668778670848:0@lo:400:kworker.0 00000100:00100000:0.0:1787826358.083201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826358.083214:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778671360:0@lo:400:kworker.0 00000100:00100000:0.0:1787826358.083232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826358.083254:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778671488 00000100:00100000:0.0:1787826358.083257:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778671488 00000100:00100000:0.0:1787826358.083281:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3512 00000100:00100000:0.0:1787826358.083288:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778671232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826358.083318:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778671232:12345-0@lo:400:kworker.0 Request processed in 30us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826358.083324:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3512 00000100:00100000:0.0:1787826358.083335:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3513 00000100:00100000:0.0:1787826358.083341:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778671488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826358.083371:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778671488:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826358.083377:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3513 00000100:00100000:0.0:1787826358.083419:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778671488:0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.083561:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778670976 00000100:00100000:3.0:1787826358.083566:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778670976 00000100:00100000:3.0:1787826358.083605:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778670848 00000100:00100000:3.0:1787826358.083608:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778670848 00000100:00100000:3.0:1787826358.083624:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5081 00000100:00100000:3.0:1787826358.083631:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874668778670976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.083669:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874668778670976:12345-0@lo:400:kworker.0 Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826358.083674:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5081 00000100:00100000:3.0:1787826358.083686:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5082 00000100:00100000:3.0:1787826358.083693:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874668778670848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.083720:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874668778670848:12345-0@lo:400:kworker.0 Request processed in 28us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826358.083726:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5082 00000100:00080000:3.0:1787826358.083750:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826358.083754:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826358.083756:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826358.083758:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826358.083773:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778670464 00000100:00100000:3.0:1787826358.083777:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778670464 00000100:00100000:3.0:1787826358.083796:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778671360 00000100:00100000:3.0:1787826358.083798:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778671360 00000100:00100000:3.0:1787826358.083813:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3427 00000100:00100000:3.0:1787826358.083819:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778670464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.083849:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778670464:12345-0@lo:400:kworker.0 Request processed in 30us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826358.083880:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3427 00000100:00100000:3.0:1787826358.083892:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3428 00000100:00100000:2.0:1787826358.084048:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778671616:12345-0@lo:400:kworker.0 Request processed in 1199us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826358.084056:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3511 00000100:00100000:2.0:1787826358.084087:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778670336 00000100:00100000:2.0:1787826358.084091:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778670336 00000100:00100000:2.0:1787826358.084117:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1787826358.084124:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778670336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.084155:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778670336:12345-0@lo:400:kworker.0 Request processed in 32us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826358.084161:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1787826358.084195:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778670720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.084206:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778671232:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.084218:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778671744:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.084228:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778670592:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.084237:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778671104:0@lo:400:kworker.0 00000100:00100000:2.0:1787826358.084245:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778671616:0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.084294:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778671360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.084326:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778671360:12345-0@lo:400:kworker.0 Request processed in 428us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826358.084332:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3428 00000100:00100000:3.0:1787826358.084374:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778670336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.084383:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1874668778670848:0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.084390:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778671360:0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.084398:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778670464:0@lo:400:kworker.0 00000100:00100000:3.0:1787826358.084405:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1874668778670976:0@lo:400:kworker.0 00010000:00010000:1.0:1787826358.146713:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826358.592010:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826358.592040:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778671872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826358.592109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826358.592175:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778671872 00000100:00100000:3.0:1787826358.592193:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778671872 00000100:00100000:3.0:1787826358.592237:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:3.0:1787826358.592246:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778671872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826358.592273:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:3.0:1787826358.592324:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778671872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826358.592332:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:3.0:1787826358.592385:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778671872:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826359.170991:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826360.135116:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778672000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826360.135185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826360.135258:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778672000 00000100:00100000:0.0:1787826360.135264:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778672000 00000100:00100000:0.0:1787826360.135310:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3429 00000100:00100000:0.0:1787826360.135318:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778672000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826360.135347:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826360.135393:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778672000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826360.135414:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3429 00000100:00100000:0.0:1787826360.135475:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778672000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826360.142493:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778672128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826360.142564:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826360.142629:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778672128 00000100:00100000:1.0:1787826360.142635:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778672128 00000100:00100000:1.0:1787826360.142679:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3430 00000100:00100000:1.0:1787826360.142688:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778672128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826360.142720:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:1.0:1787826360.142763:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778672128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826360.142774:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3430 00000100:00100000:1.0:1787826360.142819:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778672128:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787826360.192260:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826360.641956:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778672256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826360.642037:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826360.642354:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778672256 00000100:00100000:0.0:1787826360.642362:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778672256 00000100:00100000:0.0:1787826360.642426:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:0.0:1787826360.642435:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778672256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826360.642463:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826360.642505:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778672256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826360.642512:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:2.0:1787826360.643127:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778672384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826360.643159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826360.643195:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778672384 00000100:00100000:2.0:1787826360.643199:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778672384 00000100:00100000:2.0:1787826360.643224:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:2.0:1787826360.643230:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778672384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826360.643246:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826360.643276:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778672384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826360.643282:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00100000:2.0:1787826360.643318:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778672384:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787826360.643477:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826360.643481:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826360.643505:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778672256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787826361.216377:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826362.243540:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826362.311954:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826362.312014:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826362.312045:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826362.312069:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826362.312092:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826362.312109:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826362.312126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826362.312146:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826362.312166:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826362.312193:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789877632 00000100:00100000:3.0:1787826362.312201:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789877632 00000100:00100000:3.0:1787826362.312273:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789878144 00000100:00100000:3.0:1787826362.312277:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789878144 00000100:00100000:3.0:1787826362.312295:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789877760 00000100:00100000:3.0:1787826362.312297:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789877760 00000100:00100000:1.0:1787826362.312420:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789877888 00000100:00100000:1.0:1787826362.312424:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789877888 00000100:00100000:1.0:1787826362.312454:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789878400 00000100:00100000:1.0:1787826362.312457:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789878400 00000100:00100000:1.0:1787826362.312474:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789878016 00000100:00100000:1.0:1787826362.312476:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789878016 00000100:00100000:1.0:1787826362.312493:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789878528 00000100:00100000:1.0:1787826362.312496:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789878528 00000100:00100000:1.0:1787826362.312511:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3514 00000100:00100000:1.0:1787826362.312520:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789877888:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.312591:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789877888:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 72us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.312599:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3514 00000100:00100000:1.0:1787826362.312802:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3515 00000100:00100000:1.0:1787826362.312809:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789878400:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.312836:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789878400:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 27us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.312845:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3515 00000100:00100000:1.0:1787826362.312891:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3516 00000100:00100000:1.0:1787826362.312898:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16b90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789878016:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.312922:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16b90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789878016:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.312928:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3516 00000100:00100000:1.0:1787826362.312940:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3517 00000100:00100000:1.0:1787826362.312946:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789878528:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.312968:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789878528:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.312974:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3517 00000100:00100000:1.0:1787826362.313128:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5083 00000100:00100000:1.0:1787826362.313135:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789877632:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.313171:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789877632:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 36us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.313177:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5083 00000100:00100000:1.0:1787826362.313192:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5084 00000100:00100000:1.0:1787826362.313198:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789878144:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.313220:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789878144:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.313226:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5084 00000100:00100000:1.0:1787826362.313238:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5085 00000100:00100000:1.0:1787826362.313245:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789877760:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.313267:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789877760:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.313273:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5085 00000100:00100000:1.0:1787826362.313305:0:38188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789877504 00000100:00100000:1.0:1787826362.313309:0:38188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789877504 00000100:00100000:1.0:1787826362.313350:0:38188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 795 00000100:00100000:1.0:1787826362.313356:0:38188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789877504:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.313380:0:38188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789877504:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.313386:0:38188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 795 00000100:00080000:1.0:1787826362.313464:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826362.313469:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826362.313471:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826362.313474:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826362.314520:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789878272 00000100:00100000:3.0:1787826362.314528:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789878272 00000100:00100000:1.0:1787826362.314709:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5086 00000100:00100000:1.0:1787826362.314718:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789878272:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.314781:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789878272:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 63us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.314787:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5086 00000100:00080000:2.0:1787826362.315579:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1787826363.074461:0:39210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787826363.074471:0:39210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826363.075045:0:39210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787826363.075054:0:39210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787826363.202215:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826363.202235:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778672512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826363.202297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826363.202512:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778672512 00000100:00100000:0.0:1787826363.202518:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778672512 00000100:00100000:0.0:1787826363.202570:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1787826363.202579:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778672512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826363.202607:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826363.202654:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778672512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826363.202661:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00080000:2.0:1787826363.206164:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826363.206194:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778672896:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826363.206302:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778673408:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826363.206344:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778673920:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826363.206407:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778672512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826363.206428:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826363.206433:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778673024:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826363.206470:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778673536:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826363.206501:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778674048:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206518:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826363.206543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778672896 00000100:00100000:2.0:1787826363.206548:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778672896 00000100:00100000:2.0:1787826363.206582:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778673408 00000100:00100000:2.0:1787826363.206585:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778673408 00000100:00100000:2.0:1787826363.206604:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778673024 00000100:00100000:2.0:1787826363.206607:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778673024 00000100:00100000:2.0:1787826363.206620:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778674048 00000100:00100000:2.0:1787826363.206622:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778674048 00000100:00100000:2.0:1787826363.206638:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5087 00000100:00100000:2.0:1787826363.206646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778672896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778672896:12345-0@lo:400:kworker.0 Request processed in 46us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.206698:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5087 00000100:00100000:2.0:1787826363.206714:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5088 00000100:00100000:2.0:1787826363.206720:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778673408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206746:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778673408:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.206752:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5088 00000100:00100000:2.0:1787826363.206764:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5089 00000100:00100000:2.0:1787826363.206769:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778673024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206792:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778673024:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.206797:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5089 00000100:00100000:2.0:1787826363.206806:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5090 00000100:00100000:2.0:1787826363.206811:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778674048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206833:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778674048:12345-0@lo:400:kworker.0 Request processed in 22us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.206839:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5090 00000100:00080000:2.0:1787826363.206882:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826363.206885:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826363.206902:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778673024:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206911:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778674048:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206919:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778672896:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.206926:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778673408:0@lo:400:kworker.0 00000100:00100000:0.0:1787826363.211929:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778673920 00000100:00100000:0.0:1787826363.211943:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778673920 00000100:00100000:0.0:1787826363.212066:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778673536 00000100:00100000:0.0:1787826363.212071:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778673536 00000100:00100000:1.0:1787826363.212348:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3518 00000100:00100000:1.0:1787826363.212360:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778673920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.214768:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778673920:12345-0@lo:400:kworker.0 Request processed in 2404us (8393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.214783:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3518 00000100:00100000:1.0:1787826363.214902:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778673920:0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.216735:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778672640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.216802:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826363.216865:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778673152:0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.216894:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826363.216915:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778673664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.216940:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826363.216966:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787826363.216973:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778672768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.217010:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826363.220334:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826363.221128:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778673280:0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.221196:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826363.221220:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778673792:0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.221245:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826363.221287:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778672640 00000100:00100000:1.0:1787826363.221293:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778672640 00000100:00100000:1.0:1787826363.221339:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1787826363.221347:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778672640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.221408:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778672640:12345-0@lo:400:kworker.0 Request processed in 61us (4605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.221415:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1787826363.221448:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778673152 00000100:00100000:1.0:1787826363.221452:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778673152 00000100:00100000:1.0:1787826363.221483:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778673280 00000100:00100000:1.0:1787826363.221486:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778673280 00000100:00100000:1.0:1787826363.221507:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5091 00000100:00100000:1.0:1787826363.221512:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778673152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.221542:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778673152:12345-0@lo:400:kworker.0 Request processed in 30us (4647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.221548:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5091 00000100:00100000:1.0:1787826363.221559:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5092 00000100:00100000:1.0:1787826363.221565:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778673280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.221593:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778673280:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.221598:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5092 00000100:00100000:1.0:1787826363.221615:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778673664 00000100:00100000:1.0:1787826363.221619:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778673664 00000100:00100000:1.0:1787826363.221643:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778672768 00000100:00100000:1.0:1787826363.221647:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778672768 00000100:00100000:1.0:1787826363.221662:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3431 00000100:00100000:1.0:1787826363.221668:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778673664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.221699:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778673664:12345-0@lo:400:kworker.0 Request processed in 31us (4758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.221705:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3431 00000100:00100000:1.0:1787826363.221717:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3432 00000100:00100000:1.0:1787826363.221722:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe100383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778672768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.221750:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe100383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778672768:12345-0@lo:400:kworker.0 Request processed in 29us (4741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.221756:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3432 00000100:00100000:1.0:1787826363.221784:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778673792 00000100:00100000:1.0:1787826363.221787:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778673792 00000100:00100000:1.0:1787826363.221813:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3519 00000100:00100000:1.0:1787826363.221819:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778673792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826363.222055:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778673792:12345-0@lo:400:kworker.0 Request processed in 31us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.222064:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3519 00000100:00100000:2.0:1787826363.223453:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778672768:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.223471:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778673280:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.223483:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778673792:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.223493:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778672640:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.223502:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778673152:0@lo:400:kworker.0 00000100:00100000:2.0:1787826363.223511:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778673664:0@lo:400:kworker.0 00000100:00080000:2.0:1787826363.223552:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826363.223557:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826363.223559:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826363.226655:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3520 00000100:00100000:0.0:1787826363.226670:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778673536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826363.226758:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778673536:12345-0@lo:400:kworker.0 Request processed in 93us (20269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826363.226769:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3520 00000100:00100000:1.0:1787826363.236604:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778673536:0@lo:400:kworker.0 00010000:00010000:1.0:1787826363.265400:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826363.715355:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778674176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826363.715429:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826363.715543:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778674176 00000100:00100000:3.0:1787826363.715551:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778674176 00000100:00100000:3.0:1787826363.715607:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:3.0:1787826363.715617:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778674176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826363.715646:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:3.0:1787826363.715695:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778674176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826363.715702:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00100000:3.0:1787826363.715747:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778674176:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826364.288264:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826365.181337:0:57804:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 102: Verify coordinator control ======= 06:26:04 (1787826364) 00000100:00100000:3.0:1787826365.248074:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778674304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826365.248158:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826365.248320:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778674304 00000100:00100000:1.0:1787826365.248328:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778674304 00000100:00100000:1.0:1787826365.248383:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3433 00000100:00100000:1.0:1787826365.248393:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778674304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826365.248428:0:45684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:1.0:1787826365.248475:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778674304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826365.248482:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3433 00000100:00100000:3.0:1787826365.248636:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778674304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826365.248983:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778674432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826365.249021:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826365.249065:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778674432 00000100:00100000:0.0:1787826365.249069:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778674432 00000100:00100000:0.0:1787826365.249099:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3434 00000100:00100000:0.0:1787826365.249106:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778674432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826365.249137:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826365.249171:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778674432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826365.249177:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3434 00000100:00100000:0.0:1787826365.249208:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778674432:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826365.313956:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826365.764194:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778674560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826365.764263:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826365.764336:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778674688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826365.775091:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778674560 00000100:00100000:2.0:1787826365.775107:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778674560 00000100:00100000:0.0:1787826365.775569:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826365.776008:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778674688 00000100:00100000:2.0:1787826365.776014:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778674688 00000100:00100000:2.0:1787826365.776033:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:2.0:1787826365.776042:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778674560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826365.776073:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:3.0:1787826365.776417:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:3.0:1787826365.776430:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778674688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826365.776449:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:3.0:1787826365.776492:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778674688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.776499:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00080000:0.0:1787826365.777678:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826365.777685:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826365.777734:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778674688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826365.777905:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778674560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1862us (13639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826365.777915:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:0.0:1787826365.778418:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778674560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787826366.337169:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826367.360727:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826367.432103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826367.432147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826367.432170:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789878784 00000100:00100000:3.0:1787826367.432171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826367.432181:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789878784 00000100:00100000:3.0:1787826367.432188:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826367.432214:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826367.432235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826367.432236:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789879296 00000100:00100000:2.0:1787826367.432239:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789879296 00000100:00100000:3.0:1787826367.432254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826367.432257:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789878912 00000100:00100000:2.0:1787826367.432260:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789878912 00000100:00100000:3.0:1787826367.432271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826367.432278:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789879424 00000100:00100000:2.0:1787826367.432281:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789879424 00000100:00100000:3.0:1787826367.432296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826367.432302:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5093 00000100:00100000:2.0:1787826367.432312:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789878784:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826367.432317:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789879040 00000100:00100000:3.0:1787826367.432320:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789879040 00000100:00100000:3.0:1787826367.432353:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789879552 00000100:00100000:3.0:1787826367.432356:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789879552 00000100:00100000:3.0:1787826367.432374:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789879168 00000100:00100000:3.0:1787826367.432377:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789879168 00000100:00100000:3.0:1787826367.432393:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789879680 00000100:00100000:3.0:1787826367.432395:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789879680 00000100:00100000:3.0:1787826367.432410:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3521 00000100:00100000:3.0:1787826367.432417:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789879040:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826367.432453:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789878784:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 141us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.432461:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5093 00000100:00100000:2.0:1787826367.432478:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5094 00000100:00100000:2.0:1787826367.432485:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+27:2400:x1874668789879296:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826367.432566:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3522 00000100:00100000:0.0:1787826367.432575:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789879552:12345-192.168.203.9@tcp:400:kworker.0 00000100:00080000:1.0:1787826367.433223:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826367.433227:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826367.433230:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826367.433231:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826367.433246:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5095 00000100:00100000:1.0:1787826367.433258:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf4054d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2400:x1874668789878912:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826367.434750:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+27:2400:x1874668789879296:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 2256us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.434750:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789879040:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 2324us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.434764:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5094 00000100:00100000:3.0:1787826367.434764:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3521 00000100:00100000:2.0:1787826367.434794:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5096 00000100:00100000:3.0:1787826367.434794:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3523 00000100:00100000:2.0:1787826367.434806:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+48:2400:x1874668789879424:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826367.434806:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2400:x1874668789879168:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826367.434893:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+48:2400:x1874668789879424:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 91us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.434900:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5096 00000100:00100000:2.0:1787826367.435665:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3524 00000100:00100000:2.0:1787826367.435677:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668789879680:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826367.435728:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668789879680:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 56us (3431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.435734:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3524 00000100:00100000:2.0:1787826367.435760:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789878656 00000100:00100000:2.0:1787826367.435766:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789878656 00000100:00100000:2.0:1787826367.435802:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 797 00000100:00100000:2.0:1787826367.435809:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2400:x1874668789878656:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826367.435846:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2400:x1874668789878656:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 38us (3630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.435868:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 797 00000100:00100000:0.0:1787826367.436056:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789879552:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3481us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826367.436065:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3522 00000100:00100000:1.0:1787826367.436317:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf4054d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2400:x1874668789878912:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3061us (4078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826367.436325:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5095 00000100:00100000:3.0:1787826367.438217:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2400:x1874668789879168:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3406us (5953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.438229:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3523 00000100:00100000:1.0:1787826368.327487:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778674816:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.327574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.327621:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778675328:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.327651:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.327670:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778675840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.327695:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.327712:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778676352:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.327732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.327756:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787826368.327762:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1874668778675200:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.327782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.327798:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874668778675712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.327816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.327831:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778676224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.327848:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.327894:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778674944:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.327919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.327954:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778675456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.327976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.327990:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778675968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.328029:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826368.328035:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778675072:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.328072:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778675584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328092:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.328109:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778676096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328127:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826368.328157:0:38188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778674816 00000100:00100000:1.0:1787826368.328163:0:38188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778674816 00000100:00100000:1.0:1787826368.328207:0:38188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1787826368.328217:0:38188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778674816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328266:0:38188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778674816:12345-0@lo:400:kworker.0 Request processed in 50us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826368.328273:0:38188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1787826368.328307:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778675328 00000100:00100000:1.0:1787826368.328311:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778675328 00000100:00100000:1.0:1787826368.328345:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778676352 00000100:00100000:1.0:1787826368.328348:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778676352 00000100:00100000:1.0:1787826368.328365:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778675200 00000100:00100000:1.0:1787826368.328368:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778675200 00000100:00100000:1.0:1787826368.328387:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778675712 00000100:00100000:1.0:1787826368.328390:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778675712 00000100:00100000:1.0:1787826368.328404:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778675072 00000100:00100000:1.0:1787826368.328406:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778675072 00000100:00100000:1.0:1787826368.328414:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778675584 00000100:00100000:1.0:1787826368.328417:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778675584 00000100:00100000:1.0:1787826368.328430:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5097 00000100:00100000:1.0:1787826368.328436:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778675328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328470:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778675328:12345-0@lo:400:kworker.0 Request processed in 33us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826368.328475:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5097 00000100:00100000:1.0:1787826368.328488:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5098 00000100:00100000:1.0:1787826368.328494:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778676352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328522:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778676352:12345-0@lo:400:kworker.0 Request processed in 28us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826368.328528:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5098 00000100:00100000:1.0:1787826368.328538:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5099 00000100:00100000:1.0:1787826368.328544:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874668778675200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328569:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874668778675200:12345-0@lo:400:kworker.0 Request processed in 25us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826368.328575:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5099 00000100:00100000:1.0:1787826368.328586:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5100 00000100:00100000:1.0:1787826368.328592:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874668778675712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328617:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874668778675712:12345-0@lo:400:kworker.0 Request processed in 26us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826368.328622:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5100 00000100:00100000:1.0:1787826368.328633:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5101 00000100:00100000:1.0:1787826368.328639:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778675072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328673:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778675072:12345-0@lo:400:kworker.0 Request processed in 34us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826368.328679:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5101 00000100:00100000:1.0:1787826368.328690:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5102 00000100:00100000:1.0:1787826368.328696:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778675584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328720:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778675584:12345-0@lo:400:kworker.0 Request processed in 25us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826368.328726:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5102 00000100:00100000:1.0:1787826368.328744:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778675840 00000100:00100000:1.0:1787826368.328748:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778675840 00000100:00100000:1.0:1787826368.328771:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778676224 00000100:00100000:1.0:1787826368.328773:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778676224 00000100:00100000:1.0:1787826368.328789:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778675456 00000100:00100000:1.0:1787826368.328792:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778675456 00000100:00100000:1.0:1787826368.328808:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778676096 00000100:00100000:1.0:1787826368.328810:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778676096 00000100:00100000:1.0:1787826368.328824:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3525 00000100:00100000:1.0:1787826368.328829:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778675840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328881:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778675840:12345-0@lo:400:kworker.0 Request processed in 51us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826368.328887:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3525 00000100:00100000:1.0:1787826368.328898:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3526 00000100:00100000:1.0:1787826368.328904:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778676224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.328929:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778676224:12345-0@lo:400:kworker.0 Request processed in 26us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826368.328935:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3526 00000100:00100000:0.0:1787826368.329452:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826368.329465:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778676480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826368.329501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826368.329535:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3527 00000100:00100000:0.0:1787826368.329542:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778675456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826368.329570:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778675456:12345-0@lo:400:kworker.0 Request processed in 29us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826368.329575:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3527 00000100:00100000:0.0:1787826368.329587:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3528 00000100:00100000:0.0:1787826368.329591:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778676096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826368.329611:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778676096:12345-0@lo:400:kworker.0 Request processed in 20us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826368.329617:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3528 00000100:00100000:0.0:1787826368.329643:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778676480 00000100:00100000:0.0:1787826368.329648:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778676480 00000100:00100000:0.0:1787826368.329675:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1787826368.329681:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778676480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826368.329703:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:0.0:1787826368.329749:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778676480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826368.329756:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1787826368.329797:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778676480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826368.334105:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778674944 00000100:00100000:2.0:1787826368.334118:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778674944 00000100:00100000:0.0:1787826368.338985:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778675968 00000100:00100000:0.0:1787826368.338999:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778675968 00000100:00100000:2.0:1787826368.340899:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3435 00000100:00100000:2.0:1787826368.340916:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778674944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826368.341019:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778674944:12345-0@lo:400:kworker.0 Request processed in 109us (13099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826368.341027:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3435 00000100:00080000:1.0:1787826368.342352:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826368.342359:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826368.342363:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826368.342365:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826368.342429:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778675072:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342444:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778675584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342455:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778676096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342464:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778674944:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342474:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778675456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342519:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1874668778675200:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342530:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874668778675712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342539:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778676224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342549:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778674816:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342558:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778675328:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342568:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778675840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826368.342578:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778676352:0@lo:400:kworker.0 00000100:00100000:0.0:1787826368.343646:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3436 00000100:00100000:0.0:1787826368.343665:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778675968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826368.346470:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778675968:12345-0@lo:400:kworker.0 Request processed in 2804us (18448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826368.346486:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3436 00000100:00100000:1.0:1787826368.348525:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778675968:0@lo:400:kworker.0 00010000:00010000:3.0:1787826368.395839:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826368.834395:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826368.834427:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778676608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826368.834530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826368.834623:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778676608 00000100:00100000:2.0:1787826368.834631:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778676608 00000100:00100000:2.0:1787826368.834686:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:2.0:1787826368.834695:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778676608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826368.834730:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826368.834782:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778676608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826368.834790:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:2.0:1787826368.834838:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778676608:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826369.410021:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826370.368197:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826370.368226:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778676736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826370.368309:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.368430:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778676736 00000100:00100000:1.0:1787826370.368437:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778676736 00000100:00100000:1.0:1787826370.368490:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3437 00000100:00100000:1.0:1787826370.368499:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778676736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826370.368533:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1787826370.368586:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778676736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.368593:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3437 00000100:00100000:3.0:1787826370.368804:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778676736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826370.369086:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826370.369097:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778676864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826370.369133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.369207:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778676864 00000100:00100000:2.0:1787826370.369212:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778676864 00000100:00100000:2.0:1787826370.369250:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3438 00000100:00100000:2.0:1787826370.369258:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778676864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826370.369278:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:2.0:1787826370.369325:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778676864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.369331:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3438 00000100:00100000:1.0:1787826370.369403:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778676864:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826370.432701:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787826370.628387:0:39161:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826370.628396:0:39161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826370.629035:0:39161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9703 count 1 00000040:00080000:0.0:1787826370.629047:0:39161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1787826370.880992:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778676992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826370.881061:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.881150:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778676992 00000100:00100000:0.0:1787826370.881158:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778676992 00000100:00100000:0.0:1787826370.881211:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:0.0:1787826370.881221:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778676992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826370.881247:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826370.881291:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778676992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.881299:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00080000:0.0:1787826370.881320:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826370.881354:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778676992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826370.881762:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778677120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826370.881795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.881979:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778677120 00000100:00100000:1.0:1787826370.881984:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778677120 00000100:00100000:1.0:1787826370.882022:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:1.0:1787826370.882029:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778677120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826370.882047:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:1.0:1787826370.882082:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778677120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.882089:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00080000:0.0:1787826370.882144:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826370.882169:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778677120:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787826371.249496:0:39210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787826371.249504:0:39210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826371.250096:0:39210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787826371.250107:0:39210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787826371.470528:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826372.480122:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826372.562806:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826372.562844:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826372.562910:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826372.562945:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826372.562963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826372.562979:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826372.562997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826372.563014:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826372.563035:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826372.563061:0:38185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789879808 00000100:00100000:3.0:1787826372.563070:0:38185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789879808 00000100:00100000:3.0:1787826372.563117:0:38185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 799 00000100:00100000:3.0:1787826372.563126:0:38185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789879808:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826372.563201:0:38185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789879808:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 75us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826372.563208:0:38185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 799 00000100:00100000:3.0:1787826372.563239:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789880064 00000100:00100000:3.0:1787826372.563243:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789880064 00000100:00100000:3.0:1787826372.563277:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789880576 00000100:00100000:3.0:1787826372.563280:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789880576 00000100:00100000:3.0:1787826372.563298:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789879936 00000100:00100000:3.0:1787826372.563301:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789879936 00000100:00100000:3.0:1787826372.563555:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789880448 00000100:00100000:3.0:1787826372.563559:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789880448 00000100:00100000:0.0:1787826372.571280:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5103 00000100:00100000:1.0:1787826372.575955:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789880320 00000100:00100000:1.0:1787826372.575969:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789880320 00000100:00100000:1.0:1787826372.576022:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789880832 00000100:00100000:1.0:1787826372.576026:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789880832 00000100:00100000:1.0:1787826372.576047:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789880192 00000100:00100000:1.0:1787826372.576051:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789880192 00000100:00100000:1.0:1787826372.576071:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789880704 00000100:00100000:1.0:1787826372.576074:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789880704 00000100:00100000:1.0:1787826372.576095:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3529 00000100:00100000:1.0:1787826372.576105:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2402:x1874668789880320:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826372.576176:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2402:x1874668789880320:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 72us (13265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826372.576184:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3529 00000100:00100000:1.0:1787826372.576203:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3530 00000100:00100000:1.0:1787826372.576210:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789880832:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826372.576233:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789880832:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (13270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826372.576239:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3530 00000100:00100000:1.0:1787826372.576251:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3531 00000100:00100000:1.0:1787826372.576257:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789880192:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826372.576279:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789880192:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (13281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826372.576284:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3531 00000100:00100000:1.0:1787826372.576296:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3532 00000100:00100000:1.0:1787826372.576303:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789880704:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826372.576406:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789880064:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826372.576443:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789880064:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 5151us (13599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826372.576451:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5103 00000100:00100000:0.0:1787826372.576470:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5104 00000100:00100000:0.0:1787826372.576479:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789880576:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826372.576503:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789880576:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (13559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826372.576509:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5104 00000100:00100000:0.0:1787826372.576522:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5105 00000100:00100000:0.0:1787826372.576531:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789879936:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826372.576555:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789879936:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (13575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826372.576561:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5105 00000100:00100000:0.0:1787826372.576573:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5106 00000100:00100000:0.0:1787826372.576581:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789880448:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826372.576606:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789880448:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (13592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826372.576613:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5106 00000100:00080000:3.0:1787826372.576899:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826372.576904:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826372.576907:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826372.576909:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826372.580059:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789880704:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3746us (17013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826372.580072:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3532 00000040:00080000:0.0:1787826373.318502:0:39210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787826373.318512:0:39210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826373.321287:0:39210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787826373.322958:0:39210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787826373.442877:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778677376:0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.442960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826373.443009:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778677888:0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.443035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826373.443053:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778678400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.443073:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826373.443103:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787826373.443109:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778677248:0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.443137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826373.443155:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778677760:0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.443175:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826373.443191:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778678272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.443209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826373.443224:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778678784:0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.443246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826373.443276:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778677888 00000100:00100000:3.0:1787826373.443282:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778677888 00000100:00100000:3.0:1787826373.443349:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778678272 00000100:00100000:3.0:1787826373.443352:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778678272 00000100:00100000:3.0:1787826373.443373:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3533 00000100:00100000:3.0:1787826373.443381:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778677888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.443432:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778677888:12345-0@lo:400:kworker.0 Request processed in 52us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826373.443439:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3533 00000100:00100000:3.0:1787826373.443455:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534 00000100:00100000:3.0:1787826373.443461:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778678272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.443488:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778678272:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826373.443493:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534 00000100:00080000:3.0:1787826373.443511:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826373.443514:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826373.443540:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778678272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826373.443551:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778677888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.443991:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778677504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444026:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826373.444053:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778678016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826373.444092:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778678528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444113:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826373.444137:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826373.444144:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778677632:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826373.444184:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778678144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826373.444222:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778678656:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826373.444274:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778677248 00000100:00100000:2.0:1787826373.444279:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778677248 00000100:00100000:2.0:1787826373.444323:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1787826373.444331:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778677248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444371:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778677248:12345-0@lo:400:kworker.0 Request processed in 41us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826373.444378:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1787826373.444405:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778677760 00000100:00100000:2.0:1787826373.444408:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778677760 00000100:00100000:2.0:1787826373.444439:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778678784 00000100:00100000:2.0:1787826373.444442:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778678784 00000100:00100000:2.0:1787826373.444459:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778677504 00000100:00100000:2.0:1787826373.444461:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778677504 00000100:00100000:2.0:1787826373.444474:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778678016 00000100:00100000:2.0:1787826373.444477:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778678016 00000100:00100000:2.0:1787826373.444491:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778677632 00000100:00100000:2.0:1787826373.444493:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778677632 00000100:00100000:2.0:1787826373.444504:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778678144 00000100:00100000:2.0:1787826373.444506:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778678144 00000100:00100000:2.0:1787826373.444520:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5107 00000100:00100000:2.0:1787826373.444526:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778677760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444557:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778677760:12345-0@lo:400:kworker.0 Request processed in 30us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826373.444563:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5107 00000100:00100000:2.0:1787826373.444574:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5108 00000100:00100000:2.0:1787826373.444580:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778678784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444620:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778678784:12345-0@lo:400:kworker.0 Request processed in 40us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826373.444626:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5108 00000100:00100000:2.0:1787826373.444637:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5109 00000100:00100000:2.0:1787826373.444642:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778677504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444669:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778677504:12345-0@lo:400:kworker.0 Request processed in 27us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826373.444674:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5109 00000100:00100000:2.0:1787826373.444684:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5110 00000100:00100000:2.0:1787826373.444690:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778678016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444714:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778678016:12345-0@lo:400:kworker.0 Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826373.444720:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5110 00000100:00100000:2.0:1787826373.444730:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5111 00000100:00100000:2.0:1787826373.444735:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778677632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.444760:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778677632:12345-0@lo:400:kworker.0 Request processed in 25us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826373.444765:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5111 00000100:00100000:2.0:1787826373.444776:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5112 00000100:00100000:2.0:1787826373.444781:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778678144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826373.445050:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778678528 00000100:00100000:1.0:1787826373.445055:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778678528 00000100:00100000:1.0:1787826373.445082:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778678656 00000100:00100000:1.0:1787826373.445084:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778678656 00000100:00100000:1.0:1787826373.445102:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3535 00000100:00100000:1.0:1787826373.445108:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778678528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826373.445140:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778678528:12345-0@lo:400:kworker.0 Request processed in 33us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826373.445146:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3535 00000100:00100000:1.0:1787826373.445156:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3536 00000100:00100000:1.0:1787826373.445162:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778678656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826373.445183:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778678656:12345-0@lo:400:kworker.0 Request processed in 22us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826373.445188:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3536 00000100:00100000:1.0:1787826373.445205:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778677376 00000100:00100000:1.0:1787826373.445208:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778677376 00000100:00100000:1.0:1787826373.445230:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778678400 00000100:00100000:1.0:1787826373.445233:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778678400 00000100:00100000:1.0:1787826373.445248:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3439 00000100:00100000:1.0:1787826373.445254:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778677376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826373.445286:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778677376:12345-0@lo:400:kworker.0 Request processed in 32us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826373.445291:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3439 00000100:00100000:1.0:1787826373.445316:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3440 00000100:00100000:1.0:1787826373.445322:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778678400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826373.445350:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778678400:12345-0@lo:400:kworker.0 Request processed in 29us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826373.445356:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3440 00000100:00100000:2.0:1787826373.445697:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778678144:12345-0@lo:400:kworker.0 Request processed in 914us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826373.445704:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5112 00000100:00080000:2.0:1787826373.445741:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826373.445745:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826373.445748:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826373.445750:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826373.445775:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778677632:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.445785:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778678144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.446722:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778678656:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.446738:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778677504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.446749:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778678016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.446759:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778678528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.446976:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778677248:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.446995:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778677760:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.447006:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778678784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.447018:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778677376:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.447029:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778678400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826373.447265:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826373.447276:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778678912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826373.447326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826373.447367:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778678912 00000100:00100000:2.0:1787826373.447373:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778678912 00000100:00100000:2.0:1787826373.447408:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:2.0:1787826373.447414:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778678912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826373.447437:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826373.447472:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778678912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826373.447479:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:2.0:1787826373.447509:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778678912:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787826373.506890:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826373.952328:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a114b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778679040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826373.952459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826373.952579:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778679040 00000100:00100000:0.0:1787826373.952586:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778679040 00000100:00100000:0.0:1787826373.952641:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:0.0:1787826373.952649:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778679040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826373.952687:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826373.952737:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778679040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826373.952745:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:1.0:1787826373.952980:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a114b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778679040:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826374.528243:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826375.492233:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778679168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826375.492302:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826375.492477:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778679168 00000100:00100000:0.0:1787826375.492484:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778679168 00000100:00100000:0.0:1787826375.492539:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3441 00000100:00100000:0.0:1787826375.492549:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778679168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826375.492578:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826375.492628:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778679168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.492635:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3441 00000100:00100000:0.0:1787826375.492678:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778679168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826375.505593:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778679296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826375.505670:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826375.520708:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778679296 00000100:00100000:3.0:1787826375.520724:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778679296 00000100:00100000:3.0:1787826375.520877:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3442 00000100:00100000:3.0:1787826375.520890:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778679296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826375.520943:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:3.0:1787826375.521035:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778679296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (15364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.521042:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3442 00000100:00100000:3.0:1787826375.521201:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778679296:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826375.556152:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826376.008134:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826376.008155:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778679424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826376.008234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826376.008311:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778679424 00000100:00100000:3.0:1787826376.008317:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778679424 00000100:00100000:3.0:1787826376.008376:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:3.0:1787826376.008388:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778679424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826376.008417:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:3.0:1787826376.008460:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778679424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.008467:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00080000:3.0:1787826376.008487:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826376.008521:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778679424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826376.010509:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778679552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826376.010571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.010634:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778679552 00000100:00100000:2.0:1787826376.010640:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778679552 00000100:00100000:2.0:1787826376.010690:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:2.0:1787826376.010699:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778679552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826376.010723:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826376.010764:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778679552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.010771:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00080000:2.0:1787826376.010791:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826376.010819:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778679552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787826376.593758:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826377.600740:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826377.693358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826377.693403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826377.693444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826377.693468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826377.693487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826377.693507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826377.693526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826377.693547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826377.693570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826377.693598:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789881472 00000100:00100000:3.0:1787826377.693607:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789881472 00000100:00100000:3.0:1787826377.693662:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789881984 00000100:00100000:3.0:1787826377.693667:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789881984 00000100:00100000:3.0:1787826377.693689:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789881344 00000100:00100000:3.0:1787826377.693692:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789881344 00000100:00100000:3.0:1787826377.693712:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789881856 00000100:00100000:3.0:1787826377.693715:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789881856 00000100:00100000:3.0:1787826377.693734:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3537 00000100:00100000:3.0:1787826377.693744:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789881472:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.693816:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2401:x1874668789881472:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 73us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.693824:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3537 00000100:00100000:3.0:1787826377.693840:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3538 00000100:00100000:3.0:1787826377.693847:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789881984:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.693911:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789881984:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 64us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.693917:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3538 00000100:00100000:3.0:1787826377.693928:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3539 00000100:00100000:3.0:1787826377.693934:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789881344:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.693954:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789881344:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 20us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.693959:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3539 00000100:00100000:3.0:1787826377.693968:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3540 00000100:00100000:3.0:1787826377.693973:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789881856:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.693995:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789881856:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.694001:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3540 00000100:00100000:3.0:1787826377.694021:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789881216 00000100:00100000:3.0:1787826377.694024:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789881216 00000100:00100000:3.0:1787826377.694047:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789881728 00000100:00100000:3.0:1787826377.694050:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789881728 00000100:00100000:3.0:1787826377.694066:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789881088 00000100:00100000:3.0:1787826377.694069:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789881088 00000100:00100000:3.0:1787826377.694083:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789881600 00000100:00100000:3.0:1787826377.694085:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789881600 00000100:00100000:3.0:1787826377.694115:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5113 00000100:00100000:3.0:1787826377.694122:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789881216:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.694150:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789881216:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 29us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.694156:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5113 00000100:00100000:3.0:1787826377.694168:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5114 00000100:00100000:3.0:1787826377.694173:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789881728:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.694197:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789881728:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.694202:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5114 00000100:00100000:3.0:1787826377.694214:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5115 00000100:00100000:3.0:1787826377.694219:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789881088:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.694241:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789881088:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.694246:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5115 00000100:00100000:3.0:1787826377.694256:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5116 00000100:00100000:3.0:1787826377.694262:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789881600:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.694281:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+27:2401:x1874668789881600:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 19us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.694287:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5116 00000100:00080000:2.0:1787826377.694503:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826377.694507:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826377.694509:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826377.694511:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826377.694702:0:38188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789880960 00000100:00100000:1.0:1787826377.694707:0:38188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789880960 00000100:00100000:1.0:1787826377.694749:0:38188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 801 00000100:00100000:1.0:1787826377.694757:0:38188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789880960:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826377.694807:0:38188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789880960:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 52us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826377.694814:0:38188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 801 00000100:00100000:1.0:1787826378.560469:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778680064:0@lo:400:kworker.0 00000100:00100000:3.0:1787826378.560469:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778679808:0@lo:400:kworker.0 00000100:00100000:2.0:1787826378.560892:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874668778679936:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826378.561256:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778680576:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826378.561300:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778681088:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826378.561356:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787826378.561363:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c687310c-1e82-4391-b632-324cfd2cb9dd:3645:1874668778679680:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561393:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826378.561418:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778680192:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561439:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826378.561458:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778680704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561479:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826378.561496:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778681216:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826378.561561:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778680064 00000100:00100000:1.0:1787826378.561569:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778680064 00000100:00100000:1.0:1787826378.561635:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778680576 00000100:00100000:1.0:1787826378.561638:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778680576 00000100:00100000:1.0:1787826378.561656:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778680192 00000100:00100000:1.0:1787826378.561659:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778680192 00000100:00100000:1.0:1787826378.561679:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778681216 00000100:00100000:1.0:1787826378.561681:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778681216 00000100:00100000:1.0:1787826378.561703:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5117 00000100:00100000:1.0:1787826378.561711:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778680064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561772:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778680064:12345-0@lo:400:kworker.0 Request processed in 60us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826378.561780:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5117 00000100:00100000:1.0:1787826378.561799:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5118 00000100:00100000:1.0:1787826378.561805:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778680576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561835:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778680576:12345-0@lo:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826378.561841:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5118 00000100:00100000:1.0:1787826378.561889:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5119 00000100:00100000:1.0:1787826378.561896:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778680192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.561926:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778680192:12345-0@lo:400:kworker.0 Request processed in 31us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826378.561931:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5119 00000100:00100000:0.0:1787826378.562008:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5120 00000100:00100000:0.0:1787826378.562032:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778681216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826378.562041:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826378.562078:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778680320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826378.562082:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778681216:12345-0@lo:400:kworker.0 Request processed in 64us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826378.562090:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5120 00000100:00100000:3.0:1787826378.562117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826378.562148:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778680832:0@lo:400:kworker.0 00000100:00100000:3.0:1787826378.562173:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826378.562198:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778681344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826378.562214:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778681088 00000100:00100000:0.0:1787826378.562219:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778681088 00000100:00100000:3.0:1787826378.562227:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826378.562259:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778680704 00000100:00100000:0.0:1787826378.562262:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778680704 00000100:00100000:0.0:1787826378.562287:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778680320 00000100:00100000:0.0:1787826378.562290:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778680320 00000100:00100000:0.0:1787826378.562315:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3541 00000100:00100000:0.0:1787826378.562322:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778681088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826378.562364:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778681088:12345-0@lo:400:kworker.0 Request processed in 42us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826378.562371:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3541 00000100:00100000:0.0:1787826378.562386:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3542 00000100:00100000:0.0:1787826378.562393:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778680704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826378.562395:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778679808 00000100:00100000:3.0:1787826378.562401:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778679808 00000100:00100000:0.0:1787826378.562430:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778680704:12345-0@lo:400:kworker.0 Request processed in 38us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826378.562437:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3542 00000100:00100000:3.0:1787826378.562438:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778680832 00000100:00100000:3.0:1787826378.562443:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778680832 00000100:00100000:0.0:1787826378.562455:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3543 00000100:00100000:0.0:1787826378.562463:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778680320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826378.562472:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3443 00000100:00100000:3.0:1787826378.562483:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778679808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826378.562505:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778680320:12345-0@lo:400:kworker.0 Request processed in 43us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826378.562512:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3543 00000100:00100000:3.0:1787826378.562535:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778679808:12345-0@lo:400:kworker.0 Request processed in 54us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826378.562542:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3443 00000100:00100000:3.0:1787826378.562556:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444 00000100:00100000:3.0:1787826378.562562:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778680832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.562623:0:38185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778679680 00000100:00100000:1.0:1787826378.562629:0:38185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778679680 00000100:00100000:1.0:1787826378.562667:0:38185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1787826378.562674:0:38185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3ddc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3645:x1874668778679680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826378.563501:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778680832:12345-0@lo:400:kworker.0 Request processed in 934us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826378.563511:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444 00000100:00100000:3.0:1787826378.563547:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778681344 00000100:00100000:3.0:1787826378.563552:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778681344 00000100:00100000:3.0:1787826378.563668:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:3.0:1787826378.563677:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778681344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826378.563704:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:3.0:1787826378.563750:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778681344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826378.563773:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00100000:3.0:1787826378.563995:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778681344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826378.564011:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778679808:0@lo:400:kworker.0 00000100:00100000:3.0:1787826378.564022:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778680320:0@lo:400:kworker.0 00000100:00100000:3.0:1787826378.564032:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778680832:0@lo:400:kworker.0 00000100:00080000:0.0:1787826378.564936:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826378.564945:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826378.564949:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826378.564952:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826378.565009:0:38185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3ddc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3645:x1874668778679680:12345-0@lo:400:kworker.0 Request processed in 2331us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826378.565565:0:38185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1787826378.565661:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c687310c-1e82-4391-b632-324cfd2cb9dd:3645:1874668778679680:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.565679:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778680192:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.565693:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778680704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.565706:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778681216:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.565779:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778680064:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.565797:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778680576:0@lo:400:kworker.0 00000100:00100000:1.0:1787826378.565812:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778681088:0@lo:400:kworker.0 00000100:00100000:2.0:1787826378.568662:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826378.568741:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874668778680448:0@lo:400:kworker.0 00000100:00100000:2.0:1787826378.568783:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826378.568812:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778680960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826378.568843:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826378.568945:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778679936 00000100:00100000:2.0:1787826378.568954:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778679936 00000100:00100000:2.0:1787826378.569012:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778680448 00000100:00100000:2.0:1787826378.569016:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778680448 00000100:00100000:2.0:1787826378.569057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5121 00000100:00100000:2.0:1787826378.569068:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874668778679936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826378.569138:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874668778679936:12345-0@lo:400:kworker.0 Request processed in 71us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826378.569147:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5121 00000100:00100000:2.0:1787826378.569167:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5122 00000100:00100000:2.0:1787826378.569175:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874668778680448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826378.569207:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874668778680448:12345-0@lo:400:kworker.0 Request processed in 33us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826378.569213:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5122 00000100:00100000:2.0:1787826378.569237:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778680960 00000100:00100000:2.0:1787826378.569241:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778680960 00000100:00100000:2.0:1787826378.569277:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3544 00000100:00100000:2.0:1787826378.569285:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778680960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826378.569321:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778680960:12345-0@lo:400:kworker.0 Request processed in 38us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826378.569327:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3544 00000100:00080000:2.0:1787826378.569351:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826378.569357:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826378.569399:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874668778679936:0@lo:400:kworker.0 00000100:00100000:2.0:1787826378.569409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874668778680448:0@lo:400:kworker.0 00000100:00100000:2.0:1787826378.569420:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778680960:0@lo:400:kworker.0 00010000:00010000:3.0:1787826378.630416:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787826378.764959:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826378.764969:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826378.765519:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 64768 count 1 00000040:00080000:2.0:1787826378.765532:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1787826379.084046:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826379.084067:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778681472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826379.084134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826379.084194:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778681472 00000100:00100000:3.0:1787826379.084202:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778681472 00000100:00100000:3.0:1787826379.084246:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:3.0:1787826379.084254:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778681472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826379.084282:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:3.0:1787826379.084326:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778681472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826379.084334:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00100000:3.0:1787826379.084391:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778681472:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826379.648593:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787826379.776090:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826379.776101:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826379.776716:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 64768 count 1 00000040:00080000:2.0:1787826379.776731:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:0.0:1787826379.925143:0:58480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787826379.925155:0:58480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826379.925697:0:58480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787826379.925710:0:58480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787826380.612314:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826380.612347:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778681600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826380.612641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826380.613082:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778681600 00000100:00100000:0.0:1787826380.613095:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778681600 00000100:00100000:1.0:1787826380.613295:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445 00000100:00100000:1.0:1787826380.613309:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778681600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826380.613358:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:1.0:1787826380.613427:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778681600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826380.613448:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445 00000100:00100000:0.0:1787826380.613550:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826380.613564:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778681728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826380.613608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826380.613877:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778681728 00000100:00100000:1.0:1787826380.613882:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778681728 00000100:00100000:1.0:1787826380.613918:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3446 00000100:00100000:1.0:1787826380.613926:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778681728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826380.613949:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1787826380.613993:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778681728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826380.614000:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3446 00000100:00100000:0.0:1787826380.614036:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778681728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826380.614036:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778681600:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826380.672366:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787826380.929938:0:58480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787826380.929948:0:58480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826380.930724:0:58480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787826380.930735:0:58480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787826381.120279:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778681856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826381.120349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826381.124526:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826381.124548:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778681984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826381.124620:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826381.130923:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778681856 00000100:00100000:1.0:1787826381.130938:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778681856 00000100:00100000:1.0:1787826381.131010:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778681984 00000100:00100000:1.0:1787826381.131013:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778681984 00000100:00100000:1.0:1787826381.131033:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:1.0:1787826381.131043:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778681856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826381.131087:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:1.0:1787826381.131157:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778681856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (10807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826381.131164:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:1.0:1787826381.131184:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1787826381.131190:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778681984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826381.131205:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:1.0:1787826381.131233:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778681984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (6614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826381.131240:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00080000:0.0:1787826381.132685:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826381.132692:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826381.132740:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778681984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826381.132757:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778681856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787826381.696231:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826382.721669:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826382.812957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826382.812996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826382.813023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826382.813045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826382.813063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826382.813089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826382.813112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826382.813132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826382.813157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826382.813186:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789882368 00000100:00100000:2.0:1787826382.813194:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789882368 00000100:00100000:2.0:1787826382.813257:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789882880 00000100:00100000:2.0:1787826382.813260:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789882880 00000100:00100000:2.0:1787826382.813277:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789882240 00000100:00100000:2.0:1787826382.813280:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789882240 00000100:00100000:2.0:1787826382.813295:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789882752 00000100:00100000:2.0:1787826382.813297:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789882752 00000100:00100000:2.0:1787826382.813316:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5123 00000100:00100000:2.0:1787826382.813325:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2400:x1874668789882368:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826382.813404:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2400:x1874668789882368:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 80us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.813413:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5123 00000100:00100000:2.0:1787826382.813431:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5124 00000100:00100000:2.0:1787826382.813437:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+48:2400:x1874668789882880:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826382.813462:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+48:2400:x1874668789882880:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.813468:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5124 00000100:00100000:2.0:1787826382.813480:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5125 00000100:00100000:2.0:1787826382.813486:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789882240:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826382.813525:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789882240:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 39us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.813531:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5125 00000100:00100000:2.0:1787826382.813542:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5126 00000100:00100000:2.0:1787826382.813547:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+27:2400:x1874668789882752:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826382.813567:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+27:2400:x1874668789882752:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.813573:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5126 00000100:00100000:2.0:1787826382.813592:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789882624 00000100:00100000:2.0:1787826382.813596:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789882624 00000100:00100000:2.0:1787826382.813622:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789883136 00000100:00100000:2.0:1787826382.813625:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789883136 00000100:00100000:2.0:1787826382.813641:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789882496 00000100:00100000:2.0:1787826382.813643:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789882496 00000100:00100000:2.0:1787826382.813658:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789883008 00000100:00100000:2.0:1787826382.813660:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789883008 00000100:00100000:2.0:1787826382.813672:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3545 00000100:00100000:2.0:1787826382.813678:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2400:x1874668789882624:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826382.813706:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2400:x1874668789882624:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.813712:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3545 00000100:00100000:2.0:1787826382.813722:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3546 00000100:00100000:2.0:1787826382.813727:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668789883136:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826382.813750:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668789883136:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.813756:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3546 00000100:00100000:2.0:1787826382.813766:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3547 00000100:00100000:2.0:1787826382.813772:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789882496:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826382.813793:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2400:x1874668789882496:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.813798:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3547 00000100:00100000:2.0:1787826382.813809:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3548 00000100:00100000:2.0:1787826382.813815:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789883008:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826382.813837:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789883008:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.813878:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3548 00000100:00080000:2.0:1787826382.813905:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826382.813909:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826382.813911:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826382.813913:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826382.814216:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789882112 00000100:00100000:1.0:1787826382.814221:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789882112 00000100:00100000:1.0:1787826382.814268:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 803 00000100:00100000:1.0:1787826382.814275:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3ddc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2400:x1874668789882112:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826382.814299:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3ddc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2400:x1874668789882112:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826382.814305:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 803 00000100:00100000:2.0:1787826383.680100:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778682496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826383.680174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826383.680242:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874668778683008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680274:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c687310c-1e82-4391-b632-324cfd2cb9dd:3645:1874668778682112:0@lo:400:kworker.0 00000100:00100000:2.0:1787826383.680279:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826383.680308:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778683520:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826383.680337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.680360:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778682624:0@lo:400:kworker.0 00000100:00100000:2.0:1787826383.680365:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787826383.680373:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874668778682368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826383.680411:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778682496 00000100:00100000:2.0:1787826383.680418:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778682496 00000100:00100000:3.0:1787826383.680421:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778683136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.680461:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778683648:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680478:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.680495:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787826383.680500:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778682240:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.680533:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778682752:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.680575:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778683264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.680613:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778683776:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.680686:0:38188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778682112 00000100:00100000:3.0:1787826383.680690:0:38188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778682112 00000100:00100000:3.0:1787826383.680741:0:38188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:3.0:1787826383.680751:0:38188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3ddc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3645:x1874668778682112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680807:0:38188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3ddc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3645:x1874668778682112:12345-0@lo:400:kworker.0 Request processed in 58us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826383.680814:0:38188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:3.0:1787826383.680880:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778683008 00000100:00100000:3.0:1787826383.680884:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778683008 00000100:00100000:3.0:1787826383.680915:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778682624 00000100:00100000:3.0:1787826383.680918:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778682624 00000100:00100000:0.0:1787826383.680927:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c687310c-1e82-4391-b632-324cfd2cb9dd:3645:1874668778682112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.680939:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778683136 00000100:00100000:3.0:1787826383.680943:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778683136 00000100:00100000:3.0:1787826383.680964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778682752 00000100:00100000:3.0:1787826383.680967:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778682752 00000100:00100000:0.0:1787826383.680982:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778683776 00000100:00100000:0.0:1787826383.680987:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778683776 00000100:00100000:3.0:1787826383.680991:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5127 00000100:00100000:3.0:1787826383.680999:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874668778683008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.681034:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874668778683008:12345-0@lo:400:kworker.0 Request processed in 36us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826383.681036:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5128 00000100:00100000:3.0:1787826383.681046:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5127 00000100:00100000:0.0:1787826383.681050:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778682624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.681064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5129 00000100:00100000:3.0:1787826383.681072:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778683136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826383.681100:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778682624:12345-0@lo:400:kworker.0 Request processed in 53us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826383.681108:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5128 00000100:00100000:3.0:1787826383.681113:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778683136:12345-0@lo:400:kworker.0 Request processed in 41us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826383.681120:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5129 00000100:00100000:0.0:1787826383.681125:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5130 00000100:00100000:0.0:1787826383.681135:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778682752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.681137:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5131 00000100:00100000:3.0:1787826383.681148:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778683776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826383.681174:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778682752:12345-0@lo:400:kworker.0 Request processed in 41us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826383.681182:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5130 00000100:00100000:3.0:1787826383.681187:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778683776:12345-0@lo:400:kworker.0 Request processed in 40us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826383.681194:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5131 00000100:00100000:0.0:1787826383.681203:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778683520 00000100:00100000:0.0:1787826383.681208:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778683520 00000100:00100000:3.0:1787826383.681221:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778682240 00000100:00100000:3.0:1787826383.681226:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778682240 00000100:00100000:0.0:1787826383.681245:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778683648 00000100:00100000:0.0:1787826383.681249:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778683648 00000100:00100000:3.0:1787826383.681261:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3447 00000100:00100000:3.0:1787826383.681270:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778682240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826383.681273:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778683264 00000100:00100000:0.0:1787826383.681278:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778683264 00000100:00100000:0.0:1787826383.681302:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3549 00000100:00100000:3.0:1787826383.681309:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778682240:12345-0@lo:400:kworker.0 Request processed in 40us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826383.681311:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778683520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.681323:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3447 00000100:00100000:0.0:1787826383.681355:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778683520:12345-0@lo:400:kworker.0 Request processed in 46us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826383.681362:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3549 00000100:00100000:0.0:1787826383.681380:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3550 00000100:00100000:0.0:1787826383.681386:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778683648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826383.681413:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778683648:12345-0@lo:400:kworker.0 Request processed in 27us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826383.681485:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:2.0:1787826383.681495:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778682496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826383.681515:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826383.681554:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778682496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826383.681560:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:3.0:1787826383.681896:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3551 00000100:00100000:3.0:1787826383.681905:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778683264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.681938:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778683264:12345-0@lo:400:kworker.0 Request processed in 35us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826383.681943:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3551 00000100:00100000:3.0:1787826383.681964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.682004:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778682880:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682031:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.682047:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778683392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826383.682094:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874668778683008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682105:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778683520:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682120:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778682496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826383.682158:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778683392 00000100:00100000:3.0:1787826383.682162:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778683392 00000100:00100000:3.0:1787826383.682190:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3448 00000100:00100000:3.0:1787826383.682197:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778683392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682229:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778683392:12345-0@lo:400:kworker.0 Request processed in 33us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826383.682235:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3448 00000100:00100000:3.0:1787826383.682262:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778683392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682296:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778682880 00000100:00100000:3.0:1787826383.682300:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778682880 00000100:00100000:3.0:1787826383.682320:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3552 00000100:00100000:3.0:1787826383.682327:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778682880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682358:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778682880:12345-0@lo:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826383.682364:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3552 00000100:00100000:3.0:1787826383.682388:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778682880:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682418:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778682368 00000100:00100000:3.0:1787826383.682422:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778682368 00000100:00100000:3.0:1787826383.682445:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5132 00000100:00100000:3.0:1787826383.682451:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874668778682368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682485:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874668778682368:12345-0@lo:400:kworker.0 Request processed in 34us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826383.682491:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5132 00000100:00080000:3.0:1787826383.682513:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826383.682518:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826383.682520:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826383.682522:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826383.682544:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874668778682368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682592:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778682240:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682603:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778682752:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682614:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778683264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682624:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778683776:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.682635:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778682624:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.683957:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778683136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826383.684044:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778683648:0@lo:400:kworker.0 00000100:00100000:0.0:1787826383.687180:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3550 00010000:00010000:3.0:1787826383.746184:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826384.193493:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826384.193517:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778683904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826384.193590:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826384.193870:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778683904 00000100:00100000:0.0:1787826384.193878:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778683904 00000100:00100000:0.0:1787826384.193935:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:0.0:1787826384.193945:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778683904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826384.193972:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:0.0:1787826384.194027:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778683904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826384.194034:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:2.0:1787826384.194641:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778683904:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826384.768095:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826385.728364:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778684032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826385.728433:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826385.728506:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778684032 00000100:00100000:1.0:1787826385.728513:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778684032 00000100:00100000:0.0:1787826385.728740:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826385.728751:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778684160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826385.728782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826385.730909:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778684160 00000100:00100000:1.0:1787826385.730924:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778684160 00000100:00100000:1.0:1787826385.730972:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3449 00000100:00100000:1.0:1787826385.730982:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778684032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826385.731021:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1787826385.731097:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778684032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.731104:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3449 00000100:00100000:1.0:1787826385.731121:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3450 00000100:00100000:1.0:1787826385.731128:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778684160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826385.731145:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00000100:00100000:1.0:1787826385.731179:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874668778684160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.731189:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3450 00000100:00100000:0.0:1787826385.731383:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778684032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826385.733668:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778684160:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826385.792808:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826386.248897:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778684288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826386.248970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826386.249051:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778684288 00000100:00100000:3.0:1787826386.249058:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778684288 00000100:00100000:3.0:1787826386.249127:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00100000:3.0:1787826386.249138:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778684288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826386.249166:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:3.0:1787826386.249212:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778684288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826386.249221:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00080000:3.0:1787826386.249241:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826386.249276:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778684288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826386.250256:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826386.250271:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778684416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826386.250322:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826386.250435:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778684416 00000100:00100000:3.0:1787826386.250441:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778684416 00000100:00100000:3.0:1787826386.250503:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00100000:3.0:1787826386.250513:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778684416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826386.250536:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:3.0:1787826386.250578:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778684416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826386.250586:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00100000:3.0:1787826386.250621:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778684416:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787826386.250696:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787826386.816671:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826387.841009:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826387.923981:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826387.924027:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826387.924062:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826387.924095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826387.924117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826387.924141:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826387.924158:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826387.924176:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826387.924198:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826387.924225:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789883776 00000100:00100000:3.0:1787826387.924235:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789883776 00000100:00100000:3.0:1787826387.924284:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789884288 00000100:00100000:3.0:1787826387.924287:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789884288 00000100:00100000:3.0:1787826387.924308:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789883648 00000100:00100000:3.0:1787826387.924311:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789883648 00000100:00100000:3.0:1787826387.924326:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789884160 00000100:00100000:3.0:1787826387.924329:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789884160 00000100:00100000:3.0:1787826387.924346:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3553 00000100:00100000:3.0:1787826387.924354:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789883776:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826387.924423:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789883776:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 68us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.924430:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3553 00000100:00100000:3.0:1787826387.924446:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3554 00000100:00100000:3.0:1787826387.924453:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789884288:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826387.924481:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789884288:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.924487:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3554 00000100:00100000:3.0:1787826387.924500:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3555 00000100:00100000:3.0:1787826387.924506:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789883648:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826387.924529:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2399:x1874668789883648:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.924534:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3555 00000100:00100000:3.0:1787826387.924545:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3556 00000100:00100000:3.0:1787826387.924550:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789884160:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826387.924574:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789884160:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.924580:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3556 00000100:00100000:1.0:1787826387.924636:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789883520 00000100:00100000:1.0:1787826387.924642:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789883520 00000100:00100000:1.0:1787826387.924684:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789884032 00000100:00100000:1.0:1787826387.924687:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789884032 00000100:00100000:1.0:1787826387.924710:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789883392 00000100:00100000:1.0:1787826387.924713:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789883392 00000100:00100000:1.0:1787826387.924733:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789883904 00000100:00100000:1.0:1787826387.924736:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789883904 00000100:00100000:0.0:1787826387.924804:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789883264 00000100:00100000:0.0:1787826387.924819:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789883264 00000100:00100000:0.0:1787826387.924880:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 805 00000100:00100000:0.0:1787826387.924889:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3ddc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789883264:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826387.924920:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3ddc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668789883264:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 33us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.924928:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 805 00000100:00100000:1.0:1787826387.925006:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5133 00000100:00100000:1.0:1787826387.925015:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789883520:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826387.925051:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789883520:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 38us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.925058:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5133 00000100:00100000:1.0:1787826387.925071:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5134 00000100:00100000:1.0:1787826387.925077:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789884032:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826387.925101:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668789884032:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.925108:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5134 00000100:00100000:1.0:1787826387.925120:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5135 00000100:00100000:1.0:1787826387.925126:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789883392:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826387.925147:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789883392:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.925153:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5135 00000100:00100000:1.0:1787826387.925164:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5136 00000100:00100000:1.0:1787826387.925170:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789883904:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826387.925190:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789883904:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 19us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.925195:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5136 00000100:00080000:2.0:1787826387.929191:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826387.929201:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826387.929205:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826387.929210:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1787826388.186746:0:58771:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 103: Purge all requests =============== 06:26:26 (1787826386) 00000100:00100000:3.0:1787826388.528353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.528708:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789884544 00000100:00100000:0.0:1787826388.528720:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789884544 00000100:00100000:0.0:1787826388.528788:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111647 00000100:00100000:0.0:1787826388.528800:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+25:86609:x1874668789884544:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826388.528841:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.528908:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bf3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc234 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.528982:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.528997:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529010:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529025:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529032:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529038:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529130:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bf50 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529139:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529146:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826388.529155:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787826388.529235:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529243:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529249:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529256:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529261:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.529265:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529273:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529283:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bbe0a651100) 00010000:00010000:0.0:1787826388.529286:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.529291:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529297:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529310:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529315:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529321:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529326:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.529329:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529338:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529345:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bbe12dd8c00) 00010000:00010000:0.0:1787826388.529348:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.529350:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529356:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529632:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349bf3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc234 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529648:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bf50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc234 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.529655:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826388.529658:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.529661:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3600, rc 0) 00000100:00100000:0.0:1787826388.529736:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+27:86609:x1874668789884544:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 938us (1391us total) trans 8590016716 rc 0/0 00000100:00100000:0.0:1787826388.529744:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111647 00000100:00100000:2.0:1787826388.532959:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.533020:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789884800 00000100:00100000:0.0:1787826388.533039:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789884800 00000100:00100000:2.0:1787826388.533056:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.533094:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2728 00000100:00100000:0.0:1787826388.533104:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+27:86609:x1874668789884800:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826388.533193:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789884928 00000100:00100000:1.0:1787826388.533198:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789884928 00000100:00100000:1.0:1787826388.533240:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17288 00000100:00100000:1.0:1787826388.533247:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789884928:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826388.533257:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826388.533280:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349bf50 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc234 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.533297:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826388.533303:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826388.533313:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86609:x1874668789884800:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 211us (363us total) trans 8590016717 rc 0/0 00000100:00100000:1.0:1787826388.533318:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789884928:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 73us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.533320:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2728 00000100:00100000:1.0:1787826388.533324:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17288 00000100:00100000:1.0:1787826388.536960:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826388.537125:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789885056 00000100:00100000:2.0:1787826388.537135:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789885056 00000100:00100000:2.0:1787826388.537189:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111648 00000100:00100000:2.0:1787826388.537198:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+27:86609:x1874668789885056:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787826388.537304:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+27:86609:x1874668789885056:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826388.537312:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111648 00000100:00100000:3.0:1787826388.538890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826388.538962:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789885184 00000100:00100000:2.0:1787826388.538970:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789885184 00000100:00100000:2.0:1787826388.539010:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111649 00000100:00100000:2.0:1787826388.539018:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+23:86609:x1874668789885184:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787826388.539112:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+23:86609:x1874668789885184:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826388.539118:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111649 00000100:00100000:3.0:1787826388.574082:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826388.574127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.574276:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789885312 00000100:00100000:0.0:1787826388.574286:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789885312 00000100:00100000:1.0:1787826388.574291:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789885568 00000100:00100000:1.0:1787826388.574295:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789885568 00000100:00100000:1.0:1787826388.574344:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111650 00000100:00100000:0.0:1787826388.574350:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111651 00000100:00100000:1.0:1787826388.574353:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+28:86610:x1874668789885568:12345-192.168.203.9@tcp:36:mkdir.0 00000100:00100000:0.0:1787826388.574356:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+28:2399:x1874668789885312:12345-192.168.203.9@tcp:41:mkdir.0 00000004:00000024:0.0:1787826388.574385:0:23845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440522240 avail 1294282752 00010000:00010000:1.0:1787826388.574403:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826388.574428:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794e00/0x68019081f34949e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f8cc6 expref: 28 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826388.574447:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+27:2399:x1874668789885312:12345-192.168.203.9@tcp:41:mkdir.0 Request processed in 91us (376us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826388.574451:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00000100:00100000:0.0:1787826388.574454:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111651 00010000:00010000:1.0:1787826388.574455:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826388.574513:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.574527:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f3494a25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f8cdb expref: 26 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.574536:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.574567:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f3494a25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f8cdb expref: 26 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.574580:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f3494a25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f8cdb expref: 26 pid: 25759 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826388.574663:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778684544:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826388.574731:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17885a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826388.582684:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826388.582874:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789885696 00000100:00100000:3.0:1787826388.582883:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789885696 00000100:00100000:2.0:1787826388.582905:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778684544:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826388.582927:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f3494a25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f8cdb expref: 27 pid: 25759 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.582932:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826388.582978:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3106 00000100:00100000:3.0:1787826388.582989:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2402:x1874668789885696:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826388.583003:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826388.583011:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f3494a25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f8cdb expref: 27 pid: 25759 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.583024:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f3494a25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f8cdb expref: 27 pid: 25759 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.583048:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f3494a25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8f8cdb expref: 27 pid: 25759 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.583063:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:3.0:1787826388.583067:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.583076:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.583083:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.583112:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826388.583137:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.583147:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826388.583165:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2402:x1874668789885696:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 178us (490us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826388.583173:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1b19522f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826388.583174:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3106 00010000:00010000:2.0:1787826388.583188:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.583197:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584078:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584093:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584100:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826388.584115:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e804e878 reply state 000000005eb4a8d5 transno 8590016718 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584125:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584132:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.584135:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826388.584138:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787826388.584144:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4c:0x0]: returning size 4096 00010000:00010000:2.0:1787826388.584151:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584158:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584165:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584171:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.584176:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584184:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584193:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:2.0:1787826388.584196:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.584199:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584204:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349bf5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826388.584216:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e804e878 reply state 000000005eb4a8d5 transno 8590016718 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584223:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.584230:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1b19522f (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826388.584232:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826388.584234:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787826388.584302:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+28:86610:x1874668789885568:12345-192.168.203.9@tcp:36:mkdir.0 Request processed in 9948us (10172us total) trans 8590016718 rc 0/0 00000100:00100000:2.0:1787826388.584310:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111650 00000100:00100000:1.0:1787826388.611065:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.611160:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789885824 00000100:00100000:0.0:1787826388.611169:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789885824 00000100:00100000:0.0:1787826388.611228:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111652 00000100:00100000:0.0:1787826388.611238:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+28:86612:x1874668789885824:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826388.611264:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.611283:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc23b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.611345:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.611359:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.611370:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826388.611418:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826388.611423:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826388.611442:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.611466:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bf73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc23b expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.611483:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc23b expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.611491:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826388.611494:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826388.611498:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:0.0:1787826388.611561:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+29:86612:x1874668789885824:12345-192.168.203.9@tcp:101:bash.0 Request processed in 325us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.611569:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111652 00000100:00100000:3.0:1787826388.613777:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826388.613919:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789885952 00000100:00100000:2.0:1787826388.613929:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789885952 00000100:00100000:2.0:1787826388.613981:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111653 00000100:00100000:2.0:1787826388.613992:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+29:86612:x1874668789885952:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826388.614008:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826388.614028:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349bf81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc242 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614089:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614102:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614113:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614123:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614130:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614137:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614206:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bf96 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614214:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bf96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614221:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bf96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826388.614258:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4c:0x0]: returning size 4096 00000004:00200000:2.0:1787826388.614262:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826388.614280:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bf96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614291:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614297:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614304:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614310:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.614313:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614320:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614330:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:2.0:1787826388.614333:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.614337:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614343:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349bf88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614355:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614364:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614369:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614374:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.614376:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614383:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614390:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1b19522f (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826388.614393:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.614395:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614401:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349bf8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614424:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349bf81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc242 expref: 31 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614438:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3800/0x68019081f349bf96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc242 expref: 30 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.614445:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.614447:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787826388.614450:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3800, rc 0) 00000100:00100000:2.0:1787826388.614559:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+30:86612:x1874668789885952:12345-192.168.203.9@tcp:101:bash.0 Request processed in 568us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826388.614566:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111653 00000100:00100000:3.0:1787826388.619113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826388.625004:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789886080 00000100:00100000:2.0:1787826388.625019:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789886080 00000100:00100000:2.0:1787826388.625126:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111654 00000100:00100000:2.0:1787826388.625137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+30:86612:x1874668789886080:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826388.625158:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826388.625178:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf9d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc249 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625241:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625254:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625264:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625279:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625286:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625292:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625331:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625339:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625345:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625353:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625358:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.625362:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625370:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625381:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.625384:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.625388:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625395:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfa4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625410:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625417:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625423:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625429:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.625432:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625437:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625444:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xbc0ca3a9 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826388.625446:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.625449:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625453:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bfab lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625482:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf9d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc249 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625493:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.625496:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.625499:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bf9d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc249 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.625508:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826388.625581:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+30:86612:x1874668789886080:12345-192.168.203.9@tcp:101:bash.0 Request processed in 446us (6476us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826388.625601:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111654 00000100:00100000:1.0:1787826388.637045:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.637152:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789886208 00000100:00100000:0.0:1787826388.637161:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789886208 00000100:00100000:0.0:1787826388.637226:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111655 00000100:00100000:0.0:1787826388.637237:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+26:86613:x1874668789886208:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826388.637256:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.637275:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bfb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc250 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.637334:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.637350:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.637359:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826388.637401:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826388.637404:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826388.637422:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.637442:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bfb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc250 expref: 28 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.637458:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc250 expref: 27 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.637465:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826388.637468:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826388.637471:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3800, rc 0) 00000100:00100000:0.0:1787826388.637536:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+27:86613:x1874668789886208:12345-192.168.203.9@tcp:101:rm.0 Request processed in 300us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.637543:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111655 00000100:00100000:3.0:1787826388.645783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.645966:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789886336 00000100:00100000:1.0:1787826388.645976:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789886336 00000100:00100000:1.0:1787826388.646039:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111656 00000100:00100000:1.0:1787826388.646048:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+27:86613:x1874668789886336:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826388.646067:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826388.646088:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bfc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc257 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646144:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646159:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646176:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646188:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646196:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646212:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646289:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bfd5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646298:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646305:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826388.646337:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4c:0x0]: returning size 4096 00000004:00200000:1.0:1787826388.646341:0:45682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826388.646359:0:45682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646373:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646379:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646386:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646392:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826388.646396:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646404:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646416:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:1.0:1787826388.646419:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.646424:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646430:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349bfc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646445:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646451:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646457:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646462:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826388.646465:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646471:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646478:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1b19522f (ffff9bbe0fe8c100) 00010000:00010000:1.0:1787826388.646480:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.646483:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646490:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349bfce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646514:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349bfc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc257 expref: 29 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646528:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6e00/0x68019081f349bfd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc257 expref: 28 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.646535:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826388.646538:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787826388.646540:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6e00, rc 0) 00000100:00100000:1.0:1787826388.646614:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86613:x1874668789886336:12345-192.168.203.9@tcp:101:rm.0 Request processed in 567us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.646622:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111656 00000100:00100000:3.0:1787826388.649389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.649490:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789886464 00000100:00100000:0.0:1787826388.649500:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789886464 00000100:00100000:0.0:1787826388.649559:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111657 00000100:00100000:0.0:1787826388.649569:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86613:x1874668789886464:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826388.649602:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.649624:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bfdc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc25e expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651892:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651910:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651920:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651932:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651936:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651940:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651981:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651985:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651989:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651994:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.651998:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.652001:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652345:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652362:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.652365:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.652370:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652377:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349bfe3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652394:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652401:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652406:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652462:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.652465:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652470:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652475:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xbc0ca3a9 (ffff9bbe12dd8c00) 00010000:00010000:0.0:1787826388.652477:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.652479:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652483:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349bfea lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652513:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bfdc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc25e expref: 29 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652520:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.652522:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.652524:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349bfdc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc25e expref: 29 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.652530:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:1.0:1787826388.653302:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86613:x1874668789886464:12345-192.168.203.9@tcp:101:rm.0 Request processed in 3729us (3916us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826388.653314:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111657 00000100:00100000:3.0:1787826388.657641:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826388.657827:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789886592 00000100:00100000:2.0:1787826388.657836:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789886592 00000100:00100000:2.0:1787826388.657929:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111658 00000100:00100000:2.0:1787826388.657939:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86613:x1874668789886592:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826388.657958:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826388.657978:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bff1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc265 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658038:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658051:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658062:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658075:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658082:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658088:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658121:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658127:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658134:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658140:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.658144:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658152:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658164:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.658167:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.658170:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658176:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349bff8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658190:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658206:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658212:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658217:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.658219:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658226:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658237:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xbc0ca3a9 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826388.658240:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.658242:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658248:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349bfff lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658284:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bff1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc265 expref: 29 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658294:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.658297:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.658300:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349bff1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc265 expref: 29 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.658310:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826388.658367:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86613:x1874668789886592:12345-192.168.203.9@tcp:101:rm.0 Request processed in 429us (733us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826388.658374:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111658 00000100:00100000:3.0:1787826388.678571:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.678835:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789886720 00000100:00100000:0.0:1787826388.678845:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789886720 00000100:00100000:0.0:1787826388.679087:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111659 00000100:00100000:0.0:1787826388.679098:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86614:x1874668789886720:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826388.679118:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.679138:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c006 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc26c expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679312:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679327:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679338:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679354:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679361:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679368:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679406:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679413:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679420:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679427:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679434:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.679438:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679445:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679455:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.679458:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.679462:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679469:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c00d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679482:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679487:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679494:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679499:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.679502:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679508:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679514:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xbc0ca3a9 (ffff9bbe12dd8c00) 00010000:00010000:0.0:1787826388.679517:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.679519:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679523:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c014 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679555:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c006 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc26c expref: 29 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679572:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.679575:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.679579:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c006 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc26c expref: 29 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.679940:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:1.0:1787826388.680194:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86614:x1874668789886720:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1095us (1630us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826388.680210:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111659 00000100:00100000:3.0:1787826388.683443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.683519:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789886848 00000100:00100000:0.0:1787826388.683527:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789886848 00000100:00100000:0.0:1787826388.683591:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111660 00000100:00100000:0.0:1787826388.683601:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86614:x1874668789886848:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826388.683620:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.683642:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349c01b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc273 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683725:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683741:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683751:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683768:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683775:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683787:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683832:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683839:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683846:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683886:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.683890:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683898:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683910:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.683913:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.683917:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683923:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c022 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683935:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683941:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683946:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683951:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.683953:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683959:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683965:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xbc0ca3a9 (ffff9bbe12dd8900) 00010000:00010000:0.0:1787826388.683967:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.683970:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.683975:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c029 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.684007:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349c01b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc273 expref: 29 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.684017:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.684020:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.684024:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349c01b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc273 expref: 29 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.684033:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3c00, rc 0) 00000100:00100000:0.0:1787826388.684098:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86614:x1874668789886848:12345-192.168.203.9@tcp:101:cp.0 Request processed in 498us (663us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826388.684109:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111660 00000100:00100000:3.0:1787826388.689243:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.689350:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789887104 00000100:00100000:1.0:1787826388.689361:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789887104 00000100:00100000:1.0:1787826388.689421:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111661 00000100:00100000:1.0:1787826388.689431:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+28:86614:x1874668789887104:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826388.689450:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826388.689469:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c030 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc27a expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.689575:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.689591:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.689602:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.689617:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.689624:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.689632:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826388.690016:0:45682:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc9:0x0], index 0: 0 00010000:00010000:1.0:1787826388.690350:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349c045 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690361:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349c045 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690368:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349c045 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690401:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690409:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690416:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690422:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826388.690427:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690434:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690446:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826388.690449:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.690453:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690465:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c037 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826388.690478:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003663a2cc reply state 00000000bf4390ad transno 8590016719 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690489:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690495:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xbc0ca3a9 (ffff9bbe0bd66a00) 00010000:00010000:1.0:1787826388.690497:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826388.690500:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826388.690531:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c030 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc27a expref: 31 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690546:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7400/0x68019081f349c045 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc27a expref: 30 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.690554:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x134:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:1.0:1787826388.690556:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826388.690559:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7400, rc 0) 00000100:00100000:1.0:1787826388.690631:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+31:86614:x1874668789887104:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1201us (1401us total) trans 8590016719 rc 0/0 00000100:00100000:1.0:1787826388.690639:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111661 00000100:00100000:3.0:1787826388.696303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.696412:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789887232 00000100:00100000:0.0:1787826388.696421:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789887232 00000100:00100000:0.0:1787826388.696469:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6330 00000100:00100000:0.0:1787826388.696479:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789887232:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826388.696496:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.696516:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc281 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826388.696540:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826388.696559:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=3026s v=(0 0) 00010000:00010000:0.0:1787826388.696564:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826388.696573:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc281 expref: 12 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.696591:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc281 expref: 12 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.696604:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:0.0:1787826388.696665:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2402:x1874668789887232:12345-192.168.203.9@tcp:101:cp.0 Request processed in 187us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.696672:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6330 00000100:00100000:3.0:1787826388.700273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.700372:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789887360 00000100:00100000:0.0:1787826388.700382:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789887360 00000100:00100000:0.0:1787826388.700438:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6331 00000100:00100000:0.0:1787826388.700449:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:86614:x1874668789887360:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826388.700468:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.700486:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc288 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.700517:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc281 expref: 13 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.700527:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826388.700531:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826388.700536:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.700569:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc281 expref: 13 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.700593:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc281 expref: 13 pid: 25038 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826388.700610:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159cb840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778684672:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826388.700712:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826388.704231:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826388.704410:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789887488 00000100:00100000:2.0:1787826388.704420:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789887488 00010000:00010000:2.0:1787826388.704459:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc281 expref: 14 pid: 25038 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826388.704496:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3107 00000100:00100000:2.0:1787826388.704505:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789887488:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826388.704520:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826388.704540:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc281 expref: 14 pid: 25038 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.704554:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc281 expref: 14 pid: 25038 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.704580:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826388.704596:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826388.704605:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 14 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.704615:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 14 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.704649:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 14 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826388.704662:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f4f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778684800:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826388.704762:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826388.707349:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f4f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778684800:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826388.707374:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826388.707434:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789887488:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2929us (3211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.707446:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3107 00010000:00010000:0.0:1787826388.712120:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005552d7ba/0x68019081f349c053 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc281 expref: 13 pid: 25038 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826388.712146:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159cb840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874668778684672:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826388.712180:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.712285:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3c00, rc 0) 00000100:00100000:1.0:1787826388.712431:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:86614:x1874668789887360:12345-192.168.203.9@tcp:101:cp.0 Request processed in 11983us (12165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.712441:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6331 00000100:00100000:3.0:1787826388.715342:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.715436:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789887744 00000100:00100000:1.0:1787826388.715445:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789887744 00000100:00100000:1.0:1787826388.715496:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2729 00000100:00100000:1.0:1787826388.715506:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:86614:x1874668789887744:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:1.0:1787826388.715793:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86614:x1874668789887744:12345-192.168.203.9@tcp:35:cp.0 Request processed in 288us (460us total) trans 8590016720 rc 0/0 00000100:00100000:1.0:1787826388.715800:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2729 00000100:00100000:3.0:1787826388.774336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.774408:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789887872 00000100:00100000:0.0:1787826388.774417:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789887872 00000100:00100000:0.0:1787826388.774468:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111662 00000100:00100000:0.0:1787826388.774477:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+30:86617:x1874668789887872:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826388.774496:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.774516:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c061 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774575:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774756:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774768:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774785:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774792:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774798:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774845:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774872:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774878:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774886:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774891:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.774895:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774902:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774913:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.774916:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.774920:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774926:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c068 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774939:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774944:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774950:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774956:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.774960:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774965:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774971:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9b50d0cc (ffff9bbe12dd8900) 00010000:00010000:0.0:1787826388.774973:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.774976:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.774981:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c06f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.775008:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c061 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc28f expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.775017:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.775019:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.775022:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c061 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc28f expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.775031:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:0.0:1787826388.775123:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+30:86617:x1874668789887872:12345-192.168.203.9@tcp:101:bash.0 Request processed in 647us (796us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826388.775132:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111662 00000100:00100000:3.0:1787826388.799479:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826388.800159:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789888000 00000100:00100000:2.0:1787826388.800168:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789888000 00000100:00100000:2.0:1787826388.800223:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111663 00000100:00100000:2.0:1787826388.800233:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86618:x1874668789888000:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826388.800257:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826388.800277:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c076 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc296 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800335:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800349:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800360:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800372:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800379:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800386:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800420:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800426:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800431:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800436:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.800440:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800450:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800461:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.800464:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.800468:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800474:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c07d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800488:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800494:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800500:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800504:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.800507:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800511:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800516:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9b50d0cc (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826388.800518:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.800521:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800527:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c084 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800554:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c076 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc296 expref: 33 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800563:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.800565:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.800568:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c076 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc296 expref: 33 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.800576:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826388.800647:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86618:x1874668789888000:12345-192.168.203.9@tcp:101:rm.0 Request processed in 415us (1177us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826388.800654:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111663 00000100:00100000:1.0:1787826388.802455:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826388.802477:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778684928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826388.802538:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826388.802594:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778685312:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.802623:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826388.802647:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778685824:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.802667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826388.802694:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778686336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.802717:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826388.802733:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787826388.802738:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778685440:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.802757:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826388.802774:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778685952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.802793:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826388.802821:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778686464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.802841:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826388.802878:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c687310c-1e82-4391-b632-324cfd2cb9dd:3645:1874668778685056:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.802889:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778686336 00000100:00100000:1.0:1787826388.802896:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778686336 00000100:00100000:2.0:1787826388.802911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826388.802930:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778685568:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.802942:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778686464 00000100:00100000:1.0:1787826388.802945:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778686464 00000100:00100000:2.0:1787826388.802949:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826388.802965:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778686080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.802967:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3557 00000100:00100000:1.0:1787826388.802975:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778686336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.802983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826388.802997:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826388.803002:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778685184:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.803019:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778686336:12345-0@lo:400:kworker.0 Request processed in 44us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826388.803024:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826388.803026:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3557 00000100:00100000:2.0:1787826388.803036:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0c8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778685696:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.803038:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778686080 00000100:00100000:1.0:1787826388.803041:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778686080 00000100:00100000:2.0:1787826388.803056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826388.803070:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778686208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.803099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826388.803126:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778685184 00000100:00100000:2.0:1787826388.803129:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778685184 00000100:00100000:2.0:1787826388.803155:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778686208 00000100:00100000:2.0:1787826388.803157:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778686208 00000100:00100000:2.0:1787826388.803175:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3451 00000100:00100000:3.0:1787826388.803177:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778684928 00000100:00100000:2.0:1787826388.803181:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778685184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826388.803181:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778684928 00000100:00100000:2.0:1787826388.803217:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778685184:12345-0@lo:400:kworker.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826388.803219:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:2.0:1787826388.803223:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3451 00000100:00100000:3.0:1787826388.803226:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778684928:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826388.803235:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3452 00000100:00100000:2.0:1787826388.803240:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778686208:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787826388.803246:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570020160 pending 0 free 3828588544 avail 3597066240 00000100:00100000:2.0:1787826388.803264:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778686208:12345-0@lo:400:kworker.0 Request processed in 25us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826388.803270:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3452 00000100:00100000:3.0:1787826388.803272:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778684928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826388.803278:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:0.0:1787826388.803363:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778685312 00000100:00100000:0.0:1787826388.803368:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778685312 00000100:00100000:0.0:1787826388.803395:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778685824 00000100:00100000:0.0:1787826388.803398:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778685824 00000100:00100000:0.0:1787826388.803491:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778685440 00000100:00100000:0.0:1787826388.803495:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778685440 00000100:00100000:0.0:1787826388.803515:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778685952 00000100:00100000:0.0:1787826388.803518:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778685952 00000100:00100000:0.0:1787826388.803534:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778685568 00000100:00100000:0.0:1787826388.803536:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778685568 00000100:00100000:0.0:1787826388.803553:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5137 00000100:00100000:0.0:1787826388.803559:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778685312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826388.803593:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778685312:12345-0@lo:400:kworker.0 Request processed in 34us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.803599:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5137 00000100:00100000:0.0:1787826388.803611:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5138 00000100:00100000:0.0:1787826388.803617:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778685824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826388.803642:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778685824:12345-0@lo:400:kworker.0 Request processed in 26us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.803647:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5138 00000100:00100000:0.0:1787826388.803656:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5139 00000100:00100000:0.0:1787826388.803661:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778685440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826388.803685:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778685440:12345-0@lo:400:kworker.0 Request processed in 24us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.803690:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5139 00000100:00100000:0.0:1787826388.803786:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5140 00000100:00100000:0.0:1787826388.803793:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778685952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826388.803832:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778685952:12345-0@lo:400:kworker.0 Request processed in 39us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.803838:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5140 00000100:00100000:0.0:1787826388.803848:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5141 00000100:00100000:2.0:1787826388.803930:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778685184:0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.803948:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778686208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.803973:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778686592:0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.804002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826388.804030:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778686592 00000100:00100000:2.0:1787826388.804034:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778686592 00000100:00100000:2.0:1787826388.804053:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5142 00000100:00100000:2.0:1787826388.804058:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778686592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.804095:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778686592:12345-0@lo:400:kworker.0 Request processed in 36us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826388.804101:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5142 00000100:00100000:2.0:1787826388.804123:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778686592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826388.804513:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778685568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826388.804556:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778685568:12345-0@lo:400:kworker.0 Request processed in 703us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.804562:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5141 00000100:00080000:0.0:1787826388.804617:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826388.804622:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826388.804625:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826388.804627:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826388.804798:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778685696 00000100:00100000:1.0:1787826388.804818:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778685696 00000100:00100000:1.0:1787826388.804845:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3558 00000100:00100000:1.0:1787826388.804864:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778686464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.804901:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778686464:12345-0@lo:400:kworker.0 Request processed in 51us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.804907:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3558 00000100:00100000:1.0:1787826388.804920:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3559 00000100:00100000:1.0:1787826388.804927:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778686080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.804953:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778686080:12345-0@lo:400:kworker.0 Request processed in 28us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.804959:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3559 00000100:00100000:1.0:1787826388.804970:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3560 00000100:00100000:1.0:1787826388.804975:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778685696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.805000:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778685696:12345-0@lo:400:kworker.0 Request processed in 25us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.805005:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3560 00000100:00100000:1.0:1787826388.805022:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778685056 00000100:00100000:1.0:1787826388.805026:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778685056 00000100:00100000:1.0:1787826388.805050:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1787826388.805056:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3ddc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3645:x1874668778685056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.805085:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3ddc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3645:x1874668778685056:12345-0@lo:400:kworker.0 Request processed in 29us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.805091:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1787826388.805138:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778685440:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.805150:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778685952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.805159:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778686464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.805169:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778685312:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.805180:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778685824:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.805189:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778686336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826388.805370:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778684928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826388.805672:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778685696:0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.805682:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c687310c-1e82-4391-b632-324cfd2cb9dd:3645:1874668778685056:0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.805708:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0c8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778685568:0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.805720:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778686080:0@lo:400:kworker.0 00000100:00100000:2.0:1787826388.806327:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.806395:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789888128 00000100:00100000:0.0:1787826388.806400:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789888128 00000100:00100000:0.0:1787826388.806468:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111664 00000100:00100000:0.0:1787826388.806477:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86618:x1874668789888128:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826388.806491:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.806511:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c08b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc29d expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806571:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806599:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806610:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806625:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806632:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806639:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806672:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806679:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806925:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806931:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.806936:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806943:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806957:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.806959:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.806964:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806970:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c092 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806984:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806991:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.806996:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.807002:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.807004:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.807010:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.807017:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9b50d0cc (ffff9bbe12dd8900) 00010000:00010000:0.0:1787826388.807019:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.807022:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.807028:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c099 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.807059:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c08b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc29d expref: 33 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.807069:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.807072:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.807075:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c08b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc29d expref: 33 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.807090:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:0.0:1787826388.807150:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86618:x1874668789888128:12345-192.168.203.9@tcp:101:rm.0 Request processed in 674us (826us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826388.807158:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111664 00000100:00100000:3.0:1787826388.822155:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.822252:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789888256 00000100:00100000:0.0:1787826388.822263:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789888256 00000100:00100000:0.0:1787826388.822322:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111665 00000100:00100000:0.0:1787826388.822331:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86619:x1874668789888256:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826388.822350:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.822369:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c0a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2a4 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822429:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822443:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822454:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822469:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822476:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822483:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822521:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822527:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822534:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822539:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.822543:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822551:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822561:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.822564:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.822569:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822574:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c0a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822588:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822593:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822599:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822604:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.822607:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822613:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822625:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9b50d0cc (ffff9bbe12dd8900) 00010000:00010000:0.0:1787826388.822627:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.822630:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822636:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c0ae lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822669:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c0a0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2a4 expref: 33 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822678:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.822681:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.822684:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c0a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2a4 expref: 33 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.822818:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:1.0:1787826388.823969:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86619:x1874668789888256:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1632us (1816us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826388.823984:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111665 00000100:00100000:1.0:1787826388.826899:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.827001:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789888384 00000100:00100000:0.0:1787826388.827010:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789888384 00000100:00100000:0.0:1787826388.827111:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111666 00000100:00100000:0.0:1787826388.827122:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86619:x1874668789888384:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826388.827144:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.827164:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c0b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2ab expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827300:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827315:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827327:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827343:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827350:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827357:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827395:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827402:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827409:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827415:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.827420:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827427:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827438:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.827440:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.827445:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827452:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c0bc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827465:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827471:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827477:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827482:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.827485:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827491:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827498:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9b50d0cc (ffff9bbe12dd8e00) 00010000:00010000:0.0:1787826388.827501:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.827504:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827510:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c0c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827543:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c0b5 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2ab expref: 33 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827553:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.827556:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.827560:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c0b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2ab expref: 33 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.827569:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc 0) 00000100:00100000:0.0:1787826388.827933:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86619:x1874668789888384:12345-192.168.203.9@tcp:101:cp.0 Request processed in 811us (1040us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826388.827941:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111666 00000100:00100000:3.0:1787826388.831085:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.831151:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789888640 00000100:00100000:1.0:1787826388.831161:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789888640 00000100:00100000:1.0:1787826388.831231:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111667 00000100:00100000:1.0:1787826388.831241:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:86619:x1874668789888640:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826388.831259:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826388.831278:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c0ca lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831375:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831390:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831401:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831414:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831421:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831428:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826388.831745:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xca:0x0], index 1: 0 00010000:00010000:1.0:1787826388.831915:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349c0df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x135:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831924:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349c0df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831931:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349c0df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831958:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831964:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831970:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831977:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831981:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826388.831986:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.831999:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.832012:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826388.832015:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.832020:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.832027:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c0d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826388.832041:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf154dbe reply state 00000000b3b30936 transno 8590016721 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.832052:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.832058:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9b50d0cc (ffff9bbe0bd66c00) 00010000:00010000:1.0:1787826388.832061:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826388.832064:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826388.832092:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349c0ca lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b2 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.832106:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7800/0x68019081f349c0df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b2 expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.832112:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x135:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:1.0:1787826388.832115:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826388.832117:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7800, rc 0) 00000100:00100000:1.0:1787826388.832182:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+35:86619:x1874668789888640:12345-192.168.203.9@tcp:101:cp.0 Request processed in 942us (1105us total) trans 8590016721 rc 0/0 00000100:00100000:1.0:1787826388.832190:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111667 00000100:00100000:2.0:1787826388.835284:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.835349:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789888768 00000100:00100000:1.0:1787826388.835358:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789888768 00000100:00100000:1.0:1787826388.835414:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6332 00000100:00100000:1.0:1787826388.835424:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+8:2399:x1874668789888768:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826388.835442:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826388.835462:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2b9 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826388.835488:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826388.835507:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=3026s v=(0 0) 00010000:00010000:1.0:1787826388.835511:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826388.835521:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b9 expref: 9 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.835540:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b9 expref: 9 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.835555:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826388.835634:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2399:x1874668789888768:12345-192.168.203.9@tcp:101:cp.0 Request processed in 211us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.835641:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6332 00000100:00100000:3.0:1787826388.838681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.839257:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789888896 00000100:00100000:1.0:1787826388.839266:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789888896 00000100:00100000:1.0:1787826388.839323:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6333 00000100:00100000:1.0:1787826388.839332:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+9:86619:x1874668789888896:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826388.839346:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826388.839362:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2c0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.839393:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b9 expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.839402:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826388.839406:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826388.839411:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.839447:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b9 expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.839461:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b9 expref: 10 pid: 8605 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826388.839473:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778686720:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826388.839559:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17885b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826388.842843:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.843018:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778686720:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826388.843051:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.843071:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826388.843132:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:86619:x1874668789888896:12345-192.168.203.9@tcp:101:cp.0 Request processed in 3801us (4460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.843140:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6333 00000100:00100000:1.0:1787826388.843563:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789889024 00000100:00100000:1.0:1787826388.843570:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789889024 00010000:00010000:1.0:1787826388.843600:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b9 expref: 10 pid: 8605 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826388.843636:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3108 00000100:00100000:1.0:1787826388.843645:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789889024:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826388.843661:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826388.843690:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b9 expref: 10 pid: 8605 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.843702:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b9 expref: 10 pid: 8605 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.843723:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d7a2da9/0x68019081f349c0ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2b9 expref: 10 pid: 8605 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.843737:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826388.843740:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826388.843748:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 9 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.843758:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 9 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.843785:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 9 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826388.843798:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778686848:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826388.844013:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17885b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826388.847132:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778686848:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826388.847159:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826388.847216:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789889024:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3571us (4381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.847225:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3108 00000100:00100000:3.0:1787826388.855352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.855452:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789889280 00000100:00100000:0.0:1787826388.855462:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789889280 00000100:00100000:0.0:1787826388.855519:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2730 00000100:00100000:0.0:1787826388.855529:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+35:86619:x1874668789889280:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826388.855828:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86619:x1874668789889280:12345-192.168.203.9@tcp:35:cp.0 Request processed in 299us (484us total) trans 8590016722 rc 0/0 00000100:00100000:0.0:1787826388.855835:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2730 00010000:00010000:3.0:1787826388.864109:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826388.894134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826388.894226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789889408 00000100:00100000:2.0:1787826388.894235:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789889408 00000100:00100000:2.0:1787826388.894290:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111668 00000100:00100000:2.0:1787826388.894300:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+30:86622:x1874668789889408:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826388.894318:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826388.894339:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c0fb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2c7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894400:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894414:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894428:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894443:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894450:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894456:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894491:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894499:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894505:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894512:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894517:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.894521:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894530:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894541:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.894544:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.894549:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894555:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c102 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894566:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894572:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894577:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894594:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.894597:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894602:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894609:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x7a94fdef (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826388.894612:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.894614:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894620:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c109 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894651:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c0fb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c7 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894665:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.894667:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.894671:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c0fb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c7 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.894680:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:2.0:1787826388.894753:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+30:86622:x1874668789889408:12345-192.168.203.9@tcp:101:bash.0 Request processed in 455us (625us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826388.894761:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111668 00000100:00100000:3.0:1787826388.908147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826388.908356:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789889536 00000100:00100000:2.0:1787826388.908366:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789889536 00000100:00100000:2.0:1787826388.908429:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111669 00000100:00100000:2.0:1787826388.908439:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86623:x1874668789889536:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826388.908466:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826388.908487:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c110 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2ce expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908548:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908561:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908571:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908838:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908849:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908882:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908920:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908928:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908935:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908940:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.908944:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908952:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908963:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.908965:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.908969:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908975:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349c117 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908989:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.908995:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.909000:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.909006:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826388.909008:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.909013:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.909020:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x7a94fdef (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826388.909022:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.909025:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.909030:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c11e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.909061:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c110 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2ce expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.909071:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826388.909073:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826388.909076:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c110 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2ce expref: 37 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826388.909089:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:2.0:1787826388.909200:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86623:x1874668789889536:12345-192.168.203.9@tcp:101:rm.0 Request processed in 755us (1055us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826388.909209:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111669 00000100:00100000:3.0:1787826388.912632:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.912697:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789889664 00000100:00100000:1.0:1787826388.912706:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789889664 00000100:00100000:1.0:1787826388.912771:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111670 00000100:00100000:1.0:1787826388.912781:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86623:x1874668789889664:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826388.912816:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826388.912837:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c125 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2d5 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.912920:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913170:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913183:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913198:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913206:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913212:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913249:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913261:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913266:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913271:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913276:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826388.913280:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913287:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913297:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826388.913300:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.913303:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913309:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c12c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913321:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913327:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913332:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913338:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826388.913340:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913346:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913353:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x7a94fdef (ffff9bbe0bd66600) 00010000:00010000:1.0:1787826388.913355:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.913358:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913362:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c133 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913393:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c125 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2d5 expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913404:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826388.913406:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.913409:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c125 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2d5 expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.913419:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826388.913482:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86623:x1874668789889664:12345-192.168.203.9@tcp:101:rm.0 Request processed in 702us (859us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826388.913489:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111670 00000100:00100000:2.0:1787826388.944848:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.944985:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789889792 00000100:00100000:0.0:1787826388.944994:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789889792 00000100:00100000:0.0:1787826388.945057:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111671 00000100:00100000:0.0:1787826388.945067:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a106580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86624:x1874668789889792:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826388.945087:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.945106:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c13a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2dc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945168:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945181:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945192:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945207:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945214:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945220:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945257:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945265:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945270:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945277:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945284:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.945288:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945295:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945307:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.945310:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.945314:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945320:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c141 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945334:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945340:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945346:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945350:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826388.945353:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945358:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945369:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x7a94fdef (ffff9bbe12dd8e00) 00010000:00010000:0.0:1787826388.945372:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.945374:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945379:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c148 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945409:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c13a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2dc expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945419:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826388.945422:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.945426:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2400/0x68019081f349c13a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2dc expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.945435:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2400, rc 0) 00000100:00100000:0.0:1787826388.945500:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a106580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86624:x1874668789889792:12345-192.168.203.9@tcp:101:cp.0 Request processed in 435us (661us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826388.945507:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111671 00000100:00100000:3.0:1787826388.949027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.949116:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789889920 00000100:00100000:1.0:1787826388.949126:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789889920 00000100:00100000:1.0:1787826388.949174:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111672 00000100:00100000:1.0:1787826388.949183:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86624:x1874668789889920:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826388.949201:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826388.949221:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c14f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949284:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949297:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949308:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949322:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949329:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949335:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949370:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949378:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949384:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949391:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949396:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826388.949400:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949407:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949417:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826388.949420:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.949424:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949430:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c156 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949443:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949449:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949454:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949458:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826388.949461:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949470:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949477:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x7a94fdef (ffff9bbe0bd66600) 00010000:00010000:1.0:1787826388.949479:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.949482:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949487:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c15d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949516:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c14f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2e3 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949526:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826388.949528:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.949532:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c14f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2e3 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.949540:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6600, rc 0) 00000100:00100000:1.0:1787826388.949605:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86624:x1874668789889920:12345-192.168.203.9@tcp:101:cp.0 Request processed in 422us (585us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826388.949612:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111672 00000100:00100000:3.0:1787826388.955534:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.955612:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789890176 00000100:00100000:1.0:1787826388.955622:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789890176 00000100:00100000:1.0:1787826388.955694:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111673 00000100:00100000:1.0:1787826388.955704:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:86624:x1874668789890176:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826388.955726:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826388.955746:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c164 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2ea expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.955900:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.955915:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.955926:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.955939:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.955946:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.955953:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826388.956223:0:12105:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xca:0x0], index 0: 0 00010000:00010000:1.0:1787826388.956348:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c179 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x136:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956357:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c179 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x136:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956365:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c179 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x136:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956397:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956405:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956411:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956417:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956423:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826388.956428:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956435:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956446:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826388.956449:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826388.956453:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956459:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c16b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826388.956471:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000660a2057 reply state 00000000095fc366 transno 8590016723 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956481:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956487:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x7a94fdef (ffff9bbe0bd66600) 00010000:00010000:1.0:1787826388.956489:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826388.956492:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826388.956517:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c164 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2ea expref: 39 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956531:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6200/0x68019081f349c179 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x136:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2ea expref: 38 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.956538:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x136:0x0].0x0 (ffff9bbe0bd66200) 00010000:00010000:1.0:1787826388.956540:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826388.956542:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6200, rc 0) 00000100:00100000:1.0:1787826388.956614:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+39:86624:x1874668789890176:12345-192.168.203.9@tcp:101:cp.0 Request processed in 911us (1090us total) trans 8590016723 rc 0/0 00000100:00100000:1.0:1787826388.956622:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111673 00000100:00100000:2.0:1787826388.959006:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826388.959080:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789890304 00000100:00100000:1.0:1787826388.959089:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789890304 00000100:00100000:1.0:1787826388.959152:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6334 00000100:00100000:1.0:1787826388.959163:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789890304:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826388.959178:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826388.959196:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2f1 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826388.959219:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826388.959240:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca:0x0].0x0 since=3027s v=(0 0) 00010000:00010000:1.0:1787826388.959245:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826388.959254:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f1 expref: 13 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.959272:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f1 expref: 13 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.959284:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7000, rc 0) 00000100:00100000:1.0:1787826388.959343:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789890304:12345-192.168.203.9@tcp:101:cp.0 Request processed in 182us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.959350:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6334 00000100:00100000:3.0:1787826388.964821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.965046:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789890432 00000100:00100000:0.0:1787826388.965056:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789890432 00000100:00100000:0.0:1787826388.965226:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6335 00000100:00100000:0.0:1787826388.965238:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+13:86624:x1874668789890432:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826388.965254:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826388.965272:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf9070f5/0x68019081f349c18e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2f8 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.965309:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f1 expref: 14 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.965318:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826388.965322:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826388.965327:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf9070f5/0x68019081f349c18e lrc: 4/0,0 mode: --/PW res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f8 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.965359:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f1 expref: 14 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.965373:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f1 expref: 14 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826388.965388:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778686976:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826388.965614:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826388.968269:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778686976:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826388.968306:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf9070f5/0x68019081f349c18e lrc: 3/0,0 mode: --/PW res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f8 expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.968329:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2400, rc 0) 00000100:00100000:0.0:1787826388.968390:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:86624:x1874668789890432:12345-192.168.203.9@tcp:101:cp.0 Request processed in 3153us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.968399:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6335 00000100:00100000:3.0:1787826388.976155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.976549:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789890560 00000100:00100000:0.0:1787826388.976559:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789890560 00010000:00010000:0.0:1787826388.976603:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f1 expref: 14 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826388.976643:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3109 00000100:00100000:0.0:1787826388.976653:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789890560:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826388.976668:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826388.976703:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f1 expref: 14 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.976718:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f1 expref: 14 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.976741:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005477887e/0x68019081f349c187 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f1 expref: 14 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.976758:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826388.976762:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826388.976770:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf9070f5/0x68019081f349c18e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f8 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.976780:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf9070f5/0x68019081f349c18e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f8 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.976825:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cf9070f5/0x68019081f349c18e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2f8 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826388.976838:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778687104:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826388.976959:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826388.979986:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778687104:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826388.980014:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826388.980071:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789890560:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3419us (3925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.980081:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3109 00000100:00100000:2.0:1787826388.988981:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826388.989073:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789890816 00000100:00100000:0.0:1787826388.989083:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789890816 00000100:00100000:0.0:1787826388.989144:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2731 00000100:00100000:0.0:1787826388.989154:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+39:86624:x1874668789890816:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826388.989451:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86624:x1874668789890816:12345-192.168.203.9@tcp:35:cp.0 Request processed in 298us (479us total) trans 8590016724 rc 0/0 00000100:00100000:0.0:1787826388.989459:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2731 00000040:00080000:2.0:1787826388.992054:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826388.992063:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826388.992586:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 64768 count 1 00000040:00080000:2.0:1787826388.992600:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1787826389.033908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.034040:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789890944 00000100:00100000:0.0:1787826389.034049:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789890944 00000100:00100000:0.0:1787826389.034124:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111674 00000100:00100000:0.0:1787826389.034134:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+30:86627:x1874668789890944:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826389.034152:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.034172:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c195 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc2ff expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034244:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034263:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034274:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034288:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034295:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034301:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034339:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034347:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034353:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034359:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.034363:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034371:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034382:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.034385:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.034390:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034396:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c19c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034408:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034415:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034421:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034426:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.034429:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034435:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034443:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x59d92b11 (ffff9bbe12dd8e00) 00010000:00010000:0.0:1787826389.034445:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.034448:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034455:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034487:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c195 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2ff expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034497:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.034499:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.034502:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c195 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2ff expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.034510:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:0.0:1787826389.034568:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+30:86627:x1874668789890944:12345-192.168.203.9@tcp:101:bash.0 Request processed in 437us (670us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.034575:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111674 00000100:00080000:2.0:1787826389.034713:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826389.044261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.044354:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789891072 00000100:00100000:0.0:1787826389.044363:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789891072 00000100:00100000:0.0:1787826389.044437:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111675 00000100:00100000:0.0:1787826389.044448:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86628:x1874668789891072:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.044472:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.044491:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c1aa lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc306 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044549:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044563:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044573:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044587:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044595:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044601:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044637:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044645:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044651:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044657:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.044661:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044668:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044679:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.044700:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.044705:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044711:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c1b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044725:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044731:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044737:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044742:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.044744:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044751:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044758:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x59d92b11 (ffff9bbe12dd8e00) 00010000:00010000:0.0:1787826389.044760:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.044763:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044769:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c1b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044810:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c1aa lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc306 expref: 41 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044820:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.044822:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.044827:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c1aa lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc306 expref: 41 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.044842:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:0.0:1787826389.044948:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86628:x1874668789891072:12345-192.168.203.9@tcp:101:rm.0 Request processed in 502us (696us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.044956:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111675 00000100:00080000:2.0:1787826389.045413:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826389.048939:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.049057:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789891200 00000100:00100000:0.0:1787826389.049066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789891200 00000100:00100000:0.0:1787826389.049122:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111676 00000100:00100000:0.0:1787826389.049132:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86628:x1874668789891200:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.049151:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.049170:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c1bf lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049241:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049255:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049267:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049280:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049287:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049292:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049329:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049336:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049341:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049347:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049353:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.049357:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049364:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049375:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.049377:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.049382:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049387:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c1c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049400:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049406:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049413:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049417:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.049419:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049425:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049432:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x59d92b11 (ffff9bbe12dd8900) 00010000:00010000:0.0:1787826389.049435:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.049437:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049443:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c1cd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049475:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c1bf lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc30d expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049487:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.049489:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.049492:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c1bf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc30d expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.049501:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:0.0:1787826389.049567:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86628:x1874668789891200:12345-192.168.203.9@tcp:101:rm.0 Request processed in 435us (635us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.049577:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111676 00000100:00100000:3.0:1787826389.063836:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.063994:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789891328 00000100:00100000:1.0:1787826389.064003:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789891328 00000100:00100000:1.0:1787826389.064054:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111677 00000100:00100000:1.0:1787826389.064062:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86629:x1874668789891328:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.064080:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.064099:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c1d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc314 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064160:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064173:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064184:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064209:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064217:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064224:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064262:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064269:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064274:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064281:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064287:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.064292:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064299:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064310:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.064313:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.064317:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064324:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349c1db lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064337:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064343:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064349:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064354:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.064357:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064362:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064368:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x59d92b11 (ffff9bbe0bd66b00) 00010000:00010000:1.0:1787826389.064370:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.064373:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064378:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349c1e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064405:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c1d4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc314 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064413:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.064416:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.064419:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c1d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc314 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.064427:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:1.0:1787826389.064488:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86629:x1874668789891328:12345-192.168.203.9@tcp:101:cp.0 Request processed in 426us (671us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.064495:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111677 00000100:00100000:3.0:1787826389.068498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.068588:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789891456 00000100:00100000:1.0:1787826389.068597:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789891456 00000100:00100000:1.0:1787826389.068653:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111678 00000100:00100000:1.0:1787826389.068663:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86629:x1874668789891456:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.068682:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.068718:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c1e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc31b expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068783:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068796:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068818:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068833:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068840:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068847:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068911:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068923:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068929:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068935:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068941:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.068945:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068953:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068964:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.068967:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.068972:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068979:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c1f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068992:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.068999:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.069005:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.069011:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ea00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.069013:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.069020:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.069026:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x59d92b11 (ffff9bbe0bd66e00) 00010000:00010000:1.0:1787826389.069029:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.069032:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.069038:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c1f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.069067:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c1e9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc31b expref: 41 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.069076:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.069079:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.069082:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c1e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc31b expref: 41 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.069091:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826389.069159:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86629:x1874668789891456:12345-192.168.203.9@tcp:101:cp.0 Request processed in 497us (670us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.069173:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111678 00000100:00100000:3.0:1787826389.072096:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.072505:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789891712 00000100:00100000:0.0:1787826389.072514:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789891712 00000100:00100000:0.0:1787826389.072570:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111679 00000100:00100000:0.0:1787826389.072578:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+40:86629:x1874668789891712:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.072597:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.072624:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c1fe lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc322 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.072722:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.072737:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.072748:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.072764:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.072771:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.072777:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826389.074839:0:25759:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xcb:0x0], index 1: 0 00010000:00010000:0.0:1787826389.074997:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c213 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x137:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075014:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c213 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x137:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075024:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c213 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x137:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075053:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075061:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075067:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075073:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.075077:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075085:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075255:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.075259:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.075264:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075270:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c205 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826389.075286:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098ffedee reply state 00000000250086f5 transno 8590016725 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075297:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075304:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x59d92b11 (ffff9bbe12dd8900) 00010000:00010000:0.0:1787826389.075306:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826389.075309:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826389.075343:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2000/0x68019081f349c1fe lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc322 expref: 43 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075356:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2a00/0x68019081f349c213 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x137:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc322 expref: 42 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.075364:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x137:0x0].0x0 (ffff9bbe12dd8e00) 00010000:00010000:0.0:1787826389.075366:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826389.075368:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2a00, rc 0) 00000100:00100000:0.0:1787826389.075448:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+43:86629:x1874668789891712:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2871us (3362us total) trans 8590016725 rc 0/0 00000100:00100000:0.0:1787826389.075457:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111679 00000100:00100000:2.0:1787826389.079572:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.079770:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789891840 00000100:00100000:1.0:1787826389.079780:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789891840 00000100:00100000:1.0:1787826389.079906:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6336 00000100:00100000:1.0:1787826389.079916:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+9:2401:x1874668789891840:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.079933:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.079953:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc329 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826389.079979:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826389.079998:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=3027s v=(0 0) 00010000:00010000:1.0:1787826389.080003:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826389.080012:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc329 expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.080032:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc329 expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.080044:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9ea00, rc 0) 00000100:00100000:1.0:1787826389.080109:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2401:x1874668789891840:12345-192.168.203.9@tcp:101:cp.0 Request processed in 194us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826389.080116:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6336 00000100:00100000:3.0:1787826389.080598:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00080000:2.0:1787826389.080696:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826389.081353:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789891968 00000100:00100000:0.0:1787826389.081361:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789891968 00000100:00100000:0.0:1787826389.081415:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3453 00000100:00100000:0.0:1787826389.081424:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2400:x1874668789891968:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826389.081486:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.081506:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c228 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc330 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081555:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081569:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081578:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081591:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081597:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081603:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081651:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081658:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081664:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081670:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.081674:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081681:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081692:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.081696:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.081700:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081706:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c22f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081720:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081726:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081732:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081736:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.081739:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081746:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081752:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe12dd8a00) 00010000:00010000:0.0:1787826389.081755:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.081757:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081763:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c236 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081788:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c228 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc330 expref: 44 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081798:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.081811:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826389.081816:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c228 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc330 expref: 44 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.081824:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc -2) 00000100:00100000:0.0:1787826389.081911:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+43:2400:x1874668789891968:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 487us (1315us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826389.081918:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3453 00000100:00100000:3.0:1787826389.083908:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.085527:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789892096 00000100:00100000:0.0:1787826389.085538:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789892096 00000100:00100000:0.0:1787826389.085696:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6337 00000100:00100000:0.0:1787826389.085708:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+10:86629:x1874668789892096:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.085728:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.085748:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349c23d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc368 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.085780:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc329 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.085790:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.085794:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.085809:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349c23d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc368 expref: 11 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.085847:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc329 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.085905:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc329 expref: 11 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.085918:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778687232:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826389.086015:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826389.091203:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778687232:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826389.091239:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349c23d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc368 expref: 11 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.091259:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2000, rc 0) 00000100:00100000:0.0:1787826389.091313:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:86629:x1874668789892096:12345-192.168.203.9@tcp:101:cp.0 Request processed in 5607us (7412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.091322:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6337 00000100:00100000:2.0:1787826389.093654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826389.093831:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789892224 00000100:00100000:3.0:1787826389.093840:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789892224 00010000:00010000:3.0:1787826389.093920:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc329 expref: 11 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.093963:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3110 00000100:00100000:3.0:1787826389.093972:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789892224:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826389.093986:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826389.094005:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc329 expref: 11 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.094016:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc329 expref: 11 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.094042:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028870c41/0x68019081f349c221 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc329 expref: 11 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.094058:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826389.094063:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826389.094071:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349c23d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc368 expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.094079:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349c23d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc368 expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.094113:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c172164/0x68019081f349c23d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc368 expref: 10 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.094126:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778687360:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826389.094833:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826389.096679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.096891:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789892480 00000100:00100000:2.0:1787826389.096899:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789892480 00000100:00100000:2.0:1787826389.096999:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2732 00000100:00100000:2.0:1787826389.097009:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+43:86629:x1874668789892480:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:2.0:1787826389.097304:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+44:86629:x1874668789892480:12345-192.168.203.9@tcp:35:cp.0 Request processed in 296us (633us total) trans 8590016726 rc 0/0 00000100:00100000:2.0:1787826389.097312:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2732 00000100:00100000:3.0:1787826389.097534:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778687360:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826389.097562:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826389.097590:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789892224:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3619us (3944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826389.097599:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3110 00000100:00100000:1.0:1787826389.115360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.115518:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789892608 00000100:00100000:2.0:1787826389.115527:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789892608 00000100:00100000:2.0:1787826389.115597:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3454 00000100:00100000:2.0:1787826389.115608:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+44:2402:x1874668789892608:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826389.115665:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826389.115684:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c244 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc36f expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115748:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115763:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115773:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115785:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115791:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115797:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115845:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115880:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115888:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115897:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.115902:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115910:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115921:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.115924:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.115929:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115935:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c24b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115949:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115955:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115960:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115965:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.115967:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115972:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115983:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826389.115986:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.115988:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.115994:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c252 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.116022:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c244 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc36f expref: 45 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.116031:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.116032:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826389.116035:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c244 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc36f expref: 45 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.116044:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc -2) 00000100:00100000:2.0:1787826389.116109:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+44:2402:x1874668789892608:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 503us (758us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826389.116118:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3454 00000040:00080000:0.0:1787826389.120264:0:58480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787826389.120274:0:58480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826389.122455:0:58480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787826389.123416:0:58480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787826389.125095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.125579:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789892736 00000100:00100000:0.0:1787826389.125588:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789892736 00000100:00100000:0.0:1787826389.125690:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111680 00000100:00100000:0.0:1787826389.125701:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+30:86636:x1874668789892736:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826389.125723:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.125744:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c259 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3a7 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125818:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125831:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125842:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125897:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125904:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125910:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125946:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125953:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125959:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125964:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.125968:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125975:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125985:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.125988:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.125992:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.125998:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c260 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126009:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126014:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126019:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126024:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.126026:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126032:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126039:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe12dd8a00) 00010000:00010000:0.0:1787826389.126041:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.126044:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126050:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c267 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126079:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c259 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3a7 expref: 31 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126089:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.126091:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.126107:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c259 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3a7 expref: 31 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.126116:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826389.126179:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+30:86636:x1874668789892736:12345-192.168.203.9@tcp:101:bash.0 Request processed in 480us (1091us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.126187:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111680 00000100:00100000:1.0:1787826389.141276:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.141324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.141425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789892864 00000100:00100000:0.0:1787826389.141435:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789892864 00000100:00100000:0.0:1787826389.141503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111681 00000100:00100000:0.0:1787826389.141512:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+44:86637:x1874668789892864:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.141531:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.141551:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c26e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141613:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141631:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.141635:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789892992 00000100:00100000:3.0:1787826389.141639:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789892992 00010000:00010000:0.0:1787826389.141642:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141656:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141663:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141669:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.141681:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3455 00010000:00010000:0.0:1787826389.141704:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141711:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141718:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141724:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141730:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.141734:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141742:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141754:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.141757:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.141762:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141768:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c275 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141782:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141788:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141795:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141811:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.141814:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141821:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141828:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe12dd8a00) 00010000:00010000:0.0:1787826389.141830:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826389.141830:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+46:2399:x1874668789892992:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826389.141833:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141838:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c27c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.141873:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826389.141883:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c283 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3b5 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141904:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c26e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3ae expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.141910:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141914:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.141917:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.141921:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c26e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3ae expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.141921:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.141929:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.141931:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00010000:00010000:3.0:1787826389.141940:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.141946:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.141952:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.141972:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.141983:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+46:86637:x1874668789892864:12345-192.168.203.9@tcp:101:rm.0 Request processed in 473us (717us total) trans 0 rc 301/301 00010000:00010000:3.0:1787826389.141984:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.141990:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111681 00010000:00010000:3.0:1787826389.141991:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.141996:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826389.141998:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142004:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142012:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826389.142015:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826389.142018:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142024:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c28a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142033:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142039:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142044:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142050:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826389.142053:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142059:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142065:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbe08124300) 00010000:00010000:3.0:1787826389.142068:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826389.142071:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142076:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349c291 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142095:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c283 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3b5 expref: 45 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142104:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826389.142106:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826389.142109:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c283 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3b5 expref: 45 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.142117:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc -2) 00000100:00100000:3.0:1787826389.142157:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+44:2399:x1874668789892992:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 469us (833us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826389.142165:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3455 00000100:00100000:1.0:1787826389.145075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.146779:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789893120 00000100:00100000:2.0:1787826389.146793:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789893120 00000100:00100000:2.0:1787826389.146995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111682 00000100:00100000:2.0:1787826389.147006:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+44:86637:x1874668789893120:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826389.147025:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826389.147044:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c298 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147123:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147138:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147159:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147173:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147180:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147186:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147224:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147231:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147237:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147244:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147251:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.147255:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147263:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147273:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.147276:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.147280:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147286:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c29f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147300:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147305:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147310:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147314:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.147317:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147322:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147328:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826389.147330:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.147333:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147339:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147373:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c298 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3bc expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147384:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.147386:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.147390:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c298 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3bc expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.147398:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826389.147460:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+44:86637:x1874668789893120:12345-192.168.203.9@tcp:101:rm.0 Request processed in 456us (2393us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826389.147471:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111682 00000100:00100000:1.0:1787826389.165653:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.165783:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789893248 00000100:00100000:2.0:1787826389.165793:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789893248 00000100:00100000:2.0:1787826389.166026:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111683 00000100:00100000:2.0:1787826389.166037:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+44:86638:x1874668789893248:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826389.166057:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826389.166076:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c2ad lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166142:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166159:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166169:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166183:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166200:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166207:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166245:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166253:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166259:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166266:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166272:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.166276:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166283:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166294:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.166297:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.166301:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166308:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c2b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166322:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166328:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166333:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166338:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.166340:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166345:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166351:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826389.166353:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.166355:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166360:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c2bb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166391:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c2ad lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3c3 expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166400:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.166402:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.166405:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c2ad lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3c3 expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.166413:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826389.166471:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+44:86638:x1874668789893248:12345-192.168.203.9@tcp:101:cp.0 Request processed in 436us (828us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826389.166487:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111683 00000100:00100000:0.0:1787826389.169018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.169276:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789893376 00000100:00100000:1.0:1787826389.169285:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789893376 00000100:00100000:1.0:1787826389.169344:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111684 00000100:00100000:1.0:1787826389.169354:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+44:86638:x1874668789893376:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.169372:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.169392:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c2c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3ca expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169450:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169463:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169473:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169497:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169504:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169511:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169543:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169551:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169557:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169563:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.169566:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169573:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169583:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.169587:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.169591:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169597:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c2c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169610:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169616:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169621:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169626:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.169630:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169635:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169641:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe0bd66000) 00010000:00010000:1.0:1787826389.169644:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.169647:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169652:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c2d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169883:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c2c2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3ca expref: 45 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169895:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.169898:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.169901:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c2c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3ca expref: 45 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.169911:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f800, rc 0) 00000100:00100000:1.0:1787826389.169971:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+44:86638:x1874668789893376:12345-192.168.203.9@tcp:101:cp.0 Request processed in 619us (962us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.169978:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111684 00000100:00100000:1.0:1787826389.173296:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.173693:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789893632 00000100:00100000:0.0:1787826389.173702:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789893632 00000100:00100000:0.0:1787826389.173790:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111685 00000100:00100000:0.0:1787826389.173811:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+44:86638:x1874668789893632:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.173831:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.173890:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c2d7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3d1 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.173994:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.174009:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.174024:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.174039:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.174046:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.174053:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826389.175119:0:7736:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xcb:0x0], index 0: 0 00010000:00010000:0.0:1787826389.175397:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c2ec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x138:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175411:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c2ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175420:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c2ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175452:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175460:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175466:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175549:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175559:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.175563:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175570:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175583:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.175586:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.175591:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175598:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c2de lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826389.175613:0:7736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ef6220f reply state 000000003fb02759 transno 8590016727 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175623:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175629:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe12dd8a00) 00010000:00010000:0.0:1787826389.175631:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826389.175634:0:7736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826389.175666:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c2d7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d1 expref: 47 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175682:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3a00/0x68019081f349c2ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d1 expref: 46 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.175694:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x138:0x0].0x0 (ffff9bbe12dd8300) 00010000:00010000:0.0:1787826389.175696:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826389.175699:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3a00, rc 0) 00000100:00100000:0.0:1787826389.175777:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+47:86638:x1874668789893632:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1978us (2489us total) trans 8590016727 rc 0/0 00000100:00100000:0.0:1787826389.175785:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111685 00000100:00100000:2.0:1787826389.178590:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826389.178743:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789893760 00000100:00100000:3.0:1787826389.178753:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789893760 00000100:00100000:3.0:1787826389.178833:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6338 00000100:00100000:3.0:1787826389.178844:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789893760:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826389.178880:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826389.178900:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3d8 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826389.178924:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826389.178943:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=3027s v=(0 0) 00010000:00010000:3.0:1787826389.178948:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826389.178957:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d8 expref: 14 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.178975:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d8 expref: 14 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.178993:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826389.179053:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789893760:12345-192.168.203.9@tcp:101:cp.0 Request processed in 211us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826389.179060:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6338 00000100:00080000:2.0:1787826389.179168:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826389.181978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.182059:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789893888 00000100:00100000:0.0:1787826389.182068:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789893888 00000100:00100000:0.0:1787826389.182117:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6339 00000100:00100000:0.0:1787826389.182126:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+14:86638:x1874668789893888:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.182141:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.182157:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349c301 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3df expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.182185:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d8 expref: 15 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.182194:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.182198:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.182203:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349c301 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3df expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.182234:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d8 expref: 15 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.182253:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d8 expref: 15 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.182267:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778687488:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826389.182436:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826389.189560:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.189654:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778687488:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826389.189716:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349c301 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3df expref: 15 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.189736:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3200, rc 0) 00000100:00100000:0.0:1787826389.189808:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:86638:x1874668789893888:12345-192.168.203.9@tcp:101:cp.0 Request processed in 7673us (7828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.189818:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6339 00000100:00100000:2.0:1787826389.190882:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789894016 00000100:00100000:2.0:1787826389.190891:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789894016 00010000:00010000:2.0:1787826389.190927:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d8 expref: 15 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826389.190969:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3111 00000100:00100000:2.0:1787826389.190978:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789894016:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826389.190992:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826389.191012:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d8 expref: 15 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.191031:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d8 expref: 15 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.191056:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349c2fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3d8 expref: 15 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.191071:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826389.191075:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826389.191082:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349c301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3df expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.191092:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349c301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3df expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.191124:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000acf44001/0x68019081f349c301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3df expref: 14 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826389.191138:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a1061c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778687616:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826389.191218:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826389.198679:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a1061c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778687616:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826389.198721:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826389.198781:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789894016:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 7803us (9243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826389.198792:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3111 00000100:00100000:3.0:1787826389.204991:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.205092:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789894272 00000100:00100000:0.0:1787826389.205100:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789894272 00000100:00100000:0.0:1787826389.205157:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2733 00000100:00100000:0.0:1787826389.205167:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+47:86638:x1874668789894272:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826389.205450:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86638:x1874668789894272:12345-192.168.203.9@tcp:35:cp.0 Request processed in 285us (466us total) trans 8590016728 rc 0/0 00000100:00100000:0.0:1787826389.205457:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2733 00000100:00100000:3.0:1787826389.228629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.228717:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789894400 00000100:00100000:0.0:1787826389.228726:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789894400 00000100:00100000:0.0:1787826389.228787:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111686 00000100:00100000:0.0:1787826389.228808:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+30:86641:x1874668789894400:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826389.228828:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.228849:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c308 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.228945:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.228959:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.228970:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.228984:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.228991:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.228998:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229036:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229043:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229049:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229055:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229061:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.229065:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229073:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229085:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.229088:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.229093:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229099:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c30f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229112:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229117:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229122:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229127:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.229129:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229135:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229146:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x18618557 (ffff9bbe12dd8500) 00010000:00010000:0.0:1787826389.229149:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.229151:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229157:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c316 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229187:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c308 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3e6 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229208:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.229211:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.229215:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c308 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3e6 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.229224:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826389.229287:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+30:86641:x1874668789894400:12345-192.168.203.9@tcp:101:bash.0 Request processed in 491us (667us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.229295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111686 00000100:00100000:1.0:1787826389.239290:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.239376:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789894528 00000100:00100000:0.0:1787826389.239385:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789894528 00000100:00100000:0.0:1787826389.239441:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111687 00000100:00100000:0.0:1787826389.239451:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86642:x1874668789894528:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.239473:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.239494:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c31d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3ed expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239558:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239572:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239583:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239596:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239603:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239609:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239643:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239651:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239657:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239663:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239668:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.239673:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239690:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239703:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.239706:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.239710:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239717:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c324 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239730:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239736:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239742:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239747:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.239750:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239755:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239762:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x18618557 (ffff9bbe12dd8500) 00010000:00010000:0.0:1787826389.239765:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.239768:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239773:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c32b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239817:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c31d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3ed expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239827:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.239833:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.239837:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c31d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3ed expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.239846:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826389.239949:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86642:x1874668789894528:12345-192.168.203.9@tcp:101:rm.0 Request processed in 499us (666us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.239956:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111687 00000100:00100000:3.0:1787826389.242709:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.242808:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789894656 00000100:00100000:1.0:1787826389.242816:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789894656 00000100:00100000:1.0:1787826389.242909:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111688 00000100:00100000:1.0:1787826389.242919:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86642:x1874668789894656:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826389.242937:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.242957:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c332 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3f4 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243020:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243034:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243045:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243058:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243064:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243070:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243107:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243113:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243119:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243126:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243131:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.243135:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243142:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243151:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.243154:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.243158:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243165:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c339 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243177:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243182:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243187:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243192:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.243207:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243216:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243223:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x18618557 (ffff9bbe0bd66000) 00010000:00010000:1.0:1787826389.243225:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.243227:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243233:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c340 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243264:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c332 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3f4 expref: 49 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243273:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.243276:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.243279:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c332 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3f4 expref: 49 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.243289:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9fe00, rc 0) 00000100:00100000:1.0:1787826389.243355:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86642:x1874668789894656:12345-192.168.203.9@tcp:101:rm.0 Request processed in 438us (672us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.243362:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111688 00000100:00100000:1.0:1787826389.259431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.259527:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789894784 00000100:00100000:0.0:1787826389.259536:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789894784 00000100:00100000:0.0:1787826389.259593:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111689 00000100:00100000:0.0:1787826389.259604:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86643:x1874668789894784:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.259623:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.259644:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c347 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc3fb expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259725:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259743:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259754:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259768:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259776:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259783:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259829:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259837:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259844:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259888:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.259894:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259901:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259912:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.259915:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.259919:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259925:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c34e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259940:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259946:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259951:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259956:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.259959:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259965:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259972:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x18618557 (ffff9bbe12dd8500) 00010000:00010000:0.0:1787826389.259975:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.259978:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.259983:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c355 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.260013:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c347 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3fb expref: 49 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.260023:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.260025:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.260030:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c347 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc3fb expref: 49 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.260040:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826389.260105:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86643:x1874668789894784:12345-192.168.203.9@tcp:101:cp.0 Request processed in 502us (682us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.260112:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111689 00000100:00100000:2.0:1787826389.263608:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.263713:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789894912 00000100:00100000:1.0:1787826389.263722:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789894912 00000100:00100000:1.0:1787826389.263782:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111690 00000100:00100000:1.0:1787826389.263792:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86643:x1874668789894912:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.263820:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.263841:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c35c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc402 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.263943:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.263958:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.263969:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.263985:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.263992:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.263999:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264036:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264042:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264048:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264054:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.264058:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264066:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264077:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.264080:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.264085:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264091:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c363 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264103:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264110:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264115:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264120:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.264123:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264129:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264135:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x18618557 (ffff9bbe0bd66000) 00010000:00010000:1.0:1787826389.264138:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.264141:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264146:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c36a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264178:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c35c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc402 expref: 49 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264188:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.264190:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.264194:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c35c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc402 expref: 49 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.264203:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9fe00, rc 0) 00000100:00100000:1.0:1787826389.264269:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86643:x1874668789894912:12345-192.168.203.9@tcp:101:cp.0 Request processed in 478us (670us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.264277:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111690 00000100:00100000:3.0:1787826389.267757:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.267847:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789895168 00000100:00100000:0.0:1787826389.267893:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789895168 00000100:00100000:0.0:1787826389.267947:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111691 00000100:00100000:0.0:1787826389.267956:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:86643:x1874668789895168:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.267976:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.267995:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c371 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc409 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.268093:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.268107:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.268118:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.268134:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.268142:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.268153:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826389.268657:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xcc:0x0], index 1: 0 00010000:00010000:0.0:1787826389.269321:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202a00/0x68019081f349c386 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x139:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269335:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202a00/0x68019081f349c386 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269344:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202a00/0x68019081f349c386 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269377:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269385:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269391:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269397:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269404:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.269408:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269419:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269430:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.269432:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.269436:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269442:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c378 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826389.269454:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000786069eb reply state 00000000caf09308 transno 8590016729 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269465:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269470:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x18618557 (ffff9bbe12dd8000) 00010000:00010000:0.0:1787826389.269472:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826389.269475:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826389.269505:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c371 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc409 expref: 51 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269519:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202a00/0x68019081f349c386 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc409 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.269526:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x139:0x0].0x0 (ffff9bbe12dd8500) 00010000:00010000:0.0:1787826389.269528:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826389.269530:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202a00, rc 0) 00000100:00100000:0.0:1787826389.269637:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+51:86643:x1874668789895168:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1681us (1887us total) trans 8590016729 rc 0/0 00000100:00100000:0.0:1787826389.269644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111691 00000100:00100000:3.0:1787826389.273018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.273302:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789895296 00000100:00100000:1.0:1787826389.273314:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789895296 00000100:00100000:1.0:1787826389.273374:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6340 00000100:00100000:1.0:1787826389.273383:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+10:2402:x1874668789895296:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.273401:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.273421:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc410 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826389.273444:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826389.273463:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=3027s v=(0 0) 00010000:00010000:1.0:1787826389.273468:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826389.273478:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc410 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.273495:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc410 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.273507:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9fe00, rc 0) 00000100:00100000:1.0:1787826389.273606:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2402:x1874668789895296:12345-192.168.203.9@tcp:101:cp.0 Request processed in 223us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826389.273614:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6340 00000100:00100000:2.0:1787826389.276673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.279075:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789895424 00000100:00100000:0.0:1787826389.279087:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789895424 00000100:00100000:0.0:1787826389.279141:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6341 00000100:00100000:0.0:1787826389.279150:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:86643:x1874668789895424:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.279169:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.279187:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca65af6b/0x68019081f349c39b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc417 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.279219:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc410 expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.279228:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.279231:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.279237:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca65af6b/0x68019081f349c39b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc417 expref: 12 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.279269:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc410 expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.279283:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc410 expref: 12 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.279297:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778687744:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826389.279389:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826389.284966:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826389.285698:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789895552 00000100:00100000:3.0:1787826389.285708:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789895552 00010000:00010000:3.0:1787826389.285752:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc410 expref: 13 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.285795:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3112 00000100:00100000:3.0:1787826389.285815:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789895552:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826389.285830:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826389.285874:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc410 expref: 13 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.285889:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc410 expref: 13 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.285922:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826389.285926:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826389.285934:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca65af6b/0x68019081f349c39b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc417 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.285945:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca65af6b/0x68019081f349c39b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc417 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.285981:0:45686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ca65af6b/0x68019081f349c39b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc417 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.285994:0:45686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778687872:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826389.286081:0:45686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826389.288376:0:45686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778687872:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826389.288406:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826389.288462:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789895552:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2649us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826389.288474:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3112 00010000:00010000:0.0:1787826389.290979:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349c394 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc410 expref: 12 pid: 8432 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.291002:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778687744:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826389.291043:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca65af6b/0x68019081f349c39b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc417 expref: 11 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.291057:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203800, rc 0) 00000100:00100000:0.0:1787826389.291182:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+11:86643:x1874668789895424:12345-192.168.203.9@tcp:101:cp.0 Request processed in 12032us (14517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.291201:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6341 00000100:00100000:1.0:1787826389.297134:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826389.297311:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789895808 00000100:00100000:3.0:1787826389.297320:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789895808 00000100:00100000:3.0:1787826389.297377:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2734 00000100:00100000:3.0:1787826389.297387:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+51:86643:x1874668789895808:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:3.0:1787826389.297774:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86643:x1874668789895808:12345-192.168.203.9@tcp:35:cp.0 Request processed in 386us (648us total) trans 8590016730 rc 0/0 00000100:00100000:3.0:1787826389.297785:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2734 00000100:00100000:2.0:1787826389.312631:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826389.316764:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.316910:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789895936 00000100:00100000:1.0:1787826389.316920:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789895936 00000100:00100000:1.0:1787826389.316978:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3456 00000100:00100000:1.0:1787826389.316987:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+52:2399:x1874668789895936:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826389.317026:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.317045:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c3a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc41e expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317098:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317110:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317120:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317138:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317145:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317150:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317185:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317192:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317198:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317204:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.317207:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317215:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317226:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.317229:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.317234:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317240:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c3a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317255:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317262:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317268:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317272:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.317275:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317280:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317286:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbe0bd66300) 00010000:00010000:1.0:1787826389.317288:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.317291:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317296:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317325:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c3a2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc41e expref: 53 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317335:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.317337:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826389.317342:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c3a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc41e expref: 53 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.317351:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9ee00, rc -2) 00000100:00100000:1.0:1787826389.317418:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+52:2399:x1874668789895936:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 432us (665us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826389.317426:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3456 00000100:00100000:2.0:1787826389.318072:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778688000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826389.318125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826389.318236:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778688000 00000100:00100000:1.0:1787826389.318243:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778688000 00000100:00100000:1.0:1787826389.318286:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:1.0:1787826389.318294:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778688000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826389.318319:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387968 pending 0 free 3894763520 avail 3663241216 00000100:00100000:1.0:1787826389.318370:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778688000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826389.318377:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:0.0:1787826389.318455:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778688000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826389.335504:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.335602:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789896064 00000100:00100000:2.0:1787826389.335615:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789896064 00000100:00100000:2.0:1787826389.335678:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111692 00000100:00100000:2.0:1787826389.335688:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+30:86646:x1874668789896064:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826389.335707:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826389.335731:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c3b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc425 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335805:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335824:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335835:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335885:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335894:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335901:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335938:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335945:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335956:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335963:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335968:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.335972:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335980:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.335991:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.335994:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.335998:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336005:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3be lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336020:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336027:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336033:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336038:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.336040:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336046:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336053:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xf7a5b27a (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826389.336056:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.336059:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336064:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336093:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c3b7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc425 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336103:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.336105:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.336108:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c3b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc425 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.336116:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:2.0:1787826389.336187:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+30:86646:x1874668789896064:12345-192.168.203.9@tcp:101:bash.0 Request processed in 501us (691us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826389.336198:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111692 00000100:00100000:3.0:1787826389.348813:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.348960:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789896192 00000100:00100000:2.0:1787826389.348970:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789896192 00000100:00100000:2.0:1787826389.349032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111693 00000100:00100000:2.0:1787826389.349042:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86647:x1874668789896192:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826389.349061:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826389.349082:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c3cc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc42c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349155:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349167:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349178:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349191:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349198:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349205:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349251:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349262:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349267:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349273:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349279:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.349283:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349289:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349299:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.349302:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.349306:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349312:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c3d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349324:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349330:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349335:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349341:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.349343:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349348:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349354:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xf7a5b27a (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826389.349357:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.349359:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349365:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c3da lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349395:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c3cc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc42c expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349404:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.349406:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.349410:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c3cc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc42c expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.349419:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:2.0:1787826389.349492:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86647:x1874668789896192:12345-192.168.203.9@tcp:101:rm.0 Request processed in 451us (698us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826389.349499:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111693 00000100:00100000:3.0:1787826389.357206:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.357315:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789896320 00000100:00100000:0.0:1787826389.357325:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789896320 00000100:00100000:0.0:1787826389.357386:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111694 00000100:00100000:0.0:1787826389.357396:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86647:x1874668789896320:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.357414:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.357433:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c3e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc433 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357489:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357503:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357518:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357531:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357537:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357543:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357580:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357586:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357593:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357598:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.357602:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357609:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357619:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.357622:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.357626:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357633:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c3e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357646:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357651:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357657:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357663:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.357665:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357670:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357689:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xf7a5b27a (ffff9bbe12dd8600) 00010000:00010000:0.0:1787826389.357698:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.357702:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357708:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c3ef lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357739:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c3e1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc433 expref: 53 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357755:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.357757:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.357761:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c3e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc433 expref: 53 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.357768:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202400, rc 0) 00000100:00100000:0.0:1787826389.357839:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86647:x1874668789896320:12345-192.168.203.9@tcp:101:rm.0 Request processed in 444us (651us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.357847:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111694 00000100:00100000:3.0:1787826389.385552:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.385650:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789896448 00000100:00100000:1.0:1787826389.385660:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789896448 00000100:00100000:1.0:1787826389.385735:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111695 00000100:00100000:1.0:1787826389.385746:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86648:x1874668789896448:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.385765:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.385784:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c3f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc43a expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.385897:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.385913:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.385925:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.385940:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.385947:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.385954:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.385992:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.385999:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386006:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386012:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.386017:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386025:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386037:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.386040:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.386045:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386053:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c3fd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386066:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386072:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386078:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386084:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.386087:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386092:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386098:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xf7a5b27a (ffff9bbe0bd66300) 00010000:00010000:1.0:1787826389.386101:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.386103:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386108:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c404 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386139:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c3f6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc43a expref: 53 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386153:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.386156:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.386159:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c3f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc43a expref: 53 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.386174:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9ee00, rc 0) 00000100:00100000:1.0:1787826389.386244:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86648:x1874668789896448:12345-192.168.203.9@tcp:101:cp.0 Request processed in 499us (701us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.386252:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111695 00000100:00100000:3.0:1787826389.393350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.393412:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789896576 00000100:00100000:1.0:1787826389.393421:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789896576 00000100:00100000:1.0:1787826389.393477:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111696 00000100:00100000:1.0:1787826389.393486:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86648:x1874668789896576:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.393503:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.393521:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c40b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc441 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393576:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393590:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393600:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393612:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393619:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393624:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393655:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393661:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393666:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393672:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.393676:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393699:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393710:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.393713:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.393718:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393723:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c412 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393736:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393742:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393748:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393753:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.393756:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393762:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393769:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xf7a5b27a (ffff9bbe0bd66900) 00010000:00010000:1.0:1787826389.393771:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.393774:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393779:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c419 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393815:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c40b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc441 expref: 53 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393824:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.393826:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.393829:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c40b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc441 expref: 53 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.393843:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f600, rc 0) 00000100:00100000:1.0:1787826389.393931:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86648:x1874668789896576:12345-192.168.203.9@tcp:101:cp.0 Request processed in 446us (589us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.393939:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111696 00000100:00100000:3.0:1787826389.400318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.401630:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789896832 00000100:00100000:0.0:1787826389.401641:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789896832 00000100:00100000:0.0:1787826389.401708:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111697 00000100:00100000:0.0:1787826389.401719:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+52:86648:x1874668789896832:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.401738:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.401759:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c420 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc448 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.401915:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.401931:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.401941:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.401956:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.401963:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.401968:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826389.402265:0:25756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xcc:0x0], index 0: 0 00010000:00010000:0.0:1787826389.402397:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202800/0x68019081f349c435 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402407:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202800/0x68019081f349c435 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402414:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202800/0x68019081f349c435 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402450:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402457:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402464:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402470:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402476:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.402481:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402493:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402505:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.402508:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.402512:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402519:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c427 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826389.402531:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000138d2828 reply state 0000000070b78af1 transno 8590016731 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402541:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402547:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xf7a5b27a (ffff9bbe12dd8600) 00010000:00010000:0.0:1787826389.402549:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826389.402552:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826389.402579:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c420 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc448 expref: 55 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402592:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202800/0x68019081f349c435 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc448 expref: 54 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.402599:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13a:0x0].0x0 (ffff9bbe12dd8100) 00010000:00010000:0.0:1787826389.402601:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826389.402603:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202800, rc 0) 00000100:00100000:0.0:1787826389.402687:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+55:86648:x1874668789896832:12345-192.168.203.9@tcp:101:cp.0 Request processed in 969us (2377us total) trans 8590016731 rc 0/0 00000100:00100000:0.0:1787826389.402695:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111697 00000100:00100000:3.0:1787826389.406746:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.407421:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789896960 00000100:00100000:0.0:1787826389.407431:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789896960 00000100:00100000:0.0:1787826389.407536:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6342 00000100:00100000:0.0:1787826389.407547:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2399:x1874668789896960:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.407565:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.407584:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc44f expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826389.407607:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826389.407630:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=3027s v=(0 0) 00010000:00010000:0.0:1787826389.407634:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.407643:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc44f expref: 15 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.407661:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc44f expref: 15 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.407673:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203400, rc 0) 00000100:00100000:0.0:1787826389.407754:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2399:x1874668789896960:12345-192.168.203.9@tcp:101:cp.0 Request processed in 209us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.407761:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6342 00000100:00100000:3.0:1787826389.411204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.411699:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789897088 00000100:00100000:0.0:1787826389.411710:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789897088 00000100:00100000:0.0:1787826389.411763:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6343 00000100:00100000:0.0:1787826389.411771:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:86648:x1874668789897088:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.411789:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.411818:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da11c17e/0x68019081f349c44a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc456 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.411847:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc44f expref: 16 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.411883:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.411888:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.411893:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da11c17e/0x68019081f349c44a lrc: 4/0,0 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc456 expref: 16 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.411927:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc44f expref: 16 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.411940:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc44f expref: 16 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.411953:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778688128:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826389.412046:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826389.419112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.419596:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789897216 00000100:00100000:1.0:1787826389.419606:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789897216 00010000:00010000:1.0:1787826389.419646:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc44f expref: 17 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826389.419693:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3113 00000100:00100000:1.0:1787826389.419704:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789897216:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826389.419720:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826389.419741:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc44f expref: 17 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.419760:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc44f expref: 17 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.419786:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826389.419790:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826389.419809:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da11c17e/0x68019081f349c44a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc456 expref: 17 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.419820:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da11c17e/0x68019081f349c44a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc456 expref: 17 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.419889:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000da11c17e/0x68019081f349c44a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc456 expref: 17 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826389.419905:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778688256:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826389.419982:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe178850c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787826389.421568:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e870e575/0x68019081f349c443 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc44f expref: 17 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.421589:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778688128:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826389.421626:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da11c17e/0x68019081f349c44a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc456 expref: 16 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.421638:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203000, rc 0) 00000100:00100000:2.0:1787826389.421818:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778688256:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826389.421833:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826389.421928:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+16:86648:x1874668789897088:12345-192.168.203.9@tcp:101:cp.0 Request processed in 10155us (10741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.421936:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6343 00000100:00100000:2.0:1787826389.422436:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789897216:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2733us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826389.422447:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3113 00000100:00100000:2.0:1787826389.425136:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.425215:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789897472 00000100:00100000:0.0:1787826389.425224:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789897472 00000100:00100000:0.0:1787826389.425284:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2735 00000100:00100000:0.0:1787826389.425295:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+55:86648:x1874668789897472:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826389.425566:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86648:x1874668789897472:12345-192.168.203.9@tcp:35:cp.0 Request processed in 272us (448us total) trans 8590016732 rc 0/0 00000100:00100000:0.0:1787826389.425575:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2735 00000100:00100000:3.0:1787826389.462618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.462997:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789897600 00000100:00100000:2.0:1787826389.463007:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789897600 00000100:00100000:2.0:1787826389.463189:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111698 00000100:00100000:2.0:1787826389.463209:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+30:86651:x1874668789897600:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826389.463229:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826389.463259:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c451 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc45d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463324:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463338:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463350:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463364:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463371:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463378:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463420:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463428:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463434:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463441:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463447:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.463451:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463458:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463469:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.463472:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.463477:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463484:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c458 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463497:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463503:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463510:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463515:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.463518:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463523:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463530:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd6e9df9d (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826389.463532:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.463534:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463540:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c45f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463570:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c451 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc45d expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463580:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.463582:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.463586:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c451 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc45d expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.463595:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2200, rc 0) 00000100:00100000:2.0:1787826389.463664:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+30:86651:x1874668789897600:12345-192.168.203.9@tcp:101:bash.0 Request processed in 457us (1056us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826389.463675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111698 00000100:00100000:1.0:1787826389.480041:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.480131:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789897728 00000100:00100000:0.0:1787826389.480141:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789897728 00000100:00100000:0.0:1787826389.480207:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111699 00000100:00100000:0.0:1787826389.480218:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86652:x1874668789897728:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.480251:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.480273:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203400/0x68019081f349c466 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc464 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480336:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480350:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480362:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480376:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480383:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480391:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480426:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480433:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480439:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480444:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.480449:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480455:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480466:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.480468:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.480473:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480479:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c46d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480495:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480501:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480506:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480511:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.480514:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480520:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480526:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd6e9df9d (ffff9bbe12dd8200) 00010000:00010000:0.0:1787826389.480528:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.480531:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480536:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c474 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480565:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203400/0x68019081f349c466 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc464 expref: 57 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480579:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.480581:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.480585:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203400/0x68019081f349c466 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc464 expref: 57 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.480594:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203400, rc 0) 00000100:00100000:0.0:1787826389.480659:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86652:x1874668789897728:12345-192.168.203.9@tcp:101:rm.0 Request processed in 442us (641us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.480665:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111699 00000100:00100000:3.0:1787826389.484625:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.484931:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789897856 00000100:00100000:1.0:1787826389.484940:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789897856 00000100:00100000:1.0:1787826389.484989:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111700 00000100:00100000:1.0:1787826389.484997:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86652:x1874668789897856:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826389.485024:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.485042:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c47b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc46b expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485101:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485113:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485123:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485135:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485142:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485149:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485184:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485201:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485207:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485213:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.485216:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485224:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485235:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.485403:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.485409:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485416:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c482 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485429:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485436:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485442:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485448:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.485451:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485457:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485464:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd6e9df9d (ffff9bbe0bd66900) 00010000:00010000:1.0:1787826389.485466:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.485469:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485475:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c489 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485504:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c47b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc46b expref: 57 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485514:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.485516:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.485519:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c47b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc46b expref: 57 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.485527:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e200, rc 0) 00000100:00100000:1.0:1787826389.485587:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86652:x1874668789897856:12345-192.168.203.9@tcp:101:rm.0 Request processed in 590us (971us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.485598:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111700 00000100:00100000:3.0:1787826389.504443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.504526:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789897984 00000100:00100000:1.0:1787826389.504535:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789897984 00000100:00100000:1.0:1787826389.504591:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111701 00000100:00100000:1.0:1787826389.504601:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86653:x1874668789897984:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.504619:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.504639:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c490 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc472 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.504987:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505002:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505095:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505113:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505119:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505126:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505163:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505174:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505180:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505185:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.505315:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505326:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505340:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.505343:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.505348:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505354:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c497 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505368:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505373:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505379:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505384:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.505387:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505392:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505398:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd6e9df9d (ffff9bbe0bd66900) 00010000:00010000:1.0:1787826389.505400:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.505403:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505408:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c49e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505442:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c490 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc472 expref: 57 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505452:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.505453:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.505457:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e200/0x68019081f349c490 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc472 expref: 57 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.505465:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e200, rc 0) 00000100:00100000:1.0:1787826389.505569:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86653:x1874668789897984:12345-192.168.203.9@tcp:101:cp.0 Request processed in 969us (1135us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.505577:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111701 00000100:00100000:3.0:1787826389.508732:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.508807:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789898112 00000100:00100000:2.0:1787826389.508816:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789898112 00000100:00100000:2.0:1787826389.508881:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111702 00000100:00100000:2.0:1787826389.508891:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86653:x1874668789898112:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826389.508908:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826389.508928:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c4a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc479 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.508985:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.508998:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509009:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509032:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509039:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509045:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509080:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509091:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509098:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509104:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509110:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.509114:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509121:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509130:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.509133:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.509136:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509142:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349c4ac lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509153:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509159:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509165:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509171:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.509174:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509179:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509185:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd6e9df9d (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826389.509187:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.509197:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509203:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c4b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509229:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c4a5 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc479 expref: 57 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509247:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.509249:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.509253:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c4a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc479 expref: 57 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.509263:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2200, rc 0) 00000100:00100000:2.0:1787826389.509910:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86653:x1874668789898112:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1016us (1182us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826389.509919:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111702 00000100:00100000:3.0:1787826389.513065:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.513215:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789898368 00000100:00100000:1.0:1787826389.513224:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789898368 00000100:00100000:1.0:1787826389.513286:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111703 00000100:00100000:1.0:1787826389.513296:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+56:86653:x1874668789898368:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.513316:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.513336:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c4ba lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc480 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.513438:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.513453:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.513463:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.513478:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.513485:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.513491:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826389.514087:0:12105:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xcd:0x0], index 1: 0 00010000:00010000:1.0:1787826389.514221:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f349c4cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514231:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f349c4cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514328:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f349c4cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514369:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514376:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514381:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514386:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514391:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.514395:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514401:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514412:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.514415:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.514419:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514424:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c4c1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826389.514438:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bdcef9f reply state 000000001493e6ba transno 8590016733 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514449:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514456:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd6e9df9d (ffff9bbe0bd66300) 00010000:00010000:1.0:1787826389.514458:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826389.514460:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826389.514487:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c4ba lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc480 expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514500:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e400/0x68019081f349c4cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc480 expref: 58 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.514507:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13b:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:1.0:1787826389.514509:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826389.514511:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e400, rc 0) 00000100:00100000:1.0:1787826389.514564:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+59:86653:x1874668789898368:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1270us (1506us total) trans 8590016733 rc 0/0 00000100:00100000:1.0:1787826389.514572:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111703 00000100:00100000:1.0:1787826389.518754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826389.519151:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789898496 00000100:00100000:3.0:1787826389.519160:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789898496 00000100:00100000:3.0:1787826389.519226:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6344 00000100:00100000:3.0:1787826389.519246:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+11:2401:x1874668789898496:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826389.519264:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826389.519285:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc487 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826389.519309:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826389.519327:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd:0x0].0x0 since=3027s v=(0 0) 00010000:00010000:3.0:1787826389.519331:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826389.519341:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc487 expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.519356:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc487 expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.519368:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826389.519435:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789898496:12345-192.168.203.9@tcp:101:cp.0 Request processed in 201us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826389.519442:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6344 00000100:00100000:0.0:1787826389.523244:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.523366:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789898624 00000100:00100000:1.0:1787826389.523374:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789898624 00000100:00100000:1.0:1787826389.523425:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6345 00000100:00100000:1.0:1787826389.523433:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+12:86653:x1874668789898624:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.523449:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.523465:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045fc495a/0x68019081f349c4e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc48e expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.523492:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc487 expref: 13 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.523507:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826389.523512:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826389.523517:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fc495a/0x68019081f349c4e4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc48e expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.523546:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc487 expref: 13 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.523559:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc487 expref: 13 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826389.523572:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778688384:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826389.523658:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17885780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826389.527064:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.527218:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789898752 00000100:00100000:0.0:1787826389.527228:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789898752 00010000:00010000:0.0:1787826389.527278:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc487 expref: 14 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.527320:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3114 00000100:00100000:0.0:1787826389.527329:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789898752:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826389.527344:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826389.527363:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc487 expref: 14 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.527377:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc487 expref: 14 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.527402:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.527407:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.527416:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045fc495a/0x68019081f349c4e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc48e expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.527426:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fc495a/0x68019081f349c4e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc48e expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.527464:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000045fc495a/0x68019081f349c4e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc48e expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.527478:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778688512:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826389.527555:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787826389.527714:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e4fd53/0x68019081f349c4dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc487 expref: 14 pid: 45681 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826389.527730:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778688384:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826389.527755:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045fc495a/0x68019081f349c4e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc48e expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.527766:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e200, rc 0) 00000100:00100000:1.0:1787826389.527810:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:86653:x1874668789898624:12345-192.168.203.9@tcp:101:cp.0 Request processed in 4365us (4571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826389.527821:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6345 00000100:00100000:0.0:1787826389.531251:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778688512:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826389.531286:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826389.531344:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789898752:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4015us (4289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.531355:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3114 00000100:00100000:3.0:1787826389.534100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.534264:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789899008 00000100:00100000:0.0:1787826389.534273:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789899008 00000100:00100000:0.0:1787826389.534334:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2736 00000100:00100000:0.0:1787826389.534344:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+59:86653:x1874668789899008:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826389.534625:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86653:x1874668789899008:12345-192.168.203.9@tcp:35:cp.0 Request processed in 282us (533us total) trans 8590016734 rc 0/0 00000100:00100000:0.0:1787826389.534634:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2736 00000100:00100000:2.0:1787826389.561465:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.562470:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789899136 00000100:00100000:0.0:1787826389.562480:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789899136 00000100:00100000:0.0:1787826389.562595:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111704 00000100:00100000:0.0:1787826389.562606:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+30:86656:x1874668789899136:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826389.562627:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.562648:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c4eb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc495 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562722:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562737:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562749:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562763:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562771:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562777:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562826:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562834:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562840:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562886:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.562892:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562899:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562916:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.562919:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.562923:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562929:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c4f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562942:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562948:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562953:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562958:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.562961:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562967:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.562989:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xb62e0cbf (ffff9bbe12dd8200) 00010000:00010000:0.0:1787826389.562991:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.562994:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.563000:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c4f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.563042:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c4eb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc495 expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.563053:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.563055:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.563059:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c4eb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc495 expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.563069:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203200, rc 0) 00000100:00100000:0.0:1787826389.563134:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+30:86656:x1874668789899136:12345-192.168.203.9@tcp:101:bash.0 Request processed in 529us (1678us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.563141:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111704 00000100:00100000:2.0:1787826389.575972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.576048:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789899264 00000100:00100000:0.0:1787826389.576057:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789899264 00000100:00100000:0.0:1787826389.576123:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111705 00000100:00100000:0.0:1787826389.576133:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86657:x1874668789899264:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.576156:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.576178:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c500 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc49c expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576248:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576262:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576271:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576285:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576291:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576298:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576333:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576341:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576347:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576352:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.576356:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576367:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576378:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.576381:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.576386:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576392:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c507 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576405:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576411:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576416:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576420:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.576422:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576428:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576434:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xb62e0cbf (ffff9bbe12dd8200) 00010000:00010000:0.0:1787826389.576436:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.576439:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576444:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c50e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576474:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c500 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc49c expref: 61 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576483:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.576486:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.576489:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c500 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc49c expref: 61 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.576498:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203200, rc 0) 00000100:00100000:0.0:1787826389.576558:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86657:x1874668789899264:12345-192.168.203.9@tcp:101:rm.0 Request processed in 427us (595us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.576565:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111705 00000100:00100000:3.0:1787826389.579387:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.580405:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789899392 00000100:00100000:0.0:1787826389.580415:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789899392 00000100:00100000:0.0:1787826389.580470:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111706 00000100:00100000:0.0:1787826389.580480:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86657:x1874668789899392:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.580499:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.580519:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c515 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580581:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580595:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580606:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580619:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580626:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580632:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580668:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580675:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580681:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580688:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580705:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.580709:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580716:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580728:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.580731:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.580736:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580742:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c51c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580756:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580762:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580768:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580773:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.580776:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580782:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580789:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xb62e0cbf (ffff9bbe12dd8700) 00010000:00010000:0.0:1787826389.580792:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.580804:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580810:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c523 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580842:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c515 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4a3 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580875:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.580878:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.580881:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c515 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4a3 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.580890:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202c00, rc 0) 00000100:00100000:0.0:1787826389.580962:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86657:x1874668789899392:12345-192.168.203.9@tcp:101:rm.0 Request processed in 483us (1583us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.580969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111706 00000100:00100000:2.0:1787826389.599891:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.600174:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789899520 00000100:00100000:0.0:1787826389.600184:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789899520 00000100:00100000:0.0:1787826389.600250:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111707 00000100:00100000:0.0:1787826389.600261:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86658:x1874668789899520:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.600280:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.600300:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c52a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4aa expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600366:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600380:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600391:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600404:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600411:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600417:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600453:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600461:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600466:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600473:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600479:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.600483:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600490:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600502:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.600506:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.600510:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600517:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c531 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600531:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600538:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600543:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600548:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.600551:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600557:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600565:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xb62e0cbf (ffff9bbe12dd8700) 00010000:00010000:0.0:1787826389.600567:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.600570:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600575:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203a00/0x68019081f349c538 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600605:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c52a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4aa expref: 61 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600615:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.600617:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.600621:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c52a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4aa expref: 61 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.600630:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202c00, rc 0) 00000100:00100000:0.0:1787826389.600690:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86658:x1874668789899520:12345-192.168.203.9@tcp:101:cp.0 Request processed in 431us (835us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.600705:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111707 00000100:00100000:2.0:1787826389.610149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.610349:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789899648 00000100:00100000:1.0:1787826389.610358:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789899648 00000100:00100000:1.0:1787826389.610427:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111708 00000100:00100000:1.0:1787826389.610436:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86658:x1874668789899648:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.610455:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.610474:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c53f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610537:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610552:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610563:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610578:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610585:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610591:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610629:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610640:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610646:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610653:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610659:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.610663:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610671:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610681:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.610684:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.610689:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610706:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c546 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610720:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610726:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610731:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610737:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.610740:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610746:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610752:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xb62e0cbf (ffff9bbe12458d00) 00010000:00010000:1.0:1787826389.610755:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.610757:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610763:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c54d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610794:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c53f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4b1 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610815:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.610817:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.610821:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c53f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4b1 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.610830:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f200, rc 0) 00000100:00100000:1.0:1787826389.610937:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86658:x1874668789899648:12345-192.168.203.9@tcp:101:cp.0 Request processed in 501us (798us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.610945:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111708 00000100:00100000:3.0:1787826389.613244:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.613474:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789899904 00000100:00100000:1.0:1787826389.613484:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789899904 00000100:00100000:1.0:1787826389.613543:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111709 00000100:00100000:1.0:1787826389.613553:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+60:86658:x1874668789899904:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.613571:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.613589:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c554 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4b8 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.613685:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.613711:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.613722:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.613737:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.613745:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.613751:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826389.614681:0:45683:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xcd:0x0], index 0: 0 00010000:00010000:1.0:1787826389.614848:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f349c569 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.614891:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f349c569 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.614905:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f349c569 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.614939:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.614947:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.614954:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.614959:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.614964:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.614971:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.614982:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.614985:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.614989:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.614994:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c55b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826389.615007:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002134262e reply state 000000008956dd91 transno 8590016735 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.615029:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.615036:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xb62e0cbf (ffff9bbe12458f00) 00010000:00010000:1.0:1787826389.615038:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826389.615041:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826389.615483:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c554 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4b8 expref: 63 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.615502:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fa00/0x68019081f349c569 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4b8 expref: 62 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.615510:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13c:0x0].0x0 (ffff9bbe12458500) 00010000:00010000:1.0:1787826389.615513:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826389.615515:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9fa00, rc 0) 00000100:00100000:1.0:1787826389.615653:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+63:86658:x1874668789899904:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2101us (2416us total) trans 8590016735 rc 0/0 00000100:00100000:1.0:1787826389.615662:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111709 00000100:00100000:2.0:1787826389.627764:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.627891:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789900032 00000100:00100000:0.0:1787826389.627901:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789900032 00000100:00100000:0.0:1787826389.627949:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6346 00000100:00100000:0.0:1787826389.627959:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789900032:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.627986:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.628006:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4bf expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826389.628041:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826389.628061:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=3027s v=(0 0) 00010000:00010000:0.0:1787826389.628065:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.628083:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4bf expref: 16 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.628099:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4bf expref: 16 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.628112:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202c00, rc 0) 00000100:00100000:0.0:1787826389.628221:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789900032:12345-192.168.203.9@tcp:101:cp.0 Request processed in 263us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.628232:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6346 00000100:00100000:1.0:1787826389.635232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.635319:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789900160 00000100:00100000:0.0:1787826389.635328:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789900160 00000100:00100000:0.0:1787826389.635403:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6347 00000100:00100000:0.0:1787826389.635413:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+16:86658:x1874668789900160:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.635431:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.635448:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000927cdf50/0x68019081f349c57e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4c6 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.635477:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4bf expref: 17 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.635486:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.635490:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.635496:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927cdf50/0x68019081f349c57e lrc: 4/0,0 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4c6 expref: 17 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.635529:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4bf expref: 17 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.635543:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4bf expref: 17 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.635558:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778688640:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826389.635650:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826389.650900:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778688640:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826389.650949:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000927cdf50/0x68019081f349c57e lrc: 3/0,0 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4c6 expref: 17 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.651069:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203a00, rc 0) 00000100:00100000:2.0:1787826389.651176:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+17:86658:x1874668789900160:12345-192.168.203.9@tcp:101:cp.0 Request processed in 15763us (15953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826389.651186:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6347 00000100:00100000:0.0:1787826389.663499:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.663637:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789900288 00000100:00100000:1.0:1787826389.663646:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789900288 00010000:00010000:1.0:1787826389.663747:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4bf expref: 17 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826389.663792:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3115 00000100:00100000:1.0:1787826389.663812:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2401:x1874668789900288:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826389.663830:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826389.663887:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4bf expref: 17 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.663907:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4bf expref: 17 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.663929:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a84f1f09/0x68019081f349c577 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4bf expref: 17 pid: 19335 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.663946:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826389.663950:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826389.663958:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000927cdf50/0x68019081f349c57e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4c6 expref: 16 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.663967:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927cdf50/0x68019081f349c57e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4c6 expref: 16 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.664026:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000927cdf50/0x68019081f349c57e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4c6 expref: 16 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826389.664040:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778688768:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826389.664411:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17885a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826389.666837:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778688768:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826389.666902:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826389.666952:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789900288:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3141us (3462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.666963:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3115 00000100:00100000:2.0:1787826389.668734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.668828:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789900544 00000100:00100000:0.0:1787826389.668837:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789900544 00000100:00100000:0.0:1787826389.668924:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2737 00000100:00100000:0.0:1787826389.668933:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+63:86658:x1874668789900544:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826389.669657:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86658:x1874668789900544:12345-192.168.203.9@tcp:35:cp.0 Request processed in 721us (977us total) trans 8590016736 rc 0/0 00000100:00100000:0.0:1787826389.669667:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2737 00000100:00100000:2.0:1787826389.720508:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.720604:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789900672 00000100:00100000:0.0:1787826389.720612:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789900672 00000100:00100000:0.0:1787826389.720670:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111710 00000100:00100000:0.0:1787826389.720689:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+30:86661:x1874668789900672:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826389.720709:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.720730:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c585 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4cd expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720793:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720831:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720843:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720890:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720899:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720906:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720943:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720949:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720955:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720960:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.720964:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720971:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720983:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.720985:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.720989:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.720995:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c58c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721007:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721013:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721017:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721022:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.721024:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721029:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721035:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x84832a57 (ffff9bbe12dd8d00) 00010000:00010000:0.0:1787826389.721037:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.721040:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721044:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c593 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721407:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c585 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4cd expref: 31 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721419:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.721421:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.721426:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c585 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4cd expref: 31 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.721436:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203200, rc 0) 00000100:00100000:0.0:1787826389.721500:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+30:86661:x1874668789900672:12345-192.168.203.9@tcp:101:bash.0 Request processed in 812us (1000us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.721507:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111710 00000100:00100000:1.0:1787826389.740026:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.740150:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789900800 00000100:00100000:0.0:1787826389.740158:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789900800 00000100:00100000:0.0:1787826389.740216:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111711 00000100:00100000:0.0:1787826389.740225:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86662:x1874668789900800:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.740248:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.740267:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c59a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740328:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740341:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740352:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740365:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740372:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740378:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740412:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740419:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740425:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740432:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740437:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.740441:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740448:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740459:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.740461:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.740466:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740473:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740487:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740493:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740499:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740504:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.740507:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740513:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740521:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x84832a57 (ffff9bbe12dd8d00) 00010000:00010000:0.0:1787826389.740523:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.740525:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740531:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740561:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c59a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4d4 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740571:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.740573:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.740576:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c59a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4d4 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.740585:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203200, rc 0) 00000100:00100000:0.0:1787826389.740651:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86662:x1874668789900800:12345-192.168.203.9@tcp:101:rm.0 Request processed in 427us (635us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.740662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111711 00000100:00100000:2.0:1787826389.747984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.748582:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789900928 00000100:00100000:1.0:1787826389.748591:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789900928 00000100:00100000:1.0:1787826389.748653:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111712 00000100:00100000:1.0:1787826389.748663:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86662:x1874668789900928:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826389.748702:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.748725:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c5af lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748787:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748817:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748829:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748845:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748891:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748898:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748936:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748944:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748950:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748957:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748963:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.748967:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748974:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748985:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.748988:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.748992:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.748998:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749012:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749017:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749023:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749029:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.749032:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749037:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749048:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x84832a57 (ffff9bbe12458d00) 00010000:00010000:1.0:1787826389.749051:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.749054:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749060:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5bd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749110:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c5af lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4db expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749120:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.749122:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.749125:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c5af lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4db expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.749134:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f200, rc 0) 00000100:00100000:1.0:1787826389.749529:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86662:x1874668789900928:12345-192.168.203.9@tcp:101:rm.0 Request processed in 527us (1215us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.749537:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111712 00000100:00100000:2.0:1787826389.774958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.775049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789901056 00000100:00100000:1.0:1787826389.775059:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789901056 00000100:00100000:1.0:1787826389.775128:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111713 00000100:00100000:1.0:1787826389.775138:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86663:x1874668789901056:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.775157:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.775176:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c5c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775257:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775271:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775281:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775295:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775301:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775307:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775340:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775346:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775352:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775359:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775364:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.775368:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775376:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775386:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.775388:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.775393:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775398:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c5cb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775411:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775417:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775422:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775426:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.775429:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775434:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775439:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x84832a57 (ffff9bbe12458d00) 00010000:00010000:1.0:1787826389.775442:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.775444:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775449:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c5d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775478:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c5c4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4e2 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775488:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.775490:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.775493:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c5c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4e2 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.775501:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f200, rc 0) 00000100:00100000:1.0:1787826389.775558:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86663:x1874668789901056:12345-192.168.203.9@tcp:101:cp.0 Request processed in 422us (611us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.775564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111713 00000100:00100000:2.0:1787826389.788804:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.788919:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789901184 00000100:00100000:0.0:1787826389.788928:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789901184 00000100:00100000:0.0:1787826389.788991:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111714 00000100:00100000:0.0:1787826389.789001:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86663:x1874668789901184:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.789020:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.789041:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c5d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4e9 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789116:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789130:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789142:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789157:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789164:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789170:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789217:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789229:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789235:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789241:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.789246:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789255:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789266:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.789270:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.789274:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789281:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c5e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789295:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789301:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789307:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789313:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.789316:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789323:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789330:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x84832a57 (ffff9bbe12dd8d00) 00010000:00010000:0.0:1787826389.789332:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.789335:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789340:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c5e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789372:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c5d9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4e9 expref: 65 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789381:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.789384:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.789388:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c5d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4e9 expref: 65 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.789398:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203200, rc 0) 00000100:00100000:0.0:1787826389.789466:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86663:x1874668789901184:12345-192.168.203.9@tcp:101:cp.0 Request processed in 465us (680us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.789474:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111714 00000100:00100000:2.0:1787826389.792501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.792575:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789901440 00000100:00100000:0.0:1787826389.792584:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789901440 00000100:00100000:0.0:1787826389.792642:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111715 00000100:00100000:0.0:1787826389.792652:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+64:86663:x1874668789901440:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.792671:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.792699:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349c5ee lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4f0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.792813:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.792826:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.792837:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.792883:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.792891:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.792898:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826389.793213:0:23845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xce:0x0], index 1: 0 00010000:00010000:0.0:1787826389.793340:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203400/0x68019081f349c603 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793349:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203400/0x68019081f349c603 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793356:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203400/0x68019081f349c603 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793386:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793392:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793398:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793403:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.793407:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793413:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793423:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.793425:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.793429:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793435:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c5f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826389.793448:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3ea68b1 reply state 00000000fd199740 transno 8590016737 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793457:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793463:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x84832a57 (ffff9bbe12dd8800) 00010000:00010000:0.0:1787826389.793466:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826389.793469:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826389.793494:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349c5ee lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f0 expref: 67 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793508:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203400/0x68019081f349c603 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f0 expref: 66 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.793515:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13d:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:0.0:1787826389.793517:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826389.793519:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203400, rc 0) 00000100:00100000:0.0:1787826389.793568:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+67:86663:x1874668789901440:12345-192.168.203.9@tcp:101:cp.0 Request processed in 919us (1076us total) trans 8590016737 rc 0/0 00000100:00100000:0.0:1787826389.793576:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111715 00000100:00100000:2.0:1787826389.802889:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.803016:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789901568 00000100:00100000:1.0:1787826389.803026:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789901568 00000100:00100000:1.0:1787826389.803097:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6348 00000100:00100000:1.0:1787826389.803107:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+12:2401:x1874668789901568:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826389.803125:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.803145:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4f7 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826389.803169:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826389.803200:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=3027s v=(0 0) 00010000:00010000:1.0:1787826389.803205:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826389.803214:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f7 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.803229:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f7 expref: 13 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.803241:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f200, rc 0) 00000100:00100000:1.0:1787826389.803297:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789901568:12345-192.168.203.9@tcp:101:cp.0 Request processed in 192us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826389.803304:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6348 00000100:00100000:2.0:1787826389.804930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.805938:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789901696 00000100:00100000:1.0:1787826389.805950:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789901696 00000100:00100000:1.0:1787826389.806013:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3457 00000100:00100000:1.0:1787826389.806022:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+67:2400:x1874668789901696:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826389.806777:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.806815:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c618 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc4fe expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.807318:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826389.807489:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807504:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807515:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807527:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807534:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807541:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807573:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807579:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807585:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807592:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.807596:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807603:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807613:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.807616:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.807620:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807627:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c61f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807638:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807645:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807651:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807655:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.807658:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807664:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807671:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbe12458100) 00010000:00010000:1.0:1787826389.807673:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.807676:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807691:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c626 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807721:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c618 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4fe expref: 68 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807731:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.807733:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826389.807738:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c618 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4fe expref: 68 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.807751:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9ee00, rc -2) 00000100:00100000:1.0:1787826389.807828:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+67:2400:x1874668789901696:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 1806us (2903us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826389.807837:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3457 00000100:00100000:0.0:1787826389.814444:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789901824 00000100:00100000:0.0:1787826389.814458:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789901824 00000100:00100000:0.0:1787826389.814528:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6349 00000100:00100000:0.0:1787826389.814538:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+13:86663:x1874668789901824:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.814555:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.814572:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc536 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.814602:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f7 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.814612:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.814616:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826389.814623:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.814757:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f7 expref: 14 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.814772:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f7 expref: 14 pid: 8605 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826389.814786:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778688896:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826389.815269:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826389.822492:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778688896:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826389.822532:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.822552:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202e00, rc 0) 00000100:00100000:0.0:1787826389.822616:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:86663:x1874668789901824:12345-192.168.203.9@tcp:101:cp.0 Request processed in 8079us (15299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.822625:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6349 00000100:00100000:2.0:1787826389.825060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826389.825378:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789901952 00000100:00100000:3.0:1787826389.825388:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789901952 00010000:00010000:3.0:1787826389.825428:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f7 expref: 14 pid: 8605 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.825471:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3116 00000100:00100000:3.0:1787826389.825481:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2401:x1874668789901952:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826389.825498:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826389.825517:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f7 expref: 14 pid: 8605 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.825531:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f7 expref: 14 pid: 8605 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.825555:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a6a706e/0x68019081f349c611 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc4f7 expref: 14 pid: 8605 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.825571:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826389.825575:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826389.825584:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.825594:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.825629:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 13 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.825642:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0884bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778689024:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826389.825731:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826389.840574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.840657:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789902208 00000100:00100000:0.0:1787826389.840667:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789902208 00000100:00100000:0.0:1787826389.840738:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2738 00000100:00100000:0.0:1787826389.840748:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+67:86663:x1874668789902208:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826389.841061:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86663:x1874668789902208:12345-192.168.203.9@tcp:35:cp.0 Request processed in 314us (496us total) trans 8590016738 rc 0/0 00000100:00100000:0.0:1787826389.841072:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2738 00000100:00100000:3.0:1787826389.848125:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0884bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778689024:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826389.848153:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826389.848214:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2401:x1874668789901952:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 22733us (23162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826389.848224:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3116 00000100:00100000:2.0:1787826389.882776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826389.882988:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789902336 00000100:00100000:3.0:1787826389.882999:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789902336 00000100:00100000:3.0:1787826389.883059:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3458 00000100:00100000:3.0:1787826389.883086:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+68:2399:x1874668789902336:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826389.883138:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826389.883159:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c634 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc53d expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883409:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883423:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883433:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883448:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883454:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883460:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883495:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883502:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883508:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883518:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826389.883521:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883529:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883541:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826389.883544:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826389.883549:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883555:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c63b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883566:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883572:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883578:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883583:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826389.883585:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883590:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883600:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbe08124a00) 00010000:00010000:3.0:1787826389.883603:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826389.883605:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883611:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349c642 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883638:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c634 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc53d expref: 69 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883648:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826389.883650:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826389.883653:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c634 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc53d expref: 69 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.883661:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc -2) 00000100:00100000:3.0:1787826389.884430:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+68:2399:x1874668789902336:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 1358us (1658us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826389.884442:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3458 00010000:00010000:3.0:1787826389.888555:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826389.913449:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.913550:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789902464 00000100:00100000:2.0:1787826389.913559:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789902464 00000100:00100000:2.0:1787826389.913624:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111716 00000100:00100000:2.0:1787826389.913635:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+30:86670:x1874668789902464:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826389.913657:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826389.913690:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c649 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc575 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.913761:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.913775:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.913788:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.913814:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.913821:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.913827:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914001:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914010:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914017:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914024:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914030:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.914034:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914041:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914053:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.914056:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.914060:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914066:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c650 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914173:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914179:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914185:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914254:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826389.914258:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914264:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914276:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826389.914278:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.914281:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914286:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349c657 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914320:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c649 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc575 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914329:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826389.914331:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.914335:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349c649 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc575 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.914344:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826389.914625:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+30:86670:x1874668789902464:12345-192.168.203.9@tcp:101:bash.0 Request processed in 991us (1187us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826389.914633:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111716 00000100:00100000:2.0:1787826389.939946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826389.939983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.940085:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789902720 00000100:00100000:0.0:1787826389.940094:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789902720 00000100:00100000:0.0:1787826389.940153:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3459 00000100:00100000:0.0:1787826389.940163:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+68:2401:x1874668789902720:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826389.940208:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.940227:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c65e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc583 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940274:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940288:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940298:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940311:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940318:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940324:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940357:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940363:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940370:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940376:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.940380:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940387:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940397:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.940400:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.940404:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940410:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c665 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940423:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940428:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940434:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940439:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.940442:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940448:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940454:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbf41389100) 00010000:00010000:0.0:1787826389.940456:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.940458:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940464:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349c66c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940487:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c65e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc583 expref: 69 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940495:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.940497:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826389.940500:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c65e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc583 expref: 69 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.940508:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203c00, rc -2) 00000100:00100000:0.0:1787826389.940561:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+68:2401:x1874668789902720:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 400us (630us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826389.940568:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3459 00000100:00100000:1.0:1787826389.942615:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789902592 00000100:00100000:1.0:1787826389.942626:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789902592 00000100:00100000:0.0:1787826389.942817:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111717 00000100:00100000:0.0:1787826389.942827:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86671:x1874668789902592:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826389.942843:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.942880:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c673 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc57c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.942937:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.942950:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.942960:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.942973:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.942979:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.942985:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943017:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943024:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943030:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943037:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943043:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.943047:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943055:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943065:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.943068:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.943071:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943078:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c67a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943090:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943108:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943113:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943118:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.943120:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943125:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943131:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826389.943133:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.943137:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943142:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c681 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943170:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c673 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc57c expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943180:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.943182:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.943186:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c673 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc57c expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.943195:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202c00, rc 0) 00000100:00100000:0.0:1787826389.943309:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86671:x1874668789902592:12345-192.168.203.9@tcp:101:rm.0 Request processed in 483us (3324us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.943316:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111717 00000100:00100000:0.0:1787826389.948430:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826389.948515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789902848 00000100:00100000:1.0:1787826389.948525:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789902848 00000100:00100000:1.0:1787826389.948585:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111718 00000100:00100000:1.0:1787826389.948594:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86671:x1874668789902848:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826389.948613:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.948635:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c688 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc58a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948709:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948723:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948735:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948749:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948757:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948768:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948816:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948823:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948829:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948835:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948841:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.948845:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948891:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948903:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.948906:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.948910:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948917:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c68f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948930:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948936:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948941:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948946:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826389.948949:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948955:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948961:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbe12458100) 00010000:00010000:1.0:1787826389.948964:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.948966:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.948972:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c696 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.949004:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c688 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc58a expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.949014:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826389.949017:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826389.949020:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c688 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc58a expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826389.949032:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9ee00, rc 0) 00000100:00100000:1.0:1787826389.949098:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86671:x1874668789902848:12345-192.168.203.9@tcp:101:rm.0 Request processed in 505us (678us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826389.949105:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111718 00000100:00100000:2.0:1787826389.973530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.973620:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789902976 00000100:00100000:0.0:1787826389.973630:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789902976 00000100:00100000:0.0:1787826389.973700:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111719 00000100:00100000:0.0:1787826389.973710:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86672:x1874668789902976:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.973728:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.973747:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c69d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc591 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973835:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973897:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973910:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973925:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973932:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973938:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973977:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973984:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973990:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.973995:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.973999:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974006:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974017:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.974021:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.974026:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974032:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c6a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974046:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974051:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974057:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974061:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.974064:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974275:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974284:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826389.974287:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.974289:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974294:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6ab lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974327:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c69d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc591 expref: 69 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974338:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.974340:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.974344:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c69d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc591 expref: 69 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.974354:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc 0) 00000100:00100000:0.0:1787826389.974460:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86672:x1874668789902976:12345-192.168.203.9@tcp:101:cp.0 Request processed in 751us (939us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.974467:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111719 00000100:00100000:2.0:1787826389.988608:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826389.988694:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789903104 00000100:00100000:0.0:1787826389.988704:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789903104 00000100:00100000:0.0:1787826389.988760:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111720 00000100:00100000:0.0:1787826389.988769:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86672:x1874668789903104:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826389.988790:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.988823:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c6b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc598 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.988933:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.988947:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.988957:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.988969:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.988976:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.988982:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989016:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989023:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989029:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989035:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.989039:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989046:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989058:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.989060:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.989065:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989071:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c6b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989083:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989090:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989108:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989113:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826389.989115:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989121:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989128:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826389.989131:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.989133:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989139:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c6c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989167:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c6b2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc598 expref: 69 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989176:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826389.989178:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826389.989181:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c6b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc598 expref: 69 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.989193:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:0.0:1787826389.989244:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86672:x1874668789903104:12345-192.168.203.9@tcp:101:cp.0 Request processed in 476us (645us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826389.989252:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111720 00000100:00100000:2.0:1787826390.000923:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.001064:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789903360 00000100:00100000:1.0:1787826390.001083:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789903360 00000100:00100000:1.0:1787826390.001141:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111721 00000100:00100000:1.0:1787826390.001150:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+68:86672:x1874668789903360:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.001168:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.001187:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c6c7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc59f expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001296:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001310:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001321:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001337:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001343:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001348:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.001636:0:45682:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xce:0x0], index 0: 0 00010000:00010000:1.0:1787826390.001777:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f349c6dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001786:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f349c6dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001803:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f349c6dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001834:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001841:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001848:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001880:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.001884:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001892:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001904:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.001907:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.001911:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001921:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c6ce lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.001934:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac812a84 reply state 00000000c9f001f2 transno 8590016739 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001944:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001950:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbe12458100) 00010000:00010000:1.0:1787826390.001952:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.001955:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.001983:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c6c7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc59f expref: 71 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.001997:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e600/0x68019081f349c6dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc59f expref: 70 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.002004:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13e:0x0].0x0 (ffff9bbe12458700) 00010000:00010000:1.0:1787826390.002006:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.002008:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e600, rc 0) 00000100:00100000:1.0:1787826390.002081:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+71:86672:x1874668789903360:12345-192.168.203.9@tcp:101:cp.0 Request processed in 932us (1167us total) trans 8590016739 rc 0/0 00000100:00100000:1.0:1787826390.002089:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111721 00000100:00100000:2.0:1787826390.008561:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.009192:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789903488 00000100:00100000:1.0:1787826390.009202:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789903488 00000100:00100000:1.0:1787826390.009261:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6350 00000100:00100000:1.0:1787826390.009271:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789903488:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.009289:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.009309:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5a6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826390.009335:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826390.009358:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=3028s v=(0 0) 00010000:00010000:1.0:1787826390.009363:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.009372:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5a6 expref: 17 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.009391:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5a6 expref: 17 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.009403:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f200, rc 0) 00000100:00100000:1.0:1787826390.009459:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789903488:12345-192.168.203.9@tcp:101:cp.0 Request processed in 189us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.009467:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6350 00000100:00100000:3.0:1787826390.013028:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.013141:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789903616 00000100:00100000:2.0:1787826390.013150:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789903616 00000100:00100000:2.0:1787826390.013200:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6351 00000100:00100000:2.0:1787826390.013209:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+17:86672:x1874668789903616:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826390.013225:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.013242:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5ad expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.013273:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5a6 expref: 18 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.013282:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826390.013287:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826390.013292:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 18 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.013322:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5a6 expref: 18 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.013336:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5a6 expref: 18 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826390.013350:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778689152:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826390.013452:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d0c0 going to sleep for 11 seconds 00000040:00080000:2.0:1787826390.017839:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826390.017847:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826390.018413:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 64768 count 1 00000040:00080000:2.0:1787826390.018428:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1787826390.019119:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.019241:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789903744 00000100:00100000:3.0:1787826390.019250:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789903744 00010000:00010000:3.0:1787826390.019286:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5a6 expref: 19 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826390.019327:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3117 00000100:00100000:3.0:1787826390.019338:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2402:x1874668789903744:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826390.019352:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826390.019369:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5a6 expref: 19 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.019384:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5a6 expref: 19 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.019409:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.019413:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.019422:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.019432:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.019463:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826390.019476:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08848780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778689280:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826390.019555:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787826390.022458:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349c6ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5a6 expref: 19 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826390.022482:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778689152:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826390.022510:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 18 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.022524:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:2.0:1787826390.022594:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+18:86672:x1874668789903616:12345-192.168.203.9@tcp:101:cp.0 Request processed in 9386us (9575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826390.022602:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6351 00000100:00100000:3.0:1787826390.024373:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08848780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778689280:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826390.024395:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826390.024457:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789903744:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5120us (5343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.024471:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3117 00000100:00100000:2.0:1787826390.026893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.026951:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789904000 00000100:00100000:0.0:1787826390.026960:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789904000 00000100:00100000:0.0:1787826390.027016:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2739 00000100:00100000:0.0:1787826390.027026:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+71:86672:x1874668789904000:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826390.027321:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86672:x1874668789904000:12345-192.168.203.9@tcp:35:cp.0 Request processed in 296us (435us total) trans 8590016740 rc 0/0 00000100:00100000:0.0:1787826390.027328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2739 00000100:00100000:1.0:1787826390.074455:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.074563:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789904128 00000100:00100000:2.0:1787826390.074572:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789904128 00000100:00100000:2.0:1787826390.074632:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3460 00000100:00100000:2.0:1787826390.074643:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+72:2400:x1874668789904128:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826390.074690:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.074717:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c6f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5b4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074769:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074784:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074804:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074819:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074840:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074847:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074918:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074925:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074931:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074939:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.074942:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074949:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074961:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.074964:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.074968:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074974:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c6ff lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074989:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074994:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.074999:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.075003:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.075006:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.075011:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.075017:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826390.075019:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.075021:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.075027:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c706 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.075058:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c6f8 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5b4 expref: 73 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.075066:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.075068:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826390.075072:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c6f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5b4 expref: 73 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.075081:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc -2) 00000100:00100000:2.0:1787826390.075151:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+72:2400:x1874668789904128:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 510us (704us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826390.075158:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3460 00000100:00100000:2.0:1787826390.089945:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.090072:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789904256 00000100:00100000:0.0:1787826390.090083:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789904256 00000100:00100000:0.0:1787826390.090141:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111722 00000100:00100000:0.0:1787826390.090151:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+30:86676:x1874668789904256:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826390.090170:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.090202:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c70d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5bb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090272:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090287:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090303:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090316:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090323:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090329:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090368:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090376:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090382:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090388:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090393:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.090398:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090405:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090417:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.090420:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.090425:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090431:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c714 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090445:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090450:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090456:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090460:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.090463:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090469:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090476:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xcdd6ff3 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826390.090479:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.090482:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090488:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c71b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090520:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c70d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5bb expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090530:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.090532:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.090535:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c70d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5bb expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.090543:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826390.090605:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+30:86676:x1874668789904256:12345-192.168.203.9@tcp:101:bash.0 Request processed in 455us (670us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.090612:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111722 00000100:00100000:3.0:1787826390.100730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.100888:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789904384 00000100:00100000:1.0:1787826390.100897:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789904384 00000100:00100000:1.0:1787826390.100955:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111723 00000100:00100000:1.0:1787826390.100966:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86677:x1874668789904384:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826390.100986:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.101007:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c722 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101072:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101086:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101097:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101111:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101118:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101124:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101164:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101170:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101176:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101181:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101186:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.101191:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101269:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101282:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.101285:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.101290:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101297:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c729 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101310:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101316:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101323:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101328:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.101331:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101337:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101343:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xcdd6ff3 (ffff9bbe12458600) 00010000:00010000:1.0:1787826390.101345:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.101349:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101355:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c730 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101384:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c722 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5c2 expref: 73 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101393:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.101396:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.101400:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c722 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5c2 expref: 73 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.101409:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f400, rc 0) 00000100:00100000:1.0:1787826390.101535:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86677:x1874668789904384:12345-192.168.203.9@tcp:101:rm.0 Request processed in 571us (814us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.101543:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111723 00000100:00100000:1.0:1787826390.104977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.105070:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789904512 00000100:00100000:2.0:1787826390.105080:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789904512 00000100:00100000:2.0:1787826390.105180:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111724 00000100:00100000:2.0:1787826390.105200:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86677:x1874668789904512:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826390.105220:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.105240:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c737 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5c9 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105298:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105312:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105322:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105336:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105343:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105354:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105389:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105396:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105403:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105409:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.105413:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105421:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105432:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.105435:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.105439:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105445:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c73e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105459:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105464:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105471:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105476:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.105479:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105485:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105491:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xcdd6ff3 (ffff9bbe0fe8c900) 00010000:00010000:2.0:1787826390.105493:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.105496:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105502:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c745 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105532:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c737 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5c9 expref: 73 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105542:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.105545:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.105548:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c737 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5c9 expref: 73 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.105558:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826390.105655:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86677:x1874668789904512:12345-192.168.203.9@tcp:101:rm.0 Request processed in 466us (685us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826390.105665:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111724 00000100:00100000:2.0:1787826390.119135:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.119246:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789904640 00000100:00100000:0.0:1787826390.119255:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789904640 00000100:00100000:0.0:1787826390.119355:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111725 00000100:00100000:0.0:1787826390.119366:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86678:x1874668789904640:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.119386:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.119405:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c74c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119474:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119487:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119497:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119510:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119518:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119523:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119563:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119571:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119578:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119584:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.119589:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119597:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119610:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.119613:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.119617:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119623:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c753 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119637:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119644:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119649:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119655:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.119658:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119664:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119671:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xcdd6ff3 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826390.119674:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.119676:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119682:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c75a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.120099:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c74c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5d0 expref: 73 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.120109:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.120112:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.120116:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c74c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5d0 expref: 73 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.120130:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826390.120197:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86678:x1874668789904640:12345-192.168.203.9@tcp:101:cp.0 Request processed in 823us (1060us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.120205:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111725 00000100:00100000:3.0:1787826390.122900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.123135:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789904768 00000100:00100000:1.0:1787826390.123144:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789904768 00000100:00100000:1.0:1787826390.123207:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111726 00000100:00100000:1.0:1787826390.123216:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86678:x1874668789904768:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.123235:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.123254:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c761 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5d7 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123319:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123338:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123349:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123364:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123371:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123378:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123414:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123420:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123427:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123433:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.123437:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123445:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123455:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.123458:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.123463:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123468:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c768 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123480:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123486:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123491:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123496:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.123498:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123504:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123511:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xcdd6ff3 (ffff9bbe12458600) 00010000:00010000:1.0:1787826390.123513:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.123516:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123522:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c76f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123555:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c761 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5d7 expref: 73 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123566:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.123569:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.123572:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c761 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5d7 expref: 73 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.123581:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f400, rc 0) 00000100:00100000:1.0:1787826390.123651:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86678:x1874668789904768:12345-192.168.203.9@tcp:101:cp.0 Request processed in 436us (760us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.123659:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111726 00000100:00100000:3.0:1787826390.130565:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.130671:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789905024 00000100:00100000:0.0:1787826390.130689:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789905024 00000100:00100000:0.0:1787826390.130741:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111727 00000100:00100000:0.0:1787826390.130750:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+72:86678:x1874668789905024:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.130769:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.130789:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c776 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.130921:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.130936:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.130947:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.130961:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.130969:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.130975:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.131261:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xcf:0x0], index 1: 0 00010000:00010000:0.0:1787826390.131382:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c78b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131392:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c78b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131399:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c78b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131427:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131434:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131441:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131447:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131453:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.131457:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131465:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131476:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.131479:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.131485:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131491:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c77d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.131506:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8913ae6 reply state 00000000bb6490ce transno 8590016741 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131517:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131523:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xcdd6ff3 (ffff9bbf41389100) 00010000:00010000:0.0:1787826390.131525:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.131527:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826390.131553:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c776 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5de expref: 75 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131567:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203c00/0x68019081f349c78b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5de expref: 74 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.131574:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13f:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:0.0:1787826390.131577:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826390.131579:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203c00, rc 0) 00000100:00100000:0.0:1787826390.131645:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+75:86678:x1874668789905024:12345-192.168.203.9@tcp:101:cp.0 Request processed in 896us (1091us total) trans 8590016741 rc 0/0 00000100:00100000:0.0:1787826390.131653:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111727 00000100:00100000:3.0:1787826390.134938:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.135035:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789905152 00000100:00100000:2.0:1787826390.135045:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789905152 00000100:00100000:2.0:1787826390.135101:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6352 00000100:00100000:2.0:1787826390.135119:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+13:2402:x1874668789905152:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826390.135137:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.135156:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5e5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826390.135182:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826390.135211:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=3028s v=(0 0) 00010000:00010000:2.0:1787826390.135216:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826390.135226:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5e5 expref: 14 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.135244:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5e5 expref: 14 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.135256:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826390.135303:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789905152:12345-192.168.203.9@tcp:101:cp.0 Request processed in 194us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826390.135309:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6352 00000100:00100000:3.0:1787826390.139844:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.139980:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789905280 00000100:00100000:0.0:1787826390.139990:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789905280 00000100:00100000:0.0:1787826390.140039:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6353 00000100:00100000:0.0:1787826390.140048:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:86678:x1874668789905280:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.140066:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.140083:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5ec expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.140113:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5e5 expref: 15 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.140122:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.140127:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.140132:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.140163:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5e5 expref: 15 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.140177:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5e5 expref: 15 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.140201:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778689408:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826390.140301:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826390.142003:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778689408:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826390.142044:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.142062:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203200, rc 0) 00000100:00100000:0.0:1787826390.142107:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:86678:x1874668789905280:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2060us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.142116:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6353 00000100:00100000:3.0:1787826390.143771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.143879:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789905408 00000100:00100000:1.0:1787826390.143888:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789905408 00010000:00010000:1.0:1787826390.143928:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5e5 expref: 15 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826390.143962:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3118 00000100:00100000:1.0:1787826390.143971:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789905408:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826390.143986:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826390.144007:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5e5 expref: 15 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.144020:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5e5 expref: 15 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.144043:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006324b6eb/0x68019081f349c799 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5e5 expref: 15 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.144064:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.144068:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.144076:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.144086:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.144120:0:45686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 14 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826390.144134:0:45686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778689536:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826390.144214:0:45686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17885a80 going to sleep for 11 seconds 00000040:00080000:1.0:1787826390.144976:0:58480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787826390.144982:0:58480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826390.146339:0:58480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787826390.146353:0:58480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787826390.148494:0:45686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778689536:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826390.148519:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826390.148577:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789905408:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4606us (4811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.148588:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3118 00000100:00100000:3.0:1787826390.149361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.149537:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789905664 00000100:00100000:0.0:1787826390.149544:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789905664 00000100:00100000:0.0:1787826390.149598:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2740 00000100:00100000:0.0:1787826390.149607:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+75:86678:x1874668789905664:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826390.149915:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86678:x1874668789905664:12345-192.168.203.9@tcp:35:cp.0 Request processed in 308us (555us total) trans 8590016742 rc 0/0 00000100:00100000:0.0:1787826390.149923:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2740 00000100:00100000:3.0:1787826390.179277:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.179423:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789905792 00000100:00100000:1.0:1787826390.179434:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789905792 00000100:00100000:1.0:1787826390.179502:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111728 00000100:00100000:1.0:1787826390.179512:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+30:86681:x1874668789905792:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1787826390.179530:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.179552:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c7a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5f3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179615:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179628:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179651:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179666:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179684:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179692:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179728:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179736:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179742:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179751:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179757:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.179761:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179768:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179779:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.179782:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.179786:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179802:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7ae lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179816:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179822:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179828:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179833:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.179836:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179847:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179904:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbe12458600) 00010000:00010000:1.0:1787826390.179907:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.179910:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179916:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179946:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c7a7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5f3 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179957:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.179959:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.179963:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c7a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5f3 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.179971:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9fc00, rc 0) 00000100:00100000:1.0:1787826390.180022:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+30:86681:x1874668789905792:12345-192.168.203.9@tcp:101:bash.0 Request processed in 513us (756us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.180029:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111728 00000100:00100000:1.0:1787826390.193379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.193449:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789905920 00000100:00100000:0.0:1787826390.193459:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789905920 00000100:00100000:0.0:1787826390.193526:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111729 00000100:00100000:0.0:1787826390.193536:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86682:x1874668789905920:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826390.193558:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.193580:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c7bc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc5fa expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193643:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193657:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193668:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193691:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193705:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193711:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193747:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193753:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193759:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193765:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.193769:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193776:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193787:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.193790:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.193803:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193809:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c7c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193820:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193827:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193832:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193837:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.193839:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193845:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193891:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826390.193894:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.193897:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193903:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7ca lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193933:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c7bc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5fa expref: 77 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193943:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.193945:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.193949:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349c7bc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5fa expref: 77 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.193962:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202400, rc 0) 00000100:00100000:0.0:1787826390.194017:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86682:x1874668789905920:12345-192.168.203.9@tcp:101:rm.0 Request processed in 483us (648us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.194024:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111729 00000100:00100000:0.0:1787826390.197431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.197527:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789906048 00000100:00100000:1.0:1787826390.197536:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789906048 00000100:00100000:1.0:1787826390.197597:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111730 00000100:00100000:1.0:1787826390.197607:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86682:x1874668789906048:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826390.197624:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.197653:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc601 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197727:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197741:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197751:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197765:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197772:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197778:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197825:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197832:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197838:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197845:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197894:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.197898:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197906:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197916:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.197920:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.197924:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197930:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c7d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197943:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197949:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197956:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197960:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.197963:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197969:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197980:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbe12458600) 00010000:00010000:1.0:1787826390.197982:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.197985:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.197991:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c7df lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.198020:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7d1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc601 expref: 77 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.198029:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.198031:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.198035:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c7d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc601 expref: 77 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.198044:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9fe00, rc 0) 00000100:00100000:1.0:1787826390.198095:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86682:x1874668789906048:12345-192.168.203.9@tcp:101:rm.0 Request processed in 491us (673us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.198103:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111730 00000100:00100000:1.0:1787826390.220648:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.220845:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789906176 00000100:00100000:2.0:1787826390.220879:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789906176 00000100:00100000:2.0:1787826390.220941:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111731 00000100:00100000:2.0:1787826390.220951:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86683:x1874668789906176:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826390.220970:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.220993:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c7e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221056:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221070:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221080:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221092:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221097:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221103:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221140:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221146:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221152:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221164:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221170:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.221174:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221180:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221202:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.221205:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.221210:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221216:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c7ed lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221231:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221236:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221242:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221246:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.221249:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221258:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221264:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826390.221266:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.221269:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221274:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c7f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221306:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c7e6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc608 expref: 77 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221316:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.221319:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.221322:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349c7e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc608 expref: 77 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.221331:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826390.221397:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86683:x1874668789906176:12345-192.168.203.9@tcp:101:cp.0 Request processed in 447us (757us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826390.221404:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111731 00000100:00100000:3.0:1787826390.224789:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.224993:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789906304 00000100:00100000:0.0:1787826390.225002:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789906304 00000100:00100000:0.0:1787826390.225056:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111732 00000100:00100000:0.0:1787826390.225065:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86683:x1874668789906304:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.225084:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.225105:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7fb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc60f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225172:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225185:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225208:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225224:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225230:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225241:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225283:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225289:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225296:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225303:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225309:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.225313:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225322:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225333:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.225337:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.225341:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225348:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c802 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225362:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225368:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225373:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225378:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.225380:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225386:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225393:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826390.225396:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.225399:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225403:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c809 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225435:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7fb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc60f expref: 77 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225444:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.225446:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.225449:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c7fb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc60f expref: 77 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.225463:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:0.0:1787826390.225535:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86683:x1874668789906304:12345-192.168.203.9@tcp:101:cp.0 Request processed in 471us (757us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.225542:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111732 00000100:00100000:3.0:1787826390.229321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.230042:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789906560 00000100:00100000:1.0:1787826390.230052:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789906560 00000100:00100000:1.0:1787826390.230144:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111733 00000100:00100000:1.0:1787826390.230154:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+76:86683:x1874668789906560:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.230173:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.230203:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c810 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.230310:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.230325:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.230336:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.230349:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.230356:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.230362:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.230804:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xcf:0x0], index 0: 0 00010000:00010000:1.0:1787826390.230965:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c825 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x140:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.230977:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c825 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.230985:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c825 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231014:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231027:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231034:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231040:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231045:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.231049:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231057:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231068:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.231070:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.231075:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231082:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c817 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.231105:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d68c18d reply state 00000000f707a6b7 transno 8590016743 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231117:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231123:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbe12458600) 00010000:00010000:1.0:1787826390.231126:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.231129:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.231158:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c810 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc616 expref: 79 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231172:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fc00/0x68019081f349c825 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc616 expref: 78 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.231178:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x140:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:1.0:1787826390.231180:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.231401:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9fc00, rc 0) 00000100:00100000:1.0:1787826390.231580:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:86683:x1874668789906560:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1426us (2267us total) trans 8590016743 rc 0/0 00000100:00100000:1.0:1787826390.231588:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111733 00000100:00100000:1.0:1787826390.235435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.235579:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789906688 00000100:00100000:3.0:1787826390.235588:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789906688 00000100:00100000:3.0:1787826390.235683:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6354 00000100:00100000:3.0:1787826390.235696:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789906688:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826390.235714:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.235733:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc61d expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826390.235758:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826390.235776:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=3028s v=(0 0) 00010000:00010000:3.0:1787826390.235781:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.235790:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc61d expref: 18 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.235818:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc61d expref: 18 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.235832:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826390.235917:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789906688:12345-192.168.203.9@tcp:101:cp.0 Request processed in 224us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.235924:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6354 00000100:00100000:0.0:1787826390.239315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.239399:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789906816 00000100:00100000:2.0:1787826390.239409:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789906816 00000100:00100000:2.0:1787826390.239465:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6355 00000100:00100000:2.0:1787826390.239485:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+18:86683:x1874668789906816:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826390.239505:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.239523:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc624 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.239557:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc61d expref: 19 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.239565:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826390.239570:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826390.239575:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: --/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.239609:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc61d expref: 19 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.239621:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc61d expref: 19 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826390.239636:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410eda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778689664:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826390.239882:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826390.242954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.243048:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789906944 00000100:00100000:1.0:1787826390.243057:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789906944 00010000:00010000:1.0:1787826390.243096:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc61d expref: 20 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826390.243140:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3119 00000100:00100000:1.0:1787826390.243149:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2402:x1874668789906944:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826390.243163:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826390.243195:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc61d expref: 20 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.243210:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc61d expref: 20 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.243234:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.243239:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.243248:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 20 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.243258:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 20 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.243291:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 20 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826390.243304:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fcc3840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778689792:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826390.243369:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe178850c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787826390.243806:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067eee12e/0x68019081f349c833 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc61d expref: 20 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826390.243822:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410eda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778689664:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826390.243843:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.243891:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826390.243933:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+19:86683:x1874668789906816:12345-192.168.203.9@tcp:101:cp.0 Request processed in 4450us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826390.243941:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6355 00000100:00100000:1.0:1787826390.246454:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fcc3840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778689792:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826390.246477:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826390.246531:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789906944:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3382us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.246542:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3119 00000100:00100000:1.0:1787826390.254002:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.254087:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789907200 00000100:00100000:3.0:1787826390.254096:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789907200 00000100:00100000:3.0:1787826390.254151:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2741 00000100:00100000:3.0:1787826390.254161:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+79:86683:x1874668789907200:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:3.0:1787826390.254451:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86683:x1874668789907200:12345-192.168.203.9@tcp:35:cp.0 Request processed in 290us (456us total) trans 8590016744 rc 0/0 00000100:00100000:3.0:1787826390.254459:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2741 00000100:00100000:0.0:1787826390.300452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.300549:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789907328 00000100:00100000:2.0:1787826390.300558:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789907328 00000100:00100000:2.0:1787826390.300624:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111734 00000100:00100000:2.0:1787826390.300635:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+30:86686:x1874668789907328:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826390.300666:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.301026:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c841 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc62b expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301095:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301109:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301120:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301134:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301140:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301145:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301180:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301187:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301193:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301198:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.301203:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301210:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301221:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.301224:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.301228:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301234:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c848 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301250:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301256:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301262:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301268:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.301270:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301275:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301281:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9537b590 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826390.301284:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.301286:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301291:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c84f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301323:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c841 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc62b expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301332:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.301334:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.301337:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349c841 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc62b expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.301345:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826390.301412:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+30:86686:x1874668789907328:12345-192.168.203.9@tcp:101:bash.0 Request processed in 780us (971us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826390.301421:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111734 00000100:00100000:1.0:1787826390.314580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.314687:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789907456 00000100:00100000:0.0:1787826390.314703:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789907456 00000100:00100000:0.0:1787826390.314762:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111735 00000100:00100000:0.0:1787826390.314772:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86687:x1874668789907456:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826390.314807:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.314829:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c856 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc632 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.314931:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.314947:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.314957:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.314972:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.314979:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.314986:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315023:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315030:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315036:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315042:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315047:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.315050:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315057:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315068:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.315071:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.315076:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315083:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c85d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315096:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315102:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315108:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315113:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.315115:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315120:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315127:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9537b590 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826390.315130:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.315133:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315139:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c864 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315174:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c856 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc632 expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315184:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.315186:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.315190:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c856 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc632 expref: 81 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.315204:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2200, rc 0) 00000100:00100000:0.0:1787826390.315481:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86687:x1874668789907456:12345-192.168.203.9@tcp:101:rm.0 Request processed in 708us (909us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.315490:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111735 00000100:00100000:1.0:1787826390.319834:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.320028:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789907584 00000100:00100000:2.0:1787826390.320038:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789907584 00000100:00100000:2.0:1787826390.320123:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111736 00000100:00100000:2.0:1787826390.320133:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86687:x1874668789907584:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826390.320154:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.320175:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c86b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc639 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320246:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320261:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320273:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320286:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320293:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320299:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320337:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320344:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320350:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320358:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320364:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.320368:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320376:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320387:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.320391:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.320396:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320402:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349c872 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320414:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320420:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320425:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320429:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.320432:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320442:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320449:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9537b590 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826390.320452:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.320455:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320460:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349c879 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320491:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c86b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc639 expref: 81 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320502:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.320505:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.320508:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349c86b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc639 expref: 81 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.320518:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826390.320617:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86687:x1874668789907584:12345-192.168.203.9@tcp:101:rm.0 Request processed in 486us (792us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826390.320625:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111736 00000100:00100000:2.0:1787826390.344770:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.344911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789907712 00000100:00100000:0.0:1787826390.344920:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789907712 00000100:00100000:0.0:1787826390.344979:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111737 00000100:00100000:0.0:1787826390.344989:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86688:x1874668789907712:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.345006:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.345025:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c880 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc640 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345086:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345112:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345123:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345137:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345143:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345149:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345184:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345192:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345198:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345205:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345210:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.345214:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345221:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345232:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.345235:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.345239:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345245:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c887 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345259:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345265:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345271:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345276:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.345279:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345284:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345291:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9537b590 (ffff9bbf41389a00) 00010000:00010000:0.0:1787826390.345293:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.345296:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345301:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349c88e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345330:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c880 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc640 expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345340:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.345342:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.345345:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c880 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc640 expref: 81 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345354:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2200, rc 0) 00000100:00100000:0.0:1787826390.345422:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86688:x1874668789907712:12345-192.168.203.9@tcp:101:cp.0 Request processed in 434us (660us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.345432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111737 00000100:00100000:1.0:1787826390.348453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.348583:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789907840 00000100:00100000:3.0:1787826390.348592:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789907840 00000100:00100000:3.0:1787826390.348645:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111738 00000100:00100000:3.0:1787826390.348655:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86688:x1874668789907840:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826390.348682:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.348713:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c895 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc647 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.348781:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.348803:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.348815:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.348830:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.348837:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.348843:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349020:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349028:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349034:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349041:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349047:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.349052:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349059:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349070:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.349073:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.349077:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349084:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c89c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349095:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349101:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349107:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349112:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.349115:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349120:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349126:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9537b590 (ffff9bbe08124b00) 00010000:00010000:3.0:1787826390.349128:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.349131:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349136:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c8a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349164:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c895 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc647 expref: 81 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349178:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.349180:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.349362:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c895 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc647 expref: 81 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.349373:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826390.349434:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86688:x1874668789907840:12345-192.168.203.9@tcp:101:cp.0 Request processed in 781us (990us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826390.349441:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111738 00000100:00100000:3.0:1787826390.352723:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.352901:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789908096 00000100:00100000:1.0:1787826390.352911:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789908096 00000100:00100000:1.0:1787826390.352963:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111739 00000100:00100000:1.0:1787826390.352973:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+80:86688:x1874668789908096:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.352991:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.353012:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c8aa lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc64e expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353108:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353121:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353130:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353142:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353148:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353153:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.353447:0:45683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xd0:0x0], index 1: 0 00010000:00010000:1.0:1787826390.353570:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c8bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x141:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353579:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c8bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353586:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c8bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353616:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353623:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353629:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353636:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.353639:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353646:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353657:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.353660:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.353664:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353671:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c8b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.353683:0:45683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa0ce884 reply state 00000000a7bfc89d transno 8590016745 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353710:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353717:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9537b590 (ffff9bbe12458800) 00010000:00010000:1.0:1787826390.353720:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.353723:0:45683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.353751:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c8aa lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc64e expref: 83 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353765:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f600/0x68019081f349c8bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc64e expref: 82 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.353772:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x141:0x0].0x0 (ffff9bbe12458b00) 00010000:00010000:1.0:1787826390.353774:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.353776:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f600, rc 0) 00000100:00100000:1.0:1787826390.353881:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+83:86688:x1874668789908096:12345-192.168.203.9@tcp:101:cp.0 Request processed in 909us (1166us total) trans 8590016745 rc 0/0 00000100:00100000:1.0:1787826390.353889:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111739 00000100:00100000:2.0:1787826390.357224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.357353:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789908224 00000100:00100000:3.0:1787826390.357363:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789908224 00000100:00100000:3.0:1787826390.357417:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6356 00000100:00100000:3.0:1787826390.357428:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+14:2402:x1874668789908224:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826390.357446:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.357466:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc655 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826390.357491:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826390.357509:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=3028s v=(0 0) 00010000:00010000:3.0:1787826390.357514:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.357523:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc655 expref: 15 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.357542:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc655 expref: 15 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.357556:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826390.357623:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789908224:12345-192.168.203.9@tcp:101:cp.0 Request processed in 197us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.357630:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6356 00000100:00100000:3.0:1787826390.361021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.361133:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789908352 00000100:00100000:0.0:1787826390.361143:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789908352 00000100:00100000:0.0:1787826390.361207:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6357 00000100:00100000:0.0:1787826390.361216:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+15:86688:x1874668789908352:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.361233:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.361249:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc65c expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361277:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc655 expref: 16 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361286:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.361290:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.361295:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361327:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc655 expref: 16 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361340:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc655 expref: 16 pid: 19335 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.361353:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7bbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778689920:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826390.361444:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826390.363542:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7bbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778689920:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826390.363584:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.363603:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:1.0:1787826390.363654:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:86688:x1874668789908352:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2439us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.363663:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6357 00000100:00100000:3.0:1787826390.365604:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.365703:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789908480 00000100:00100000:0.0:1787826390.365713:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789908480 00010000:00010000:0.0:1787826390.365753:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc655 expref: 16 pid: 19335 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.365803:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3120 00000100:00100000:0.0:1787826390.365813:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789908480:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826390.365828:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826390.365889:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc655 expref: 16 pid: 19335 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.365904:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc655 expref: 16 pid: 19335 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.365926:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067eee12e/0x68019081f349c8cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc655 expref: 16 pid: 19335 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.365943:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.365947:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.365955:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.365964:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.365998:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 15 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.366013:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778690048:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826390.366089:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826390.369819:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778690048:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826390.369847:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826390.369931:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2401:x1874668789908480:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4119us (4335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.369942:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3120 00000100:00100000:1.0:1787826390.371578:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.371653:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789908736 00000100:00100000:2.0:1787826390.371661:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789908736 00000100:00100000:2.0:1787826390.371728:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2742 00000100:00100000:2.0:1787826390.371739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+83:86688:x1874668789908736:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:2.0:1787826390.372042:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86688:x1874668789908736:12345-192.168.203.9@tcp:35:cp.0 Request processed in 304us (470us total) trans 8590016746 rc 0/0 00000100:00100000:2.0:1787826390.372050:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2742 00000100:00100000:3.0:1787826390.402241:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.402544:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789908864 00000100:00100000:0.0:1787826390.402553:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789908864 00000100:00100000:0.0:1787826390.402663:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111740 00000100:00100000:0.0:1787826390.402675:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+30:86691:x1874668789908864:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826390.402713:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.402734:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c8db lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc663 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.402811:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.402826:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.402837:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.402996:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403011:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403018:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403054:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403061:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403067:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403074:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403080:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.403084:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403091:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403101:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.403104:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.403108:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403115:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403129:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403135:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403141:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403146:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.403148:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403154:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403161:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd964d85e (ffff9bbf41389a00) 00010000:00010000:0.0:1787826390.403163:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.403166:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403172:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403344:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c8db lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc663 expref: 31 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403356:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.403359:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.403363:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c8db lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc663 expref: 31 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.403373:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826390.403497:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+30:86691:x1874668789908864:12345-192.168.203.9@tcp:101:bash.0 Request processed in 824us (1265us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.403505:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111740 00000100:00100000:1.0:1787826390.413245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.413474:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789908992 00000100:00100000:0.0:1787826390.413485:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789908992 00000100:00100000:0.0:1787826390.413589:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111741 00000100:00100000:0.0:1787826390.413600:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86692:x1874668789908992:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826390.413623:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.413642:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c8f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc66a expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413729:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413742:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413753:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413767:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413773:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413779:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413834:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413841:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413847:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413906:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.413910:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413919:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413930:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.413933:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.413938:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413944:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c8f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413957:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413963:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413969:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413975:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.413977:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413983:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.413989:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd964d85e (ffff9bbf41389a00) 00010000:00010000:0.0:1787826390.413992:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.413995:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.414000:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349c8fe lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.414031:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c8f0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc66a expref: 85 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.414041:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.414044:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.414047:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c8f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc66a expref: 85 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.414055:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826390.414132:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86692:x1874668789908992:12345-192.168.203.9@tcp:101:rm.0 Request processed in 534us (895us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.414139:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111741 00000100:00100000:2.0:1787826390.417738:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.417996:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789909120 00000100:00100000:0.0:1787826390.418007:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789909120 00000100:00100000:1.0:1787826390.418123:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111742 00000100:00100000:1.0:1787826390.418133:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86692:x1874668789909120:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826390.418154:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.418174:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c905 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc671 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418248:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418262:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418273:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418288:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418295:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418301:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418338:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418346:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418352:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418358:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.418363:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418370:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418382:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.418385:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.418390:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418397:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c90c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418409:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418416:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418422:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418427:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.418430:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418437:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418444:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd964d85e (ffff9bbe12458c00) 00010000:00010000:1.0:1787826390.418447:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.418450:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418456:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c913 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418489:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c905 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc671 expref: 85 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418500:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.418503:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.418507:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c905 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc671 expref: 85 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.418516:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f200, rc 0) 00000100:00100000:1.0:1787826390.418573:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86692:x1874668789909120:12345-192.168.203.9@tcp:101:rm.0 Request processed in 441us (845us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.418580:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111742 00000100:00100000:3.0:1787826390.430511:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.430609:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789909248 00000100:00100000:1.0:1787826390.430618:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789909248 00000100:00100000:1.0:1787826390.430683:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111743 00000100:00100000:1.0:1787826390.430703:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86693:x1874668789909248:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.430723:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.430746:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c91a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc678 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430817:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430835:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430847:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430900:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430907:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430914:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430953:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430960:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430967:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430973:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430979:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.430983:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.430991:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431003:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.431006:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.431011:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431017:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349c921 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431030:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431036:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431042:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431047:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.431050:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431055:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431062:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd964d85e (ffff9bbe12458c00) 00010000:00010000:1.0:1787826390.431064:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.431067:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431073:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349c928 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431107:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c91a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc678 expref: 85 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431117:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.431119:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.431123:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349c91a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc678 expref: 85 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.431132:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f200, rc 0) 00000100:00100000:1.0:1787826390.431487:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86693:x1874668789909248:12345-192.168.203.9@tcp:101:cp.0 Request processed in 793us (982us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.431494:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111743 00000100:00100000:1.0:1787826390.435131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.435260:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789909376 00000100:00100000:2.0:1787826390.435269:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789909376 00000100:00100000:2.0:1787826390.435366:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111744 00000100:00100000:2.0:1787826390.435376:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86693:x1874668789909376:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826390.435396:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.435416:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c92f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc67f expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435481:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435495:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435507:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435520:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435527:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435534:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435570:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435577:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435583:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435589:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.435593:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435601:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435612:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.435615:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.435620:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435626:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c936 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435640:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435645:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435651:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435656:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.435659:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435665:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435685:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd964d85e (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826390.435688:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.435691:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435843:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c93d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435917:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c92f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc67f expref: 85 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435928:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.435931:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.435935:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c92f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc67f expref: 85 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.435944:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:2.0:1787826390.435998:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3faffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86693:x1874668789909376:12345-192.168.203.9@tcp:101:cp.0 Request processed in 624us (876us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826390.436006:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111744 00000100:00100000:3.0:1787826390.438732:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.439202:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789909632 00000100:00100000:0.0:1787826390.439212:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789909632 00000100:00100000:1.0:1787826390.439420:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111745 00000100:00100000:1.0:1787826390.439431:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+84:86693:x1874668789909632:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.439450:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.439470:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c944 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc686 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.439566:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.439579:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.439589:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.439605:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.439611:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.439617:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.442298:0:25759:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd0:0x0], index 0: 0 00010000:00010000:1.0:1787826390.442455:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c959 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x142:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442471:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c959 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442481:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c959 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442511:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442517:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442523:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442528:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.442532:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442542:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442553:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.442556:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.442561:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442568:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349c94b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.442580:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000392a7f26 reply state 0000000092f9925b transno 8590016747 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442592:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442597:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd964d85e (ffff9bbe12458900) 00010000:00010000:1.0:1787826390.442600:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.442602:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.442638:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349c944 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc686 expref: 87 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442654:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7e00/0x68019081f349c959 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc686 expref: 86 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.442661:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x142:0x0].0x0 (ffff9bbe12458000) 00010000:00010000:1.0:1787826390.442663:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.442665:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7e00, rc 0) 00000100:00100000:1.0:1787826390.443142:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+87:86693:x1874668789909632:12345-192.168.203.9@tcp:101:cp.0 Request processed in 3711us (4415us total) trans 8590016747 rc 0/0 00000100:00100000:1.0:1787826390.443152:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111745 00000100:00100000:3.0:1787826390.449970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.450016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.450136:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789909888 00000100:00100000:2.0:1787826390.450146:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789909888 00000100:00100000:2.0:1787826390.450210:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3461 00000100:00100000:2.0:1787826390.450221:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0225b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+87:2400:x1874668789909888:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826390.450283:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.450303:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c967 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc694 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450363:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450376:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450387:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450402:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450410:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450417:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450454:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450462:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450469:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450476:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.450481:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450489:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450501:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.450504:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.450509:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450517:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c96e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450531:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450538:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450544:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450550:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.450553:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450560:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450572:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826390.450575:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.450578:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450585:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c975 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450613:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c967 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc694 expref: 88 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450623:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.450626:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826390.450630:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c967 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc694 expref: 88 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.450640:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc -2) 00000100:00100000:2.0:1787826390.450703:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0225b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+87:2400:x1874668789909888:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 484us (685us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826390.450712:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3461 00000100:00100000:0.0:1787826390.451241:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789909760 00000100:00100000:0.0:1787826390.451248:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789909760 00000100:00100000:0.0:1787826390.451286:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6358 00000100:00100000:0.0:1787826390.451295:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2399:x1874668789909760:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.451307:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.451322:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc68d expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826390.451344:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826390.451360:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=3028s v=(0 0) 00010000:00010000:0.0:1787826390.451365:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.451374:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc68d expref: 19 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.451390:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc68d expref: 19 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.451401:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:0.0:1787826390.451433:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2399:x1874668789909760:12345-192.168.203.9@tcp:101:cp.0 Request processed in 140us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.451439:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6358 00000100:00100000:2.0:1787826390.457488:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.457564:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789910016 00000100:00100000:0.0:1787826390.457573:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789910016 00000100:00100000:0.0:1787826390.457622:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6359 00000100:00100000:0.0:1787826390.457631:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+19:86693:x1874668789910016:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.457647:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.457662:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc6cc expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.457835:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc68d expref: 20 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.457845:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.457933:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.457941:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 20 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.457973:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc68d expref: 20 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.457986:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc68d expref: 20 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.458001:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778690176:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826390.458112:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826390.462505:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.463254:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778690176:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826390.463269:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789910144 00000100:00100000:1.0:1787826390.463281:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789910144 00010000:00010000:2.0:1787826390.463290:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 21 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.463312:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00010000:00010000:1.0:1787826390.463318:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc68d expref: 21 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826390.463409:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3121 00000100:00100000:1.0:1787826390.463422:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789910144:12345-192.168.203.9@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787826390.463429:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+21:86693:x1874668789910016:12345-192.168.203.9@tcp:101:cp.0 Request processed in 5795us (5947us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826390.463440:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826390.463440:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6359 00010000:00010000:1.0:1787826390.463465:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc68d expref: 20 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.463479:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc68d expref: 20 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.463502:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e22f34f/0x68019081f349c97c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc68d expref: 20 pid: 45681 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.463517:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.463522:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.463530:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.463540:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.463573:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826390.463585:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778690304:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826390.463635:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a7cf840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826390.468992:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.469055:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789910400 00000100:00100000:2.0:1787826390.469064:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789910400 00000100:00100000:0.0:1787826390.469103:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1874668778690304:192.168.203.9@tcp:105: 00010000:00010000:0.0:1787826390.469126:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826390.469132:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2743 00000100:00100000:2.0:1787826390.469143:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+87:86693:x1874668789910400:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826390.469186:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2401:x1874668789910144:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5766us (6689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.469200:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3121 00000100:00100000:2.0:1787826390.469404:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+88:86693:x1874668789910400:12345-192.168.203.9@tcp:35:cp.0 Request processed in 263us (420us total) trans 8590016748 rc 0/0 00000100:00100000:2.0:1787826390.469411:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2743 00000100:00100000:0.0:1787826390.493704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.493806:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789910528 00000100:00100000:3.0:1787826390.493816:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789910528 00000100:00100000:3.0:1787826390.493907:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3462 00000100:00100000:2.0:1787826390.493947:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+88:2399:x1874668789910528:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826390.494005:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.494025:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c98a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc6d3 expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494080:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494095:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494106:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494120:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494126:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494134:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494172:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494179:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494187:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494193:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.494197:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494203:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494215:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.494219:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.494222:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494229:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c991 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494242:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494248:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494254:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494259:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.494262:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494269:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494276:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826390.494278:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.494281:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494286:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c998 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494314:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c98a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6d3 expref: 89 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494324:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.494326:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826390.494330:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c98a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6d3 expref: 89 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.494339:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc -2) 00000100:00100000:2.0:1787826390.494410:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+88:2399:x1874668789910528:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 494us (713us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826390.494421:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3462 00000100:00100000:1.0:1787826390.512126:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.512177:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789910656 00000100:00100000:2.0:1787826390.512195:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789910656 00000100:00100000:2.0:1787826390.512259:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111746 00000100:00100000:2.0:1787826390.512274:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+30:86700:x1874668789910656:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826390.512293:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.512313:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c99f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc70b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512377:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512390:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512401:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512416:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512423:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512429:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512467:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512478:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512483:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512489:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512494:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.512498:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512505:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512515:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.512518:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.512523:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512529:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512542:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512548:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512554:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512560:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.512562:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512567:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512573:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826390.512575:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.512578:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512583:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9ad lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512614:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c99f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc70b expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512623:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.512625:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.512629:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c99f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc70b expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.512638:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:2.0:1787826390.512713:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+30:86700:x1874668789910656:12345-192.168.203.9@tcp:101:bash.0 Request processed in 440us (597us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826390.512720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111746 00000100:00100000:1.0:1787826390.548659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.548705:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.548800:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789910912 00000100:00100000:2.0:1787826390.548811:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789910912 00000100:00100000:2.0:1787826390.548908:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3463 00000100:00100000:2.0:1787826390.548919:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+88:2400:x1874668789910912:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826390.548957:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.548978:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c9b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc719 expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549034:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549049:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549061:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549075:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549082:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549089:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549127:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549135:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549142:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549149:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.549154:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549161:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549173:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.549176:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.549181:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549188:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349c9bb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549201:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549207:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549213:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549219:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.549221:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549226:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549238:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x747be2b2 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826390.549241:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.549243:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549248:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349c9c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549279:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c9b4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc719 expref: 89 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549290:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.549293:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826390.549297:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349c9b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc719 expref: 89 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.549301:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789910784 00000100:00100000:0.0:1787826390.549307:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789910784 00010000:00010000:2.0:1787826390.549310:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc -2) 00000100:00100000:0.0:1787826390.549357:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111747 00000100:00100000:0.0:1787826390.549365:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+89:86701:x1874668789910784:12345-192.168.203.9@tcp:101:rm.0 00000100:00100000:2.0:1787826390.549372:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+89:2400:x1874668789910912:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 452us (664us total) trans 0 rc -2/-2 00010000:00010000:0.0:1787826390.549381:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787826390.549382:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3463 00010000:00010000:0.0:1787826390.549395:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c9c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc712 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549431:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549440:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549447:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549458:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549465:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549472:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549493:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549502:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549508:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549513:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549518:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.549521:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549527:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549535:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.549538:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.549542:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549549:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349c9d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549561:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549567:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549574:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549581:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.549584:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549589:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549596:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbf41389200) 00010000:00010000:0.0:1787826390.549598:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.549600:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549606:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349c9d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549625:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c9c9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc712 expref: 89 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549633:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.549635:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.549638:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349c9c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc712 expref: 89 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.549646:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2200, rc 0) 00000100:00100000:0.0:1787826390.549688:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+88:86701:x1874668789910784:12345-192.168.203.9@tcp:101:rm.0 Request processed in 324us (1039us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.549696:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111747 00000100:00100000:1.0:1787826390.553811:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.554180:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789911040 00000100:00100000:3.0:1787826390.554199:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789911040 00000100:00100000:3.0:1787826390.554262:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111748 00000100:00100000:3.0:1787826390.554272:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+88:86701:x1874668789911040:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:3.0:1787826390.554291:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.554313:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c9de lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc720 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554380:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554394:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554407:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554421:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554428:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554434:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554474:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554481:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554487:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554493:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554499:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.554503:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554510:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554521:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.554525:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.554529:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554535:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349c9e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554548:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554554:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554559:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554564:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.554566:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554571:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554578:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbe08124b00) 00010000:00010000:3.0:1787826390.554580:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.554583:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554587:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9ec lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554618:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c9de lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc720 expref: 89 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554628:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.554631:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.554634:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c9de lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc720 expref: 89 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.554643:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826390.554718:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+88:86701:x1874668789911040:12345-192.168.203.9@tcp:101:rm.0 Request processed in 447us (916us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826390.554726:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111748 00000100:00100000:1.0:1787826390.581324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.581787:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789911168 00000100:00100000:2.0:1787826390.581805:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789911168 00000100:00100000:2.0:1787826390.581906:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111749 00000100:00100000:2.0:1787826390.581915:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+88:86702:x1874668789911168:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826390.581935:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.582153:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c9f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc727 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582218:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582232:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582242:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582256:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582263:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582269:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582305:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582312:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582318:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582324:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.582327:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582334:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582345:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.582348:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.582352:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582357:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349c9fa lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582370:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582375:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582380:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582386:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.582389:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582395:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582402:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbe08124b00) 00010000:00010000:3.0:1787826390.582404:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.582407:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582412:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca01 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582443:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c9f3 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc727 expref: 89 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582453:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.582456:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.582461:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349c9f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc727 expref: 89 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.582469:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826390.582536:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+88:86702:x1874668789911168:12345-192.168.203.9@tcp:101:cp.0 Request processed in 623us (1221us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826390.582543:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111749 00000100:00100000:0.0:1787826390.588142:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.588257:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789911296 00000100:00100000:1.0:1787826390.588267:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789911296 00000100:00100000:1.0:1787826390.588331:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111750 00000100:00100000:1.0:1787826390.588342:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+88:86702:x1874668789911296:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.588361:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.588383:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ca08 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc72e expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588445:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588459:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588469:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588485:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588491:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588498:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588538:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588545:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588551:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588559:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588565:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.588569:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588576:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588588:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.588591:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.588600:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588607:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349ca0f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588619:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588625:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588631:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588636:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.588639:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588644:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588651:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbe12458c00) 00010000:00010000:1.0:1787826390.588653:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.588656:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.588662:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349ca16 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.589489:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ca08 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc72e expref: 89 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.589507:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.589510:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.589514:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349ca08 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc72e expref: 89 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.589536:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:1.0:1787826390.589608:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+88:86702:x1874668789911296:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1267us (1474us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.589615:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111750 00000100:00100000:2.0:1787826390.597452:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.597935:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789911552 00000100:00100000:0.0:1787826390.597944:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789911552 00000100:00100000:0.0:1787826390.598006:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111751 00000100:00100000:0.0:1787826390.598016:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+88:86702:x1874668789911552:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.598038:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.599161:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349ca1d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc735 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599278:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599293:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599304:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599320:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599328:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599335:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.599619:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xd1:0x0], index 1: 0 00010000:00010000:0.0:1787826390.599762:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349ca32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x143:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599771:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349ca32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599778:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349ca32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599823:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599839:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599846:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599879:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599885:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.599890:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599897:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599909:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.599912:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.599917:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599924:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3000/0x68019081f349ca24 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.599938:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4250b1c reply state 00000000c0a0a2e4 transno 8590016749 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599950:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599956:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbf41389200) 00010000:00010000:0.0:1787826390.599959:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.599961:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826390.601355:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2200/0x68019081f349ca1d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc735 expref: 91 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.601380:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202400/0x68019081f349ca32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc735 expref: 90 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.601391:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x143:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:0.0:1787826390.601393:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826390.601396:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202400, rc 0) 00000100:00100000:0.0:1787826390.601556:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+91:86702:x1874668789911552:12345-192.168.203.9@tcp:101:cp.0 Request processed in 3539us (4111us total) trans 8590016749 rc 0/0 00000100:00100000:0.0:1787826390.601566:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111751 00000100:00100000:2.0:1787826390.606128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.606276:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789911680 00000100:00100000:1.0:1787826390.606286:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789911680 00000100:00100000:1.0:1787826390.606342:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6360 00000100:00100000:1.0:1787826390.606352:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+15:2402:x1874668789911680:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.606371:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.606392:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc73c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826390.606416:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826390.606434:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=3028s v=(0 0) 00010000:00010000:1.0:1787826390.606503:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.606514:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc73c expref: 16 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.606532:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc73c expref: 16 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.606551:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:1.0:1787826390.606656:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2402:x1874668789911680:12345-192.168.203.9@tcp:101:cp.0 Request processed in 305us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.606664:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6360 00000100:00100000:0.0:1787826390.612938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.614672:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789911808 00000100:00100000:1.0:1787826390.614686:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789911808 00000100:00100000:1.0:1787826390.615108:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6361 00000100:00100000:1.0:1787826390.615120:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:86702:x1874668789911808:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.615138:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.615158:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc743 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.615200:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc73c expref: 17 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.615209:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.615214:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.615219:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 17 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.615254:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc73c expref: 17 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.615268:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc73c expref: 17 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826390.615282:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a116940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778690432:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826390.615384:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a7cf840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826390.618642:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a116940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778690432:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826390.618692:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 17 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.618712:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:1.0:1787826390.618781:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+17:86702:x1874668789911808:12345-192.168.203.9@tcp:101:cp.0 Request processed in 3662us (5932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.618798:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6361 00000100:00100000:2.0:1787826390.621804:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.622230:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789911936 00000100:00100000:3.0:1787826390.622241:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789911936 00010000:00010000:3.0:1787826390.622283:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc73c expref: 17 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826390.622326:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3122 00000100:00100000:3.0:1787826390.622336:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2401:x1874668789911936:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826390.622352:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826390.622373:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc73c expref: 17 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.622388:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc73c expref: 17 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.622411:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ca40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc73c expref: 17 pid: 8432 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.622427:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.622431:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.622448:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.622458:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.622492:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 16 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826390.622510:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc79a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778690560:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826390.622592:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826390.636612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.636974:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc79a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15760:1874668778690560:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826390.636997:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826390.637058:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789911936:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 14722us (15271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.637069:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3122 00000100:00100000:0.0:1787826390.640229:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789912192 00000100:00100000:0.0:1787826390.640246:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789912192 00000100:00100000:0.0:1787826390.640329:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2744 00000100:00100000:0.0:1787826390.640339:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+91:86702:x1874668789912192:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826390.640624:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86702:x1874668789912192:12345-192.168.203.9@tcp:35:cp.0 Request processed in 286us (4022us total) trans 8590016750 rc 0/0 00000100:00100000:0.0:1787826390.640632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2744 00000100:00100000:2.0:1787826390.694412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.694504:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789912320 00000100:00100000:0.0:1787826390.694513:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789912320 00000100:00100000:0.0:1787826390.694573:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111752 00000100:00100000:0.0:1787826390.694582:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+30:86705:x1874668789912320:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826390.694601:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.694620:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349ca4e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc74a expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694687:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694701:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694711:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694724:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694730:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694735:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694773:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694779:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694801:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694808:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694813:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.694817:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694824:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694835:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.694837:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.694843:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694849:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349ca55 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694902:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694908:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694914:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694919:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.694923:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694928:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694936:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x61bf1dfb (ffff9bbf41389900) 00010000:00010000:0.0:1787826390.694938:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.694942:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694947:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349ca5c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694988:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349ca4e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc74a expref: 31 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694999:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.695001:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.695005:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349ca4e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc74a expref: 31 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.695014:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205600, rc 0) 00000100:00100000:0.0:1787826390.695085:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+30:86705:x1874668789912320:12345-192.168.203.9@tcp:101:bash.0 Request processed in 503us (682us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.695094:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111752 00000100:00100000:2.0:1787826390.704394:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.704454:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.704527:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789912576 00000100:00100000:0.0:1787826390.704538:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789912576 00000100:00100000:0.0:1787826390.704595:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3464 00000100:00100000:0.0:1787826390.704605:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+92:2400:x1874668789912576:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826390.704648:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.704671:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349ca63 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc758 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704730:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704745:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704757:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704771:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704778:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704783:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704835:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704842:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704847:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704892:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.704897:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704904:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704916:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.704919:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.704924:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704930:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349ca6a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704945:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704951:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704957:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704962:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.704966:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704981:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.704989:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x747be2b2 (ffff9bbf41389700) 00010000:00010000:0.0:1787826390.704992:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.704995:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.705000:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349ca71 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.705031:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349ca63 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc758 expref: 93 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.705042:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.705045:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.705049:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349ca63 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc758 expref: 93 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.705058:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204800, rc -2) 00000100:00100000:0.0:1787826390.705124:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+92:2400:x1874668789912576:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 520us (669us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826390.705133:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3464 00000100:00100000:3.0:1787826390.705448:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789912448 00000100:00100000:3.0:1787826390.705454:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789912448 00000100:00100000:3.0:1787826390.705500:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111753 00000100:00100000:3.0:1787826390.705509:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86706:x1874668789912448:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:3.0:1787826390.705521:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.705535:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ca78 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc751 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705572:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705581:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705589:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705602:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705614:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705621:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705643:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705651:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705657:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705663:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705669:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.705672:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705749:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705759:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.705762:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.705765:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705771:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349ca7f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705782:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705797:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705803:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705808:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.705810:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705815:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705822:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x61bf1dfb (ffff9bbe08124b00) 00010000:00010000:3.0:1787826390.705824:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.705827:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705832:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349ca86 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705879:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ca78 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc751 expref: 93 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705889:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.705892:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.705896:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349ca78 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc751 expref: 93 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.705905:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826390.705943:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86706:x1874668789912448:12345-192.168.203.9@tcp:101:rm.0 Request processed in 436us (1563us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826390.705950:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111753 00000100:00100000:2.0:1787826390.714400:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.714482:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789912704 00000100:00100000:3.0:1787826390.714491:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789912704 00000100:00100000:3.0:1787826390.714552:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111754 00000100:00100000:3.0:1787826390.714563:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86706:x1874668789912704:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:3.0:1787826390.714582:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.714604:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349ca8d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc75f expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714669:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714683:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714693:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714727:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714735:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714742:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714779:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714786:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714802:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714808:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.714813:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714820:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714831:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.714835:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.714839:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714845:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349ca94 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714904:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714910:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714915:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714921:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.714923:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714929:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714936:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x61bf1dfb (ffff9bbe08124700) 00010000:00010000:3.0:1787826390.714939:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.714942:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.714947:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349ca9b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.715152:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349ca8d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc75f expref: 93 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.715164:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.715166:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.715170:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349ca8d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc75f expref: 93 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.715179:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826390.715278:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86706:x1874668789912704:12345-192.168.203.9@tcp:101:rm.0 Request processed in 716us (886us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826390.715286:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111754 00000100:00100000:2.0:1787826390.742964:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.743142:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789912832 00000100:00100000:1.0:1787826390.743153:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789912832 00000100:00100000:1.0:1787826390.743224:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111755 00000100:00100000:1.0:1787826390.743234:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86707:x1874668789912832:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.743255:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.743276:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349caa2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc766 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743347:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743362:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743373:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743391:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743398:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743404:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743443:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743449:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743456:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743462:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.743465:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743472:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743482:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.743484:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.743489:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743494:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349caa9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743506:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743512:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743517:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743522:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.743524:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743528:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743534:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x61bf1dfb (ffff9bbe16e56f00) 00010000:00010000:1.0:1787826390.743536:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.743539:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743545:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349cab0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743579:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349caa2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc766 expref: 93 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743589:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.743592:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.743595:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349caa2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc766 expref: 93 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.743604:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:1.0:1787826390.743668:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86707:x1874668789912832:12345-192.168.203.9@tcp:101:cp.0 Request processed in 435us (716us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.743675:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111755 00000100:00100000:1.0:1787826390.747276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826390.747402:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789912960 00000100:00100000:2.0:1787826390.747411:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789912960 00000100:00100000:2.0:1787826390.747466:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111756 00000100:00100000:2.0:1787826390.747474:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86707:x1874668789912960:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826390.747494:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.747516:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349cab7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc76d expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747594:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747608:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747618:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747631:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747637:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747643:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747678:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747684:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747691:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747696:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.747700:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747707:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747718:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.747721:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.747726:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747731:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cabe lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747745:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747751:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747756:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747761:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826390.747764:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747769:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747775:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x61bf1dfb (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826390.747778:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.747780:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747785:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cac5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747828:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349cab7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc76d expref: 93 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747838:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826390.747841:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.747844:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349cab7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc76d expref: 93 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.747885:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826390.747955:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86707:x1874668789912960:12345-192.168.203.9@tcp:101:cp.0 Request processed in 481us (688us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826390.747962:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111756 00000100:00100000:2.0:1787826390.751272:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.751355:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789913216 00000100:00100000:1.0:1787826390.751366:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789913216 00000100:00100000:1.0:1787826390.751418:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111757 00000100:00100000:1.0:1787826390.751428:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+92:86707:x1874668789913216:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.751448:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.751471:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349cacc lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc774 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.751571:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.751585:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.751595:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.751608:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.751615:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.751624:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.751994:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd1:0x0], index 0: 0 00010000:00010000:1.0:1787826390.752147:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f349cae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x144:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752158:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f349cae1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752164:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f349cae1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752198:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752204:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752210:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752216:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752222:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.752226:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752234:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752251:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.752254:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.752259:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752265:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349cad3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.752280:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058a2a2d3 reply state 000000007427306a transno 8590016751 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752290:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752297:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x61bf1dfb (ffff9bbe16e56e00) 00010000:00010000:1.0:1787826390.752299:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.752302:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.752330:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349cacc lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc774 expref: 95 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752343:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d400/0x68019081f349cae1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc774 expref: 94 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.752349:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x144:0x0].0x0 (ffff9bbe16e56100) 00010000:00010000:1.0:1787826390.752352:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.752354:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d400, rc 0) 00000100:00100000:1.0:1787826390.752419:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+95:86707:x1874668789913216:12345-192.168.203.9@tcp:101:cp.0 Request processed in 992us (1156us total) trans 8590016751 rc 0/0 00000100:00100000:1.0:1787826390.752426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111757 00000100:00100000:3.0:1787826390.762310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.762450:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789913344 00000100:00100000:0.0:1787826390.762459:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789913344 00000100:00100000:0.0:1787826390.762514:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6362 00000100:00100000:0.0:1787826390.762523:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2401:x1874668789913344:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.762540:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.762557:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc77b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826390.762580:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826390.762596:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=3028s v=(0 0) 00010000:00010000:0.0:1787826390.762602:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.762609:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc77b expref: 20 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762624:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc77b expref: 20 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762637:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204800, rc 0) 00000100:00100000:0.0:1787826390.762897:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2401:x1874668789913344:12345-192.168.203.9@tcp:101:cp.0 Request processed in 373us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.762905:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6362 00000100:00100000:2.0:1787826390.766436:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.766528:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789913472 00000100:00100000:0.0:1787826390.766537:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789913472 00000100:00100000:0.0:1787826390.766637:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6363 00000100:00100000:0.0:1787826390.766647:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+20:86707:x1874668789913472:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.766663:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.766690:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc782 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.766720:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc77b expref: 21 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.766730:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.766735:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.766740:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 21 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.766775:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc77b expref: 21 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.766797:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc77b expref: 21 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.766811:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778690688:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826390.768431:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826390.771631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.771707:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789913600 00000100:00100000:3.0:1787826390.771716:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789913600 00010000:00010000:3.0:1787826390.771758:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc77b expref: 22 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826390.771813:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3123 00000100:00100000:3.0:1787826390.771823:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2402:x1874668789913600:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826390.771840:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826390.771890:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc77b expref: 22 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.771905:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc77b expref: 22 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.771931:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.771936:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.771944:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 22 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.771955:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 22 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.771995:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 22 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826390.772009:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778690816:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826390.772085:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170840 going to sleep for 11 seconds 00010000:00010000:0.0:1787826390.772713:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349caef lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc77b expref: 22 pid: 8430 timeout: 3128 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.772731:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778690688:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826390.772755:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 21 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.772766:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205200, rc 0) 00000100:00100000:0.0:1787826390.772828:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+21:86707:x1874668789913472:12345-192.168.203.9@tcp:101:cp.0 Request processed in 6182us (6402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.772837:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6363 00000100:00100000:3.0:1787826390.776201:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9521:1874668778690816:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826390.776230:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826390.776294:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2402:x1874668789913600:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4472us (4671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.776306:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3123 00000100:00100000:2.0:1787826390.787640:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.787773:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789913856 00000100:00100000:3.0:1787826390.787782:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789913856 00000100:00100000:3.0:1787826390.787892:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2745 00000100:00100000:3.0:1787826390.787903:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+95:86707:x1874668789913856:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:3.0:1787826390.788237:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86707:x1874668789913856:12345-192.168.203.9@tcp:35:cp.0 Request processed in 334us (606us total) trans 8590016752 rc 0/0 00000100:00100000:3.0:1787826390.788246:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2745 00000100:00100000:2.0:1787826390.820150:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.820211:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789913984 00000100:00100000:3.0:1787826390.820221:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789913984 00000100:00100000:3.0:1787826390.820284:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111758 00000100:00100000:3.0:1787826390.820294:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+30:86710:x1874668789913984:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1787826390.820314:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.820336:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cafd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc789 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820403:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820419:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820434:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820449:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820456:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820463:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820501:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820508:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820514:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820520:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820533:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.820537:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820544:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820556:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.820560:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.820564:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820572:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb04 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820584:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820589:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820594:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820598:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.820601:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820608:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820615:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa5ec40c9 (ffff9bbe08124700) 00010000:00010000:3.0:1787826390.820618:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.820620:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820625:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb0b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820656:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cafd lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc789 expref: 31 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820679:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.820682:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.820686:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cafd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc789 expref: 31 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.820696:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826390.820760:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+30:86710:x1874668789913984:12345-192.168.203.9@tcp:101:bash.0 Request processed in 467us (619us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826390.820767:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111758 00000100:00100000:1.0:1787826390.837390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.837594:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789914112 00000100:00100000:0.0:1787826390.837604:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789914112 00000100:00100000:0.0:1787826390.837707:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111759 00000100:00100000:0.0:1787826390.837718:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86711:x1874668789914112:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826390.837747:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.837769:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349cb12 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc790 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837889:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837904:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837914:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837928:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837934:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837940:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837978:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837985:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837991:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.837997:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.838001:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838008:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838020:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.838023:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.838027:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838034:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb19 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838049:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838055:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838060:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838065:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.838068:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838074:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838081:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa5ec40c9 (ffff9bbf41389600) 00010000:00010000:0.0:1787826390.838083:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.838087:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838092:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb20 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838122:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349cb12 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc790 expref: 97 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838132:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.838134:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.838138:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349cb12 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc790 expref: 97 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.838147:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204800, rc 0) 00000100:00100000:0.0:1787826390.838211:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86711:x1874668789914112:12345-192.168.203.9@tcp:101:rm.0 Request processed in 495us (831us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.838219:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111759 00000100:00100000:0.0:1787826390.850340:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826390.850364:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778690944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826390.850431:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826390.853768:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826390.853810:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778691072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826390.853922:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826390.854095:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778690944 00000100:00100000:1.0:1787826390.854102:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778690944 00000100:00100000:1.0:1787826390.854144:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778691072 00000100:00100000:1.0:1787826390.854148:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778691072 00000100:00100000:1.0:1787826390.854168:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3465 00000100:00100000:1.0:1787826390.854175:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778690944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826390.854209:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440518144 avail 1294278656 00000100:00100000:1.0:1787826390.854258:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778690944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (3828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.854266:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3465 00000100:00100000:1.0:1787826390.854283:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3466 00000100:00100000:1.0:1787826390.854289:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778691072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826390.854304:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1787826390.854335:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778691072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.854341:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3466 00000100:00100000:1.0:1787826390.854381:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778691072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826390.854587:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778690944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826390.858763:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.863323:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789914240 00000100:00100000:1.0:1787826390.863337:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789914240 00000100:00100000:1.0:1787826390.863398:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111760 00000100:00100000:1.0:1787826390.863408:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86711:x1874668789914240:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826390.863427:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.863447:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cb27 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc797 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863545:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863561:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863572:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863586:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863594:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863600:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863637:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863644:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863651:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863657:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.863661:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863684:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863697:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.863700:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.863704:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863710:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb2e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863723:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863728:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863734:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863739:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.863742:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863748:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863755:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa5ec40c9 (ffff9bbe16e56f00) 00010000:00010000:1.0:1787826390.863757:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.863760:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863766:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb35 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863810:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cb27 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc797 expref: 97 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863820:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.863822:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.863826:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cb27 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc797 expref: 97 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.863835:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826390.863926:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86711:x1874668789914240:12345-192.168.203.9@tcp:101:rm.0 Request processed in 519us (5174us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.863933:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111760 00000100:00100000:2.0:1787826390.903906:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.904118:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789914368 00000100:00100000:1.0:1787826390.904128:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789914368 00000100:00100000:1.0:1787826390.904199:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111761 00000100:00100000:1.0:1787826390.904211:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86712:x1874668789914368:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.904232:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.904254:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cb3c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc79e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904316:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904330:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904343:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904356:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904363:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904369:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904407:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904414:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904420:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904426:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904431:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.904435:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904441:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904451:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.904454:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.904459:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904465:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cb43 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904477:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904482:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904487:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904508:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826390.904510:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904517:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904524:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa5ec40c9 (ffff9bbe16e56f00) 00010000:00010000:1.0:1787826390.904527:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.904530:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904535:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349cb4a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904568:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cb3c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc79e expref: 97 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904578:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826390.904581:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.904584:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cb3c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc79e expref: 97 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.904837:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826390.904941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86712:x1874668789914368:12345-192.168.203.9@tcp:101:cp.0 Request processed in 732us (1092us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826390.904949:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111761 00010000:00010000:3.0:1787826390.912601:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826390.913648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.920218:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789914496 00000100:00100000:0.0:1787826390.920232:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789914496 00000100:00100000:0.0:1787826390.920297:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111762 00000100:00100000:0.0:1787826390.920306:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86712:x1874668789914496:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.920326:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.920347:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349cb51 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7a5 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920411:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920427:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920438:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920453:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920460:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920467:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920516:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920524:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920531:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920538:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920544:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.920549:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920557:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920570:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.920573:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.920578:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920585:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cb58 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920892:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920900:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920906:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920911:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826390.920914:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920920:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920940:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa5ec40c9 (ffff9bbf41389600) 00010000:00010000:0.0:1787826390.920943:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.920947:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920953:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cb5f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920985:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349cb51 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7a5 expref: 97 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.920996:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826390.920998:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.921002:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349cb51 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7a5 expref: 97 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.921011:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204800, rc 0) 00000100:00100000:0.0:1787826390.921082:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86712:x1874668789914496:12345-192.168.203.9@tcp:101:cp.0 Request processed in 776us (7441us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826390.921090:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111762 00000100:00100000:2.0:1787826390.929237:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.929322:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789914752 00000100:00100000:3.0:1787826390.929332:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789914752 00000100:00100000:3.0:1787826390.929393:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111763 00000100:00100000:3.0:1787826390.929404:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+96:86712:x1874668789914752:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826390.929424:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.929444:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cb66 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7ac expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.929554:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.929568:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.929578:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930113:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930123:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930131:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826390.930533:0:12105:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xd2:0x0], index 1: 0 00010000:00010000:3.0:1787826390.930890:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349cb7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x145:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930902:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349cb7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930910:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349cb7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930957:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930965:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930972:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930979:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930985:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826390.930989:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.930996:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.931007:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826390.931011:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.931015:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.931021:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb6d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826390.931035:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbcd357d reply state 0000000063601d07 transno 8590016753 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.931045:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.931053:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa5ec40c9 (ffff9bbe08124b00) 00010000:00010000:3.0:1787826390.931055:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826390.931057:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826390.931090:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cb66 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ac expref: 99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.931104:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607600/0x68019081f349cb7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ac expref: 98 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.931111:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x145:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:3.0:1787826390.931113:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826390.931116:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607600, rc 0) 00000100:00100000:3.0:1787826390.931241:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+99:86712:x1874668789914752:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1838us (2014us total) trans 8590016753 rc 0/0 00000100:00100000:3.0:1787826390.931249:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111763 00000100:00100000:2.0:1787826390.933294:0:38205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ecb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:38205:1874668778691200:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787826390.933364:0:38205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826390.933424:0:38205:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826390.933509:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778691200 00000100:00100000:3.0:1787826390.933517:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778691200 00000100:00100000:3.0:1787826390.933584:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6364 00000100:00100000:3.0:1787826390.933605:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:38205:x1874668778691200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787826390.933647:0:8605:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 226 00000100:00080000:2.0:1787826390.934753:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826390.941879:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826390.942068:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789914880 00000100:00100000:1.0:1787826390.942077:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789914880 00000100:00100000:1.0:1787826390.942127:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6365 00000100:00100000:1.0:1787826390.942137:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+16:2401:x1874668789914880:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826390.942154:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.942175:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7b3 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826390.942198:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826390.942217:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=3029s v=(0 0) 00010000:00010000:1.0:1787826390.942221:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826390.942231:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7b3 expref: 17 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.942248:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7b3 expref: 17 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.942268:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c400, rc 0) 00000100:00100000:1.0:1787826390.942328:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2401:x1874668789914880:12345-192.168.203.9@tcp:101:cp.0 Request processed in 192us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.942335:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6365 00000100:00100000:3.0:1787826390.944469:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:38205:x1874668778691200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10861us (11097us total) trans 4294968186 rc 0/0 00000100:00100000:3.0:1787826390.944481:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6364 00000100:00100000:2.0:1787826390.945065:0:38205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ecb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:38205:1874668778691200:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787826390.945081:0:38205:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xd2:0x0]-[0x2c0000401:0x101:0x0] 00000100:00100000:1.0:1787826390.947344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.947444:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789915008 00000100:00100000:0.0:1787826390.947452:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789915008 00000100:00100000:0.0:1787826390.947518:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6366 00000100:00100000:0.0:1787826390.947528:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+17:86712:x1874668789915008:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826390.947548:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.947567:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7ba expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.947612:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7b3 expref: 18 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.947627:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.947632:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826390.947638:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 18 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.947803:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7b3 expref: 18 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.947818:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7b3 expref: 18 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.947833:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778691328:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826390.947984:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd09180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826390.950249:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778691328:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826390.950285:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 18 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.950305:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204800, rc 0) 00000100:00100000:0.0:1787826390.950363:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+18:86712:x1874668789915008:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2835us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.950372:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6366 00000100:00100000:2.0:1787826390.954341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826390.955041:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789915136 00000100:00100000:3.0:1787826390.955053:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789915136 00010000:00010000:3.0:1787826390.955100:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7b3 expref: 18 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826390.955147:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3124 00000100:00100000:3.0:1787826390.955157:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789915136:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826390.955173:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826390.955194:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7b3 expref: 18 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.955209:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7b3 expref: 18 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.955230:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006af0812e/0x68019081f349cb89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7b3 expref: 18 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.955249:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.955252:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826390.955260:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 17 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.955269:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 17 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.955304:0:45686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 17 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826390.955318:0:45686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc79680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778691456:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826390.955403:0:45686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826390.962258:0:45686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc79680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:45686:1874668778691456:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826390.962286:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826390.962348:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789915136:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 7192us (8015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.962359:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3124 00000100:00100000:2.0:1787826390.967453:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826390.967541:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789915392 00000100:00100000:0.0:1787826390.967550:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789915392 00000100:00100000:0.0:1787826390.967618:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2746 00000100:00100000:0.0:1787826390.967629:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+99:86712:x1874668789915392:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826390.968175:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86712:x1874668789915392:12345-192.168.203.9@tcp:35:cp.0 Request processed in 545us (728us total) trans 8590016754 rc 0/0 00000100:00100000:0.0:1787826390.968183:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2746 00000100:00100000:2.0:1787826391.002454:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.002540:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789915520 00000100:00100000:3.0:1787826391.002549:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789915520 00000100:00100000:3.0:1787826391.002621:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111764 00000100:00100000:3.0:1787826391.002632:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+30:86715:x1874668789915520:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1787826391.002651:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.002670:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cb97 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7c1 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.002741:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.002755:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.002766:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.002780:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.002799:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.002805:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.002849:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787826391.003068:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826391.003111:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003118:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003123:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.003127:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003139:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003154:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.003157:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.003162:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003167:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cb9e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003181:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003188:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003194:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003198:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.003201:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003207:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003214:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826391.003216:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.003219:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003224:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cba5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003260:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cb97 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7c1 expref: 31 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003271:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.003273:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.003277:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cb97 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7c1 expref: 31 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.003286:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826391.003351:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+30:86715:x1874668789915520:12345-192.168.203.9@tcp:101:bash.0 Request processed in 722us (905us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.003359:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111764 00000100:00100000:1.0:1787826391.017771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.017922:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789915648 00000100:00100000:2.0:1787826391.017932:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789915648 00000100:00100000:2.0:1787826391.018011:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111765 00000100:00100000:2.0:1787826391.018022:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86716:x1874668789915648:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826391.018045:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.018064:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cbac lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7c8 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018130:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018147:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018157:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018170:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018176:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018193:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018230:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018236:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018242:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018248:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.018252:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018259:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018270:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.018273:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.018278:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018284:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349cbb3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018299:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018304:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018309:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018313:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.018316:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018321:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018327:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826391.018329:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.018331:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018336:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cbba lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018367:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cbac lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7c8 expref: 101 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018376:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.018379:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.018382:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cbac lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7c8 expref: 101 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.018390:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:2.0:1787826391.018450:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86716:x1874668789915648:12345-192.168.203.9@tcp:101:rm.0 Request processed in 430us (689us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826391.018458:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111765 00000100:00080000:0.0:1787826391.019057:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826391.024589:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.024951:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789915776 00000100:00100000:1.0:1787826391.024962:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789915776 00000100:00100000:1.0:1787826391.025022:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111766 00000100:00100000:1.0:1787826391.025033:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86716:x1874668789915776:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826391.025052:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.025072:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cbc1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7cf expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025134:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025148:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025158:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025172:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025179:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025186:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025223:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025230:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025237:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025242:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.025246:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025253:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025265:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.025268:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.025271:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025276:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025288:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025294:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025299:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025303:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993ce00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.025305:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025311:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025317:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbe16e56900) 00010000:00010000:1.0:1787826391.025320:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.025322:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025328:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbcf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025360:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cbc1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7cf expref: 101 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025370:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.025373:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.025376:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cbc1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7cf expref: 101 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.025385:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d000, rc 0) 00000100:00100000:1.0:1787826391.025458:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41277840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86716:x1874668789915776:12345-192.168.203.9@tcp:101:rm.0 Request processed in 427us (877us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826391.025468:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111766 00000100:00100000:1.0:1787826391.061231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.061472:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789915904 00000100:00100000:3.0:1787826391.061482:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789915904 00000100:00100000:3.0:1787826391.061549:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111767 00000100:00100000:3.0:1787826391.061559:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86717:x1874668789915904:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826391.061578:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.061599:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cbd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7d6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061665:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061689:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061710:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061726:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061733:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061739:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061777:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061794:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061800:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061807:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061812:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.061816:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061824:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061836:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.061839:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.061843:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061849:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cbdd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061888:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061895:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061900:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061904:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.061907:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061912:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061919:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826391.061921:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.061924:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061929:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cbe4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061962:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cbd6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7d6 expref: 101 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061973:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.061975:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.061978:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cbd6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7d6 expref: 101 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.061987:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826391.062064:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86717:x1874668789915904:12345-192.168.203.9@tcp:101:cp.0 Request processed in 505us (842us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.062072:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111767 00000100:00100000:3.0:1787826391.069619:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.069967:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789916032 00000100:00100000:1.0:1787826391.069976:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789916032 00000100:00100000:1.0:1787826391.070028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111768 00000100:00100000:1.0:1787826391.070036:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86717:x1874668789916032:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826391.070054:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.070072:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cbeb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7dd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070128:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070141:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070151:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070164:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070171:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070177:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070211:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070219:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070225:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070232:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070237:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993ce00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.070241:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070248:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070258:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.070261:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.070265:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070271:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cbf2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070283:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070289:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070295:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070301:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.070304:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070310:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070316:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbe16e56900) 00010000:00010000:1.0:1787826391.070318:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.070320:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070326:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cbf9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070353:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cbeb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7dd expref: 101 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070363:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.070365:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.070368:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cbeb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7dd expref: 101 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.070376:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d000, rc 0) 00000100:00100000:1.0:1787826391.070436:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86717:x1874668789916032:12345-192.168.203.9@tcp:101:cp.0 Request processed in 400us (826us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826391.070443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111768 00000100:00100000:2.0:1787826391.076965:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.077047:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789916288 00000100:00100000:0.0:1787826391.077056:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789916288 00000100:00100000:0.0:1787826391.077114:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111769 00000100:00100000:0.0:1787826391.077140:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+100:86717:x1874668789916288:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826391.077160:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.077182:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cc00 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7e4 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077286:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077301:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077311:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077324:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077330:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077337:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826391.077640:0:45682:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd2:0x0], index 0: 0 00010000:00010000:0.0:1787826391.077802:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349cc15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x146:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077811:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349cc15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077819:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349cc15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077848:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077892:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077899:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.077905:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826391.077909:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.078002:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.078026:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826391.078029:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826391.078147:0:38203:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf412770c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:38203:1874668778691584:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787826391.078219:0:38203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826391.078269:0:38203:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d180 going to sleep for 11 seconds 00010000:00010000:0.0:1787826391.078317:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.078328:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349cc07 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826391.078344:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095289f18 reply state 000000009d9ae110 transno 8590016755 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.078354:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.078359:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbf41389600) 00010000:00010000:0.0:1787826391.078361:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826391.078364:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826391.078382:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778691584 00000100:00100000:0.0:1787826391.078387:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778691584 00000100:00100000:0.0:1787826391.078441:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6367 00000100:00100000:0.0:1787826391.078449:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:38203:x1874668778691584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787826391.078478:0:8433:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 226 00000100:00080000:2.0:1787826391.079063:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826391.079296:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cc00 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7e4 expref: 103 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.079317:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204a00/0x68019081f349cc15 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7e4 expref: 102 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.079326:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x146:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:1.0:1787826391.079328:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826391.079331:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204a00, rc 0) 00000100:00100000:1.0:1787826391.079397:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+103:86717:x1874668789916288:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2258us (2441us total) trans 8590016755 rc 0/0 00000100:00100000:1.0:1787826391.079404:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111769 00000100:00100000:0.0:1787826391.082207:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:38203:x1874668778691584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3750us (3979us total) trans 4294968201 rc 0/0 00000100:00100000:0.0:1787826391.082218:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6367 00000100:00100000:1.0:1787826391.083341:0:38203:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf412770c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:38203:1874668778691584:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787826391.083357:0:38203:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xd2:0x0]-[0x280000401:0x101:0x0] 00000100:00100000:2.0:1787826391.085932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.086043:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789916416 00000100:00100000:1.0:1787826391.086052:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789916416 00000100:00100000:1.0:1787826391.086133:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6368 00000100:00100000:1.0:1787826391.086143:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2401:x1874668789916416:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826391.086160:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.086182:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7eb expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826391.086207:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826391.086227:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=3029s v=(0 0) 00010000:00010000:1.0:1787826391.086233:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826391.086243:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7eb expref: 21 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.086267:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7eb expref: 21 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.086281:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d000, rc 0) 00000100:00100000:1.0:1787826391.086345:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789916416:12345-192.168.203.9@tcp:101:cp.0 Request processed in 203us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826391.086352:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6368 00000100:00080000:2.0:1787826391.086650:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826391.106021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.106124:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789916544 00000100:00100000:2.0:1787826391.106135:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789916544 00000100:00100000:2.0:1787826391.106198:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6369 00000100:00100000:2.0:1787826391.106208:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+21:86717:x1874668789916544:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826391.106226:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.106242:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7f2 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.106271:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7eb expref: 22 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.106281:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826391.106286:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826391.106292:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 22 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.106321:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7eb expref: 22 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.106334:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7eb expref: 22 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826391.106346:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41275e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778691712:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826391.106435:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826391.110605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.110696:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789916672 00000100:00100000:1.0:1787826391.110705:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789916672 00010000:00010000:1.0:1787826391.110742:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7eb expref: 23 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.110795:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3125 00000100:00100000:1.0:1787826391.110806:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789916672:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826391.110823:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826391.110845:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7eb expref: 23 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.110895:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7eb expref: 23 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.110921:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826391.110925:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826391.110934:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 23 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.110943:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 23 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.110978:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 23 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.110991:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073be1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778691840:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826391.111063:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5240 going to sleep for 11 seconds 00010000:00010000:2.0:1787826391.111638:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349cc23 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7eb expref: 23 pid: 25038 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826391.111656:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41275e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778691712:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826391.111690:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 22 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.111703:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826391.111795:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+22:86717:x1874668789916544:12345-192.168.203.9@tcp:101:cp.0 Request processed in 5579us (5774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.111807:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6369 00000100:00100000:1.0:1787826391.113298:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073be1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778691840:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826391.113318:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826391.113402:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789916672:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2597us (2805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826391.113413:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3125 00000100:00100000:2.0:1787826391.120779:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.120895:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789916928 00000100:00100000:0.0:1787826391.120905:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789916928 00000100:00100000:0.0:1787826391.121004:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2747 00000100:00100000:0.0:1787826391.121013:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+103:86717:x1874668789916928:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826391.121326:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86717:x1874668789916928:12345-192.168.203.9@tcp:35:cp.0 Request processed in 313us (557us total) trans 8590016756 rc 0/0 00000100:00100000:0.0:1787826391.121545:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2747 00000100:00100000:0.0:1787826391.162266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.162360:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789917056 00000100:00100000:2.0:1787826391.162371:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789917056 00000100:00100000:2.0:1787826391.162437:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111770 00000100:00100000:2.0:1787826391.162447:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+30:86720:x1874668789917056:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826391.162468:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.162502:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349cc31 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc7f9 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162570:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162594:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162606:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162623:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162630:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162637:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162683:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162691:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162817:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162823:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.162827:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162835:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162847:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.162980:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.162986:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.162993:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cc38 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163007:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163012:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163017:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163021:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.163024:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163029:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163036:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x63c75779 (ffff9bbe0fe8c300) 00010000:00010000:2.0:1787826391.163039:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.163041:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163047:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349cc3f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163079:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349cc31 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f9 expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163088:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.163090:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.163093:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349cc31 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f9 expref: 31 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.163101:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826391.163249:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+30:86720:x1874668789917056:12345-192.168.203.9@tcp:101:bash.0 Request processed in 803us (992us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826391.163257:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111770 00000100:00100000:2.0:1787826391.192233:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.192329:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789917184 00000100:00100000:1.0:1787826391.192339:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789917184 00000100:00100000:1.0:1787826391.192399:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111771 00000100:00100000:1.0:1787826391.192409:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41275e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86721:x1874668789917184:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826391.192433:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.192453:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cc46 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc800 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192531:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192546:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192558:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192572:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192579:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192596:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192636:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192642:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192649:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192654:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993ce00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.192659:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192667:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192685:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.192688:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.192697:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192704:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349cc4d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192718:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192724:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192730:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192735:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.192738:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192743:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192750:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x63c75779 (ffff9bbe16e56400) 00010000:00010000:1.0:1787826391.192752:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.192756:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192761:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349cc54 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192801:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cc46 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc800 expref: 105 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192826:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.192829:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.192833:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cc46 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc800 expref: 105 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.192842:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d800, rc 0) 00000100:00100000:1.0:1787826391.193049:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41275e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86721:x1874668789917184:12345-192.168.203.9@tcp:101:rm.0 Request processed in 640us (826us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826391.193057:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111771 00000100:00100000:0.0:1787826391.203737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.204028:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789917312 00000100:00100000:3.0:1787826391.204039:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789917312 00000100:00100000:3.0:1787826391.204099:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111772 00000100:00100000:3.0:1787826391.204109:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86721:x1874668789917312:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:3.0:1787826391.204129:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.204152:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cc5b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc807 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204217:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204233:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204244:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204263:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204271:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204279:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204317:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204324:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204331:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204337:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204343:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.204348:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204356:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204368:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.204371:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.204376:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204383:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc62 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204398:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204404:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204411:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204416:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.204419:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204426:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204434:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x63c75779 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826391.204437:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.204440:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204447:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc69 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.204479:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cc5b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc807 expref: 105 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.207360:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.207366:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.207377:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cc5b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc807 expref: 105 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.207396:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826391.207479:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86721:x1874668789917312:12345-192.168.203.9@tcp:101:rm.0 Request processed in 3370us (3751us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.207497:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111772 00000100:00100000:0.0:1787826391.233544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.233635:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789917440 00000100:00100000:1.0:1787826391.233645:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789917440 00000100:00100000:3.0:1787826391.233888:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111773 00000100:00100000:3.0:1787826391.233901:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86722:x1874668789917440:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826391.233921:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.233942:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cc70 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc80e expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234012:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234025:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234036:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234050:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234062:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234067:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234106:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234113:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234119:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234125:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234130:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.234134:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234141:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234152:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.234155:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.234159:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234166:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc77 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234192:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234198:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234204:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234208:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.234211:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234216:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234223:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x63c75779 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826391.234226:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.234229:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234234:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc7e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234265:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cc70 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc80e expref: 105 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234274:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.234277:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.234280:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cc70 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc80e expref: 105 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.234289:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826391.234340:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86722:x1874668789917440:12345-192.168.203.9@tcp:101:cp.0 Request processed in 444us (806us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.234347:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111773 00000100:00100000:2.0:1787826391.245949:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.246048:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789917568 00000100:00100000:3.0:1787826391.246058:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789917568 00000100:00100000:3.0:1787826391.246120:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111774 00000100:00100000:3.0:1787826391.246131:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86722:x1874668789917568:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826391.246151:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.246171:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cc85 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc815 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246246:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246259:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246270:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246284:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246289:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246295:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246331:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246339:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246345:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246351:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.246354:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246361:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246373:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.246376:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.246380:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246386:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cc8c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246399:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246404:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246409:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246413:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.246416:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246420:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246427:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x63c75779 (ffff9bbe08124f00) 00010000:00010000:3.0:1787826391.246429:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.246431:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246436:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cc93 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246466:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cc85 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc815 expref: 105 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246475:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.246477:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.246481:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cc85 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc815 expref: 105 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.246489:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606200, rc 0) 00000100:00100000:3.0:1787826391.246555:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86722:x1874668789917568:12345-192.168.203.9@tcp:101:cp.0 Request processed in 426us (615us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.246562:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111774 00000100:00100000:0.0:1787826391.251735:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.251819:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789917824 00000100:00100000:3.0:1787826391.251829:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789917824 00000100:00100000:3.0:1787826391.251908:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111775 00000100:00100000:3.0:1787826391.251918:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+104:86722:x1874668789917824:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826391.251940:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.251962:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cc9a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc81c expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252060:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252073:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252083:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252095:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252102:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252108:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826391.252418:0:7736:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xd3:0x0], index 1: 0 00010000:00010000:3.0:1787826391.252547:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ccaf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x147:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252558:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ccaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252568:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ccaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252599:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252607:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252614:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252620:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252625:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.252629:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252637:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252648:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.252651:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.252655:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252661:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cca1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826391.252676:0:7736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c16c0c5 reply state 00000000fac2338b transno 8590016757 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252686:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252691:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x63c75779 (ffff9bbe08124700) 00010000:00010000:3.0:1787826391.252693:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826391.252696:0:7736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826391.252737:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cc9a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc81c expref: 107 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252753:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607200/0x68019081f349ccaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc81c expref: 106 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.252760:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x147:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:3.0:1787826391.252762:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826391.252764:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607200, rc 0) 00000100:00100000:3.0:1787826391.252887:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+107:86722:x1874668789917824:12345-192.168.203.9@tcp:101:cp.0 Request processed in 970us (1163us total) trans 8590016757 rc 0/0 00000100:00100000:3.0:1787826391.252896:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111775 00000100:00100000:0.0:1787826391.257675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.267760:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789917952 00000100:00100000:3.0:1787826391.267776:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789917952 00000100:00100000:2.0:1787826391.268062:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6370 00000100:00100000:2.0:1787826391.268074:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+17:2402:x1874668789917952:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826391.268092:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.268113:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc823 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826391.268138:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826391.268156:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd3:0x0].0x0 since=3029s v=(0 0) 00010000:00010000:2.0:1787826391.268160:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826391.268169:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc823 expref: 18 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268187:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc823 expref: 18 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268201:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:2.0:1787826391.268256:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789917952:12345-192.168.203.9@tcp:101:cp.0 Request processed in 185us (10606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.268264:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6370 00000100:00100000:2.0:1787826391.268330:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.268355:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789918080 00000100:00100000:2.0:1787826391.268359:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789918080 00000100:00100000:2.0:1787826391.268386:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3467 00000100:00100000:2.0:1787826391.268393:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+107:2400:x1874668789918080:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826391.268438:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.268452:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ccc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc82a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268521:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268534:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268543:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268555:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268562:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268568:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268614:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268621:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268627:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268634:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.268638:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268648:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268659:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.268662:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.268667:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268674:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cccb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268688:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268694:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268699:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268704:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.268706:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268711:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268717:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa7f47a48 (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826391.268719:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.268721:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268730:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349ccd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268760:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ccc4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc82a expref: 108 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268770:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.268772:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826391.268776:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ccc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc82a expref: 108 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.268796:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc -2) 00000100:00100000:2.0:1787826391.268842:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+107:2400:x1874668789918080:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 449us (512us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826391.268877:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3467 00000100:00080000:3.0:1787826391.269225:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826391.273926:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.274149:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789918208 00000100:00100000:0.0:1787826391.274158:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789918208 00000100:00100000:0.0:1787826391.274208:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6371 00000100:00100000:0.0:1787826391.274216:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+18:86722:x1874668789918208:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826391.274230:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.274245:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ef467a2/0x68019081f349ccd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc862 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.274271:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc823 expref: 19 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.274279:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826391.274283:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826391.274287:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ef467a2/0x68019081f349ccd9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc862 expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.274312:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc823 expref: 19 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.274323:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc823 expref: 19 pid: 8430 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826391.274335:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778691968:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826391.274416:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826391.281066:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.281161:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789918336 00000100:00100000:1.0:1787826391.281171:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789918336 00010000:00010000:1.0:1787826391.281210:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc823 expref: 20 pid: 8430 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.281251:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3126 00000100:00100000:1.0:1787826391.281259:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2401:x1874668789918336:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826391.281272:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826391.281292:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc823 expref: 20 pid: 8430 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.281305:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc823 expref: 20 pid: 8430 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.281337:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826391.281342:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826391.281350:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ef467a2/0x68019081f349ccd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc862 expref: 20 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.281360:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ef467a2/0x68019081f349ccd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc862 expref: 20 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.281393:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ef467a2/0x68019081f349ccd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc862 expref: 20 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.281409:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073be1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778692096:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826391.281491:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5240 going to sleep for 11 seconds 00010000:00010000:2.0:1787826391.281621:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b26478ee/0x68019081f349ccbd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc823 expref: 20 pid: 8430 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826391.281636:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778691968:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826391.281659:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ef467a2/0x68019081f349ccd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc862 expref: 19 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.281680:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204e00, rc 0) 00000100:00100000:2.0:1787826391.281709:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+19:86722:x1874668789918208:12345-192.168.203.9@tcp:101:cp.0 Request processed in 7493us (7791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.281717:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6371 00000100:00100000:1.0:1787826391.284440:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073be1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778692096:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826391.284465:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826391.284520:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2401:x1874668789918336:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3261us (3464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826391.284531:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3126 00000100:00100000:0.0:1787826391.295969:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.296086:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789918592 00000100:00100000:3.0:1787826391.296095:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789918592 00000100:00100000:3.0:1787826391.296155:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2748 00000100:00100000:3.0:1787826391.296165:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+107:86722:x1874668789918592:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:3.0:1787826391.296453:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+108:86722:x1874668789918592:12345-192.168.203.9@tcp:35:cp.0 Request processed in 290us (491us total) trans 8590016758 rc 0/0 00000100:00100000:3.0:1787826391.296465:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2748 00000100:00100000:0.0:1787826391.318773:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.319156:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789918720 00000100:00100000:2.0:1787826391.319166:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789918720 00000100:00100000:2.0:1787826391.319228:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3468 00000100:00100000:2.0:1787826391.319238:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+108:2399:x1874668789918720:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826391.319296:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.319318:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cce0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc869 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319379:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319395:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319406:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319421:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319429:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319436:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319476:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319488:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319495:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319502:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.319507:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319514:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319527:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.319530:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.319535:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319541:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cce7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319555:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319560:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319566:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319571:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.319575:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319580:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319603:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa7f47a48 (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826391.319606:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.319609:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319616:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ccee lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319644:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cce0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc869 expref: 109 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319655:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.319657:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826391.319660:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cce0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc869 expref: 109 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.319682:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc -2) 00000100:00100000:2.0:1787826391.319754:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+108:2399:x1874668789918720:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 517us (990us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826391.319762:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3468 00000100:00100000:1.0:1787826391.330922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.331002:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789918976 00000100:00100000:0.0:1787826391.331010:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789918976 00000100:00100000:0.0:1787826391.331064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111776 00000100:00100000:0.0:1787826391.331073:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+30:86441:x1874668789918976:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826391.331093:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.331111:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349ccf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826391.331244:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4c:0x0]: returning size 4096 00010000:00010000:0.0:1787826391.331336:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349ccf5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8a1 expref: 32 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.331356:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826391.331359:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826391.331364:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349ccf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8a1 expref: 32 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.331379:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204000, rc 0) 00000100:00100000:0.0:1787826391.331440:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+31:86441:x1874668789918976:12345-192.168.203.9@tcp:101:bash.0 Request processed in 368us (526us total) trans 8590016759 rc 301/301 00000100:00100000:0.0:1787826391.331451:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111776 00000100:00100000:0.0:1787826391.335160:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.337263:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789919104 00000100:00100000:2.0:1787826391.337276:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789919104 00000100:00100000:2.0:1787826391.337348:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111777 00000100:00100000:2.0:1787826391.337358:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+31:86441:x1874668789919104:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826391.337384:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.337406:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8a8 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.337468:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cd0a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.337481:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cd0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.337492:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cd0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.337536:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4c:0x0]: returning size 4096 00000004:00200000:2.0:1787826391.337541:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.337561:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cd0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.337600:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8a8 expref: 33 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.337620:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3000/0x68019081f349cd0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8a8 expref: 32 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.337629:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.337632:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826391.337635:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3000, rc 0) 00000100:00100000:2.0:1787826391.337709:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+32:86441:x1874668789919104:12345-192.168.203.9@tcp:101:bash.0 Request processed in 352us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.337717:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111777 00000100:00100000:2.0:1787826391.342635:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.342737:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789919232 00000100:00100000:0.0:1787826391.342747:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789919232 00000100:00100000:0.0:1787826391.342809:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2749 00000100:00100000:0.0:1787826391.342819:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+32:86441:x1874668789919232:12345-192.168.203.9@tcp:37:bash.0 00000100:00100000:0.0:1787826391.347054:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+32:86441:x1874668789919232:12345-192.168.203.9@tcp:37:bash.0 Request processed in 4224us (4418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826391.347067:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2749 00000100:00100000:2.0:1787826391.354055:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.354152:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789919488 00000100:00100000:0.0:1787826391.354162:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789919488 00000100:00100000:0.0:1787826391.354320:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2750 00000100:00100000:0.0:1787826391.354330:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+32:86441:x1874668789919488:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:0.0:1787826391.354544:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+33:86441:x1874668789919488:12345-192.168.203.9@tcp:35:bash.0 Request processed in 215us (499us total) trans 8590016760 rc 0/0 00000100:00100000:0.0:1787826391.354553:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2750 00000100:00100000:1.0:1787826391.362556:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826391.362577:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778692224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826391.362644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826391.362928:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778692224 00000100:00100000:3.0:1787826391.362936:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778692224 00000100:00100000:3.0:1787826391.362989:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:3.0:1787826391.362999:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874668778692224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826391.363020:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570019264 pending 0 free 3828588544 avail 3597066240 00000100:00100000:3.0:1787826391.363070:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874668778692224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826391.363077:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00100000:3.0:1787826391.363121:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778692224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826391.363489:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826391.363500:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17084b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778692352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826391.363534:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826391.363612:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778692352 00000100:00100000:2.0:1787826391.363617:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778692352 00000100:00100000:2.0:1787826391.363652:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:2.0:1787826391.363660:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874668778692352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826391.363681:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 671387072 pending 0 free 3894763520 avail 3663241216 00000100:00100000:2.0:1787826391.363736:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874668778692352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.363743:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:1.0:1787826391.363911:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17084b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778692352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826391.392230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.398314:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789919616 00000100:00100000:3.0:1787826391.398328:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789919616 00000100:00100000:2.0:1787826391.398484:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111778 00000100:00100000:2.0:1787826391.398495:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+33:86729:x1874668789919616:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.398520:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.398541:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349cd11 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8af expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.398606:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.398621:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.398632:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.398644:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.398656:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.398662:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399281:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cd26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x134:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399292:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cd26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399300:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cd26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.399338:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x134:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.399343:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.399363:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cd26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399375:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cd26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399384:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399390:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399396:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399407:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399412:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.399416:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399423:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399435:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.399438:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.399442:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399448:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cd18 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399461:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399468:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399474:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399479:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.399482:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399493:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399501:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xbc0ca3a9 (ffff9bbe0bd66a00) 00010000:00010000:2.0:1787826391.399504:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.399507:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399513:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd1f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399542:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349cd11 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8af expref: 35 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399556:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2000/0x68019081f349cd26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8af expref: 34 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.399563:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x134:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:2.0:1787826391.399565:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.399568:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2000, rc 0) 00000100:00100000:2.0:1787826391.399839:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+34:86729:x1874668789919616:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1344us (7617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.399847:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111778 00000100:00100000:1.0:1787826391.414381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.414526:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789919744 00000100:00100000:3.0:1787826391.414535:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789919744 00000100:00100000:3.0:1787826391.414609:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6372 00000100:00100000:3.0:1787826391.414619:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789919744:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.414636:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.414672:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349cd2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8b6 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.414731:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778692480:192.168.203.9@tcp:106: 00000100:00100000:3.0:1787826391.414830:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170300 going to sleep for 11 seconds 00000100:00080000:2.0:1787826391.414967:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1787826391.418048:0:19335:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1787826391.418058:0:19335:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb mtime: 0 -> 1787826388 00002000:00010000:3.0:1787826391.418061:0:19335:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb atime: 0 -> 1787826388 00002000:00010000:3.0:1787826391.418063:0:19335:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb ctime: 0 -> 1787826388 00002000:00010000:3.0:1787826391.418066:0:19335:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1787826391.418090:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778692480:192.168.203.9@tcp:106: 00010000:00010000:3.0:1787826391.418126:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349cd2d lrc: 1/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8b6 expref: 7 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.418151:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008dda9b0/0x68019081f349cd2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8b6 expref: 7 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.418163:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:3.0:1787826391.418228:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789919744:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 3611us (3856us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.418237:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6372 00000100:00100000:0.0:1787826391.424705:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.424836:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789919872 00000100:00100000:3.0:1787826391.424847:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789919872 00000100:00100000:3.0:1787826391.424929:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111779 00000100:00100000:3.0:1787826391.424939:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+34:86729:x1874668789919872:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.424958:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.424977:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd34 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8bd expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425050:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425066:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425077:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425089:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425095:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425101:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425163:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cd49 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425170:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425175:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826391.425227:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13d:0x0]: returning size 1516 00000004:00200000:3.0:1787826391.425232:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826391.425250:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425261:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425269:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425275:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425286:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425292:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.425296:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425303:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425314:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.425317:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.425321:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425328:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd3b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425339:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425344:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425350:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425354:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.425357:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425366:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425372:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x84832a57 (ffff9bbe12dd8800) 00010000:00010000:3.0:1787826391.425374:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.425377:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425383:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd42 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425406:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd34 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8bd expref: 36 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425417:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606400/0x68019081f349cd49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8bd expref: 35 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.425425:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13d:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:3.0:1787826391.425427:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826391.425430:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606400, rc 0) 00000100:00100000:3.0:1787826391.425479:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+35:86729:x1874668789919872:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 541us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826391.425485:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111779 00000100:00100000:1.0:1787826391.431655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.431927:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789920000 00000100:00100000:3.0:1787826391.431937:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789920000 00000100:00100000:3.0:1787826391.432002:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6373 00000100:00100000:3.0:1787826391.432011:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789920000:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.432032:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.432056:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349cd50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8c4 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.432109:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778692608:192.168.203.9@tcp:106: 00000100:00100000:3.0:1787826391.432189:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170300 going to sleep for 11 seconds 00000100:00080000:0.0:1787826391.432337:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1787826391.434383:0:8605:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xce:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1787826391.434392:0:8605:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xce:0x0] updating lvb mtime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.434394:0:8605:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xce:0x0] updating lvb atime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.434396:0:8605:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xce:0x0] updating lvb ctime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.434399:0:8605:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xce:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1787826391.434421:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778692608:192.168.203.9@tcp:106: 00010000:00010000:3.0:1787826391.434457:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349cd50 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8c4 expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.434481:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349cd50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8c4 expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.434493:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826391.434556:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789920000:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2545us (2918us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.434565:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6373 00000100:00100000:0.0:1787826391.441272:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.441356:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789920128 00000100:00100000:3.0:1787826391.441367:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789920128 00000100:00100000:3.0:1787826391.441426:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111780 00000100:00100000:3.0:1787826391.441436:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+35:86729:x1874668789920128:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.441456:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.441477:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cd57 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8cb expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441544:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441559:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441570:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441583:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441591:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441599:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441689:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441708:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441715:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826391.441751:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13e:0x0]: returning size 1516 00000004:00200000:3.0:1787826391.441756:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826391.441775:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441795:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441805:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441812:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441818:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441824:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441830:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.441834:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441841:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441888:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.441892:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.441897:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441903:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cd5e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441919:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441925:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441930:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441935:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.441938:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441945:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441952:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbe12458100) 00010000:00010000:3.0:1787826391.441955:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.441957:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441964:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cd65 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.441991:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cd57 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8cb expref: 37 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.442004:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607a00/0x68019081f349cd6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8cb expref: 36 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.442017:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13e:0x0].0x0 (ffff9bbe12458700) 00010000:00010000:3.0:1787826391.442020:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826391.442022:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607a00, rc 0) 00000100:00100000:3.0:1787826391.442089:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+36:86729:x1874668789920128:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 653us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826391.442096:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111780 00000100:00100000:1.0:1787826391.446116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.446198:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789920256 00000100:00100000:3.0:1787826391.446207:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789920256 00000100:00100000:3.0:1787826391.446263:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6374 00000100:00100000:3.0:1787826391.446273:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789920256:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.446290:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.446306:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349cd73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8d2 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.446366:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778692736:192.168.203.9@tcp:106: 00000100:00100000:3.0:1787826391.446453:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170300 going to sleep for 11 seconds 00002000:00010000:3.0:1787826391.449567:0:45681:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xce:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1787826391.449576:0:45681:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xce:0x0] updating lvb mtime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.449578:0:45681:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xce:0x0] updating lvb atime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.449580:0:45681:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xce:0x0] updating lvb ctime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.449581:0:45681:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xce:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1787826391.449602:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778692736:192.168.203.9@tcp:106: 00010000:00010000:3.0:1787826391.449640:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349cd73 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8d2 expref: 7 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.449681:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349cd73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8d2 expref: 7 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.449694:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826391.449761:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789920256:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 3490us (3655us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.449769:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6374 00000100:00100000:0.0:1787826391.453559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.453840:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789920384 00000100:00100000:1.0:1787826391.454025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789920384 00000100:00100000:0.0:1787826391.454276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111781 00000100:00100000:0.0:1787826391.454287:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+36:86729:x1874668789920384:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826391.454308:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.454328:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349cd7a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454390:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454404:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454414:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454424:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454431:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454437:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454507:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204c00/0x68019081f349cd8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454515:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204c00/0x68019081f349cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454522:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204c00/0x68019081f349cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826391.454559:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13f:0x0]: returning size 1516 00000004:00200000:0.0:1787826391.454564:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826391.454582:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204c00/0x68019081f349cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454593:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204c00/0x68019081f349cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454601:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454608:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454614:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454620:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454626:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826391.454630:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454637:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454649:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826391.454652:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826391.454657:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454674:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349cd81 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454700:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454707:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454712:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454718:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826391.454720:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454725:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454732:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xcdd6ff3 (ffff9bbf41389100) 00010000:00010000:0.0:1787826391.454734:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826391.454737:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454742:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349cd88 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454767:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349cd7a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8d9 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454781:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204c00/0x68019081f349cd8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8d9 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.454803:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13f:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:0.0:1787826391.454806:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826391.454808:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204c00, rc 0) 00000100:00100000:0.0:1787826391.455172:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+37:86729:x1874668789920384:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 885us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826391.455181:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111781 00000100:00100000:1.0:1787826391.463249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.463344:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789920512 00000100:00100000:2.0:1787826391.463353:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789920512 00000100:00100000:2.0:1787826391.463409:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6375 00000100:00100000:2.0:1787826391.463419:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789920512:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.463439:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.463457:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349cd96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8e0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826391.463516:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778692864:192.168.203.9@tcp:106: 00000100:00100000:2.0:1787826391.463602:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53dcc0 going to sleep for 11 seconds 00002000:00010000:2.0:1787826391.465642:0:8433:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xcf:0x0] updating lvb size: 0 -> 1516 00002000:00010000:2.0:1787826391.465649:0:8433:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xcf:0x0] updating lvb mtime: 0 -> 1787826390 00002000:00010000:2.0:1787826391.465652:0:8433:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xcf:0x0] updating lvb atime: 0 -> 1787826390 00002000:00010000:2.0:1787826391.465655:0:8433:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xcf:0x0] updating lvb ctime: 0 -> 1787826390 00002000:00010000:2.0:1787826391.465657:0:8433:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xcf:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1787826391.465685:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778692864:192.168.203.9@tcp:106: 00010000:00010000:2.0:1787826391.465722:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349cd96 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8e0 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.465744:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2186a15/0x68019081f349cd96 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8e0 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.465757:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00000100:00100000:2.0:1787826391.465816:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668789920512:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2398us (2576us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826391.465825:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6375 00000100:00100000:0.0:1787826391.470463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.470528:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789920640 00000100:00100000:2.0:1787826391.470537:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789920640 00000100:00100000:2.0:1787826391.470590:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111782 00000100:00100000:2.0:1787826391.470599:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+37:86729:x1874668789920640:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.470619:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.470646:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd9d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8e7 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470721:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470736:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470746:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470758:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470765:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470772:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470887:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349cdb2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x140:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470896:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349cdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470903:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349cdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.470949:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x140:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.470954:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.470971:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349cdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470983:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349cdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470993:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.470999:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471005:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471012:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471018:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.471022:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471029:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471050:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.471053:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.471057:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471062:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349cda4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471080:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471087:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471092:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471097:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.471100:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471105:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471112:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbe12458600) 00010000:00010000:2.0:1787826391.471114:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.471117:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471123:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349cdab lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471147:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349cd9d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8e7 expref: 39 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471159:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2200/0x68019081f349cdb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8e7 expref: 38 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.471172:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x140:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:2.0:1787826391.471174:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.471176:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2200, rc 0) 00000100:00100000:2.0:1787826391.471225:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+38:86729:x1874668789920640:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 626us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.471232:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111782 00000100:00100000:1.0:1787826391.476070:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.476151:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789920768 00000100:00100000:3.0:1787826391.476160:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789920768 00000100:00100000:3.0:1787826391.476286:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6376 00000100:00100000:3.0:1787826391.476296:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789920768:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.476313:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.476330:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349cdb9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8ee expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.476386:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778692992:192.168.203.9@tcp:106: 00000100:00100000:3.0:1787826391.476482:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170300 going to sleep for 11 seconds 00002000:00010000:3.0:1787826391.483065:0:19335:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xcf:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1787826391.483073:0:19335:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xcf:0x0] updating lvb mtime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.483076:0:19335:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xcf:0x0] updating lvb atime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.483078:0:19335:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xcf:0x0] updating lvb ctime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.483081:0:19335:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xcf:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1787826391.483103:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778692992:192.168.203.9@tcp:106: 00010000:00010000:3.0:1787826391.483139:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349cdb9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8ee expref: 7 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.483163:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92e3861/0x68019081f349cdb9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8ee expref: 7 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.483175:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826391.483236:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789920768:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 6940us (7175us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.483243:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6376 00000100:00100000:0.0:1787826391.490951:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.491408:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789920896 00000100:00100000:1.0:1787826391.491417:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789920896 00000100:00100000:1.0:1787826391.491480:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111783 00000100:00100000:1.0:1787826391.491490:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+38:86729:x1874668789920896:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826391.491510:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.491532:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cdc0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8f5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491595:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491609:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491620:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491631:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491638:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491644:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491729:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ca00/0x68019081f349cdd5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x141:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491737:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ca00/0x68019081f349cdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491743:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ca00/0x68019081f349cdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826391.491791:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x141:0x0]: returning size 1516 00000004:00200000:1.0:1787826391.491795:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826391.491817:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ca00/0x68019081f349cdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491829:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ca00/0x68019081f349cdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491839:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491846:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491886:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491894:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491900:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.491904:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491913:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491925:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.491928:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.491933:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491939:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cdc7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491954:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491961:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491967:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491972:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.491975:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491981:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.491988:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9537b590 (ffff9bbe12458800) 00010000:00010000:1.0:1787826391.491991:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.491994:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.492004:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cdce lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.492029:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cdc0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8f5 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.492247:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ca00/0x68019081f349cdd5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8f5 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.492256:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x141:0x0].0x0 (ffff9bbe12458b00) 00010000:00010000:1.0:1787826391.492258:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826391.492261:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993ca00, rc 0) 00000100:00100000:1.0:1787826391.492327:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+39:86729:x1874668789920896:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 838us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826391.492335:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111783 00000100:00100000:1.0:1787826391.498704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.498944:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789921024 00000100:00100000:3.0:1787826391.498954:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789921024 00000100:00100000:3.0:1787826391.499005:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6377 00000100:00100000:3.0:1787826391.499015:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789921024:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.499031:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.499050:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349cddc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc8fc expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.499107:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778693120:192.168.203.9@tcp:106: 00000100:00100000:3.0:1787826391.499195:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170300 going to sleep for 11 seconds 00002000:00010000:3.0:1787826391.503094:0:8605:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xd0:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1787826391.503104:0:8605:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xd0:0x0] updating lvb mtime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.503107:0:8605:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xd0:0x0] updating lvb atime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.503109:0:8605:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xd0:0x0] updating lvb ctime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.503112:0:8605:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xd0:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1787826391.503134:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778693120:192.168.203.9@tcp:106: 00010000:00010000:3.0:1787826391.503171:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349cddc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8fc expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.503195:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349cddc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc8fc expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.503207:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826391.503274:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789921024:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 4259us (4578us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.503283:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6377 00000100:00100000:0.0:1787826391.510306:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.510509:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789921152 00000100:00100000:3.0:1787826391.510519:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789921152 00000100:00100000:3.0:1787826391.510583:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111784 00000100:00100000:3.0:1787826391.510593:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+39:86729:x1874668789921152:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.510613:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.510634:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349cde3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc903 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.510715:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.510728:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.510738:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.510750:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.510761:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.510767:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.510844:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cdf8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x142:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.511143:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cdf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.511153:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cdf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826391.512972:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x142:0x0]: returning size 1516 00000004:00200000:0.0:1787826391.512984:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826391.513013:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cdf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513032:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cdf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513044:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513051:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513058:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513064:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826391.513068:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513079:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513094:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826391.513097:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826391.513103:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513108:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606c00/0x68019081f349cdea lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513124:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513130:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513136:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513142:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826391.513144:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513150:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513173:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd964d85e (ffff9bbe12458900) 00010000:00010000:0.0:1787826391.513175:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826391.513178:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513185:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349cdf1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513222:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607000/0x68019081f349cde3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc903 expref: 41 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513236:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606000/0x68019081f349cdf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc903 expref: 40 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.513243:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x142:0x0].0x0 (ffff9bbe12458000) 00010000:00010000:0.0:1787826391.513246:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826391.513248:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606000, rc 0) 00000100:00100000:0.0:1787826391.513331:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+40:86729:x1874668789921152:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2739us (3033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826391.513340:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111784 00000100:00100000:1.0:1787826391.522020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.522530:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789921280 00000100:00100000:3.0:1787826391.522539:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789921280 00000100:00100000:3.0:1787826391.522593:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3469 00000100:00100000:3.0:1787826391.522603:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+40:2401:x1874668789921280:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826391.522655:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.522679:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349cdff lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc90a expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522731:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522744:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522754:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522765:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522773:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522779:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522925:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ce14 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x143:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522941:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ce14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522949:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ce14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826391.522968:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x143:0x0]: returning size 1516 00000004:00200000:3.0:1787826391.522972:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826391.522988:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ce14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.522998:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ce14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523007:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523013:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523025:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523031:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.523035:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523042:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523053:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826391.523056:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.523060:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523066:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606800/0x68019081f349ce06 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523078:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523084:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523090:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523095:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826391.523098:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523109:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523116:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbf41389200) 00010000:00010000:3.0:1787826391.523119:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826391.523121:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523126:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606a00/0x68019081f349ce0d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523153:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607c00/0x68019081f349cdff lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc90a expref: 42 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523165:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607400/0x68019081f349ce14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc90a expref: 41 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.523172:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x143:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:3.0:1787826391.523175:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826391.523177:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607400, rc 0) 00010000:00010000:3.0:1787826391.523191:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.523800:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ce1b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc911 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.523837:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.523847:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.523870:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.523880:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.523887:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.523893:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.523946:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ce30 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x144:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826391.523958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:2.0:1787826391.523958:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.523965:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.523981:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x144:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.523984:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.523996:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524004:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524012:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524018:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524024:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524029:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.524032:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524050:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524060:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.524063:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.524066:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524072:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349ce22 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524084:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524090:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524095:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524100:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.524103:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524109:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524116:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x61bf1dfb (ffff9bbe16e56e00) 00010000:00010000:2.0:1787826391.524119:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.524121:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524127:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349ce29 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524146:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349ce1b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc911 expref: 43 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524159:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3a00/0x68019081f349ce30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc911 expref: 42 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524165:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x144:0x0].0x0 (ffff9bbe16e56100) 00010000:00010000:2.0:1787826391.524168:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.524170:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3a00, rc 0) 00010000:00010000:2.0:1787826391.524176:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.524183:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ce37 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc918 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524205:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524213:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524221:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524232:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524239:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524245:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524289:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794e00/0x68019081f349ce4c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x145:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524296:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794e00/0x68019081f349ce4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524302:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794e00/0x68019081f349ce4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.524316:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x145:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.524319:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.524326:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794e00/0x68019081f349ce4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524333:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794e00/0x68019081f349ce4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524339:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524343:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524348:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524353:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.524355:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524360:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524367:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.524369:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.524372:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524378:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349ce3e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524386:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524392:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524398:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524403:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.524405:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524410:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524417:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa5ec40c9 (ffff9bbe08124b00) 00010000:00010000:2.0:1787826391.524418:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.524421:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524427:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349ce45 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524443:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349ce37 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc918 expref: 44 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524455:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794e00/0x68019081f349ce4c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc918 expref: 43 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524461:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x145:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:2.0:1787826391.524464:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.524466:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794e00, rc 0) 00010000:00010000:2.0:1787826391.524471:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.524478:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349ce53 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc91f expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524498:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524506:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524512:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.524516:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789921408 00010000:00010000:2.0:1787826391.524520:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.524522:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789921408 00010000:00010000:2.0:1787826391.524526:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524533:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524569:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f349ce68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x146:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.524573:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6378 00010000:00010000:2.0:1787826391.524578:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f349ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.524582:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789921408:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.524585:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f349ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.524592:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1787826391.524599:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x146:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.524602:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1787826391.524602:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349ce6f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc942 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826391.524611:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f349ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524618:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f349ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524624:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524629:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524634:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524638:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.524641:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524647:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524654:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.524657:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.524659:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524665:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349ce5a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.524670:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778693248:192.168.203.9@tcp:106: 00010000:00010000:2.0:1787826391.524675:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524679:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524685:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524689:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.524691:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524696:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524715:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbf41389600) 00010000:00010000:2.0:1787826391.524717:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.524720:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524725:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349ce61 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524742:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349ce53 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc91f expref: 45 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.524746:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787826391.524752:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795800/0x68019081f349ce68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc91f expref: 44 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524758:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x146:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:2.0:1787826391.524761:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.524763:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41795800, rc 0) 00010000:00010000:2.0:1787826391.524768:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.524775:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349ce76 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc926 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524803:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524813:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524819:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524829:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524834:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524840:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524895:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795200/0x68019081f349ce8b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x147:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524904:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795200/0x68019081f349ce8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x147:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524912:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795200/0x68019081f349ce8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x147:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.524926:0:45684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x147:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.524929:0:45684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.524938:0:45684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795200/0x68019081f349ce8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x147:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524946:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795200/0x68019081f349ce8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524953:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524959:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524965:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524971:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.524974:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524980:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524988:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.524991:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.524994:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.524999:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349ce7d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525008:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525014:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525020:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525026:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.525028:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525034:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525040:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x63c75779 (ffff9bbe08124700) 00010000:00010000:2.0:1787826391.525042:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.525045:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525051:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349ce84 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525068:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349ce76 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc926 expref: 46 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525079:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795200/0x68019081f349ce8b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc926 expref: 45 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525086:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x147:0x0].0x0 (ffff9bbe0a9bf800) 00010000:00010000:2.0:1787826391.525088:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.525091:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41795200, rc 0) 00010000:00010000:2.0:1787826391.525095:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.525101:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349ce92 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc92d expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525120:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525127:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525134:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525145:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525151:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525157:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525171:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525176:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525182:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525187:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.525190:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525196:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525203:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.525205:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.525208:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525214:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349ce99 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525222:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525228:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525234:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525240:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.525243:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525249:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525256:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa7f47a48 (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826391.525259:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.525261:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525267:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349cea0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa7f47a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525287:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349ce92 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc92d expref: 46 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525296:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.525298:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826391.525301:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349ce92 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc92d expref: 46 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.525308:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794c00, rc -2) 00000100:00100000:2.0:1787826391.525352:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2401:x1874668789921280:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 2750us (3340us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826391.525360:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3469 00002000:00010000:3.0:1787826391.531822:0:45681:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xd0:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1787826391.531830:0:45681:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xd0:0x0] updating lvb mtime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.531832:0:45681:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xd0:0x0] updating lvb atime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.531834:0:45681:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xd0:0x0] updating lvb ctime: 0 -> 1787826390 00002000:00010000:3.0:1787826391.531836:0:45681:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xd0:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1787826391.531886:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778693248:192.168.203.9@tcp:106: 00010000:00010000:3.0:1787826391.531933:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349ce6f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc942 expref: 7 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.531957:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002480845e/0x68019081f349ce6f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc942 expref: 7 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.531971:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00000100:00100000:3.0:1787826391.532029:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789921408:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 7447us (8070us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.532037:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6378 00000100:00100000:3.0:1787826391.540565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.540710:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789921536 00000100:00100000:2.0:1787826391.540720:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789921536 00000100:00100000:2.0:1787826391.540779:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6379 00000100:00100000:2.0:1787826391.540797:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668789921536:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.540815:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.540833:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8ba39c7/0x68019081f349cea7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc949 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826391.540912:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778693376:192.168.203.9@tcp:106: 00000100:00100000:2.0:1787826391.540992:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826391.543357:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.543395:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.543422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.543455:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.543504:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789921664 00000100:00100000:1.0:1787826391.543510:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789921664 00002000:00010000:2.0:1787826391.543520:0:8433:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xd1:0x0] updating lvb size: 0 -> 1516 00002000:00010000:2.0:1787826391.543524:0:8433:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xd1:0x0] updating lvb mtime: 0 -> 1787826390 00002000:00010000:2.0:1787826391.543526:0:8433:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xd1:0x0] updating lvb atime: 0 -> 1787826390 00002000:00010000:2.0:1787826391.543528:0:8433:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xd1:0x0] updating lvb ctime: 0 -> 1787826390 00002000:00010000:2.0:1787826391.543530:0:8433:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xd1:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1787826391.543547:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778693376:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826391.543550:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789921920 00000100:00100000:1.0:1787826391.543553:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789921920 00000100:00100000:1.0:1787826391.543565:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789921792 00000100:00100000:1.0:1787826391.543567:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789921792 00000100:00100000:1.0:1787826391.543576:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789922048 00010000:00010000:2.0:1787826391.543577:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e8ba39c7/0x68019081f349cea7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc949 expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.543578:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789922048 00000100:00100000:1.0:1787826391.543590:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6380 00000100:00100000:1.0:1787826391.543597:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+7:2402:x1874668789921664:12345-192.168.203.9@tcp:101:ll_agl.0 00010000:00010000:2.0:1787826391.543600:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8ba39c7/0x68019081f349cea7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc949 expref: 12 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.543609:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.543611:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb000, rc 0) 00010000:00010000:1.0:1787826391.543624:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349ceae lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc950 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.543658:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349ceae lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc950 expref: 8 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826391.543658:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+11:2400:x1874668789921536:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2862us (3102us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826391.543671:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6379 00010000:00010000:1.0:1787826391.543672:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349ceae lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc950 expref: 8 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.543682:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d000, rc 0) 00000100:00100000:2.0:1787826391.543690:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6381 00000100:00100000:1.0:1787826391.543703:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+7:2402:x1874668789921664:12345-192.168.203.9@tcp:101:ll_agl.0 Request processed in 107us (356us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826391.543709:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+7:2402:x1874668789921920:12345-192.168.203.9@tcp:101:ll_agl.0 00000100:00100000:1.0:1787826391.543710:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6380 00010000:00010000:2.0:1787826391.543716:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787826391.543722:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6382 00010000:00010000:2.0:1787826391.543725:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7552dce/0x68019081f349ceb5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc95e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.543728:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+10:2402:x1874668789921792:12345-192.168.203.9@tcp:101:ll_agl.0 00010000:00010000:1.0:1787826391.543734:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.543742:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7584702/0x68019081f349cebc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc957 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.543742:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7552dce/0x68019081f349ceb5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc95e expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.543755:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7552dce/0x68019081f349ceb5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc95e expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.543756:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7584702/0x68019081f349cebc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc957 expref: 11 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.543764:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09cea600, rc 0) 00010000:00010000:1.0:1787826391.543768:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7584702/0x68019081f349cebc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc957 expref: 11 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.543776:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c600, rc 0) 00000100:00100000:2.0:1787826391.543792:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789921920:12345-192.168.203.9@tcp:101:ll_agl.0 Request processed in 87us (387us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826391.543798:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6381 00000100:00100000:1.0:1787826391.543801:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+10:2402:x1874668789921792:12345-192.168.203.9@tcp:101:ll_agl.0 Request processed in 74us (379us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826391.543807:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6382 00000100:00100000:2.0:1787826391.543810:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6383 00000100:00100000:2.0:1787826391.543816:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789922048:12345-192.168.203.9@tcp:101:ll_agl.0 00010000:00010000:2.0:1787826391.543822:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.543830:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbd6ccbf/0x68019081f349cec3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc965 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.543847:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fbd6ccbf/0x68019081f349cec3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc965 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.543902:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbd6ccbf/0x68019081f349cec3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc965 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.543911:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb200, rc 0) 00000100:00100000:2.0:1787826391.543932:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789922048:12345-192.168.203.9@tcp:101:ll_agl.0 Request processed in 115us (476us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826391.543938:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6383 00000100:00100000:1.0:1787826391.544740:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.545158:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789922176 00000100:00100000:2.0:1787826391.545164:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789922176 00000100:00100000:2.0:1787826391.545208:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3470 00000100:00100000:2.0:1787826391.545216:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2400:x1874668789922176:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826391.545260:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.545276:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349ceca lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc96c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545323:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545336:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545346:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545359:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545370:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545376:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545411:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545418:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545425:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545431:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceae00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.545435:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545443:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545453:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.545456:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.545460:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545467:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349ced1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545480:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545487:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545494:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545499:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.545502:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545509:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545516:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x747be2b2 (ffff9bbe0fe8c600) 00010000:00010000:2.0:1787826391.545519:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.545522:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545528:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349ced8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x747be2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545554:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349ceca lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc96c expref: 46 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545563:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.545565:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826391.545569:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349ceca lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc96c expref: 46 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.545583:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09cea800, rc -2) 00000100:00100000:2.0:1787826391.545631:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2400:x1874668789922176:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 416us (893us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826391.545639:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3470 00000100:00100000:2.0:1787826391.564480:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.564567:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789922304 00000100:00100000:1.0:1787826391.564575:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789922304 00000100:00100000:1.0:1787826391.564631:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6384 00000100:00100000:1.0:1787826391.564641:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789922304:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826391.564659:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.564686:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349cedf lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc9ab expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.564749:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778693504:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826391.564837:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5240 going to sleep for 11 seconds 00002000:00010000:1.0:1787826391.566462:0:25038:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826391.566470:0:25038:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb mtime: 0 -> 1787826391 00002000:00010000:1.0:1787826391.566473:0:25038:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb atime: 0 -> 1787826391 00002000:00010000:1.0:1787826391.566476:0:25038:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb ctime: 0 -> 1787826391 00002000:00010000:1.0:1787826391.566478:0:25038:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826391.566499:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778693504:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826391.566529:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349cedf lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc9ab expref: 7 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.566552:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349cedf lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc9ab expref: 7 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.566573:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c600, rc 0) 00000100:00100000:1.0:1787826391.566624:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789922304:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1984us (2154us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826391.566633:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6384 00000100:00100000:0.0:1787826391.576324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.576426:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789922432 00000100:00100000:2.0:1787826391.576435:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789922432 00000100:00100000:2.0:1787826391.576494:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3471 00000100:00100000:2.0:1787826391.576504:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2401:x1874668789922432:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826391.591308:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.591335:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349cee6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fc9b2 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591391:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591403:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591413:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591431:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591437:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591443:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591480:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591554:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591561:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591566:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826391.591570:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591576:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591715:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826391.591719:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826391.591724:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.591838:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349ceed lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592244:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592252:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592258:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592263:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826391.592267:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592273:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592283:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xf92ed07 (ffff9bbe12dd8d00) 00010000:00010000:0.0:1787826391.592285:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826391.592289:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592294:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cef4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf92ed07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592329:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349cee6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc9b2 expref: 47 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592340:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826391.592342:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826391.592346:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349cee6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc9b2 expref: 47 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.592356:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204600, rc -2) 00000100:00100000:0.0:1787826391.596868:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2401:x1874668789922432:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 20342us (20529us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826391.596881:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3471 00000100:00100000:0.0:1787826391.599893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.600090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.600327:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789922560 00000100:00100000:1.0:1787826391.600337:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789922560 00000100:00100000:1.0:1787826391.600397:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6385 00000100:00100000:1.0:1787826391.600409:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789922560:12345-192.168.203.9@tcp:101:lfs.0 00000100:00100000:3.0:1787826391.600417:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789922688 00000100:00100000:3.0:1787826391.600422:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789922688 00010000:00010000:1.0:1787826391.600427:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.600446:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7584702/0x68019081f349cefb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fca29 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.600465:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3472 00000100:00100000:3.0:1787826391.600474:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2399:x1874668789922688:12345-192.168.203.9@tcp:63:ll_sa.0 00000100:00100000:1.0:1787826391.600514:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778693632:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826391.600576:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5240 going to sleep for 11 seconds 00010000:00010000:1.0:1787826391.615393:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.615419:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf02 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fca30 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615484:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615499:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615510:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615530:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615537:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615543:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615580:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615586:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615592:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615598:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.615602:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615611:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615621:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.615625:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.615629:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615635:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf09 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615649:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615656:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615662:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615667:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.615670:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615676:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615683:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x193dee2 (ffff9bbe16e56400) 00010000:00010000:1.0:1787826391.615685:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.615689:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615695:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf10 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x193dee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615743:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf02 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fca30 expref: 47 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615755:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.615758:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826391.615762:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf02 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fca30 expref: 47 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.615772:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d000, rc -2) 00000100:00100000:1.0:1787826391.615890:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2399:x1874668789922688:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 15416us (15798us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826391.615901:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3472 00002000:00010000:1.0:1787826391.622737:0:8433:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xd2:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826391.622745:0:8433:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xd2:0x0] updating lvb mtime: 0 -> 1787826391 00002000:00010000:1.0:1787826391.622748:0:8433:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xd2:0x0] updating lvb atime: 0 -> 1787826391 00002000:00010000:1.0:1787826391.622750:0:8433:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xd2:0x0] updating lvb ctime: 0 -> 1787826391 00002000:00010000:1.0:1787826391.622752:0:8433:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xd2:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826391.622774:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778693632:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826391.622819:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7584702/0x68019081f349cefb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fca29 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.622844:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7584702/0x68019081f349cefb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fca29 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.622885:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c600, rc 0) 00000100:00100000:1.0:1787826391.622946:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789922560:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 22538us (23090us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826391.622954:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6385 00000100:00100000:3.0:1787826391.631954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.632041:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789922816 00000100:00100000:0.0:1787826391.632050:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789922816 00000100:00100000:0.0:1787826391.632109:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6386 00000100:00100000:0.0:1787826391.632118:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789922816:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826391.632134:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.632151:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004570ab88/0x68019081f349cf17 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcb17 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826391.632207:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a1070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778693760:192.168.203.9@tcp:106: 00000100:00100000:0.0:1787826391.632288:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826391.640680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.640813:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789922944 00000100:00100000:3.0:1787826391.640823:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789922944 00000100:00100000:3.0:1787826391.640916:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3473 00000100:00100000:3.0:1787826391.640926:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17086d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2402:x1874668789922944:12345-192.168.203.9@tcp:63:ll_sa.0 00000100:00100000:3.0:1787826391.647513:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:1.0:1787826391.647840:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.647891:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf1e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcb1e expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.647953:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.647966:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.647977:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.647990:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.647996:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648002:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648040:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648047:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648053:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648059:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.648063:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648074:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648086:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.648089:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.648094:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648100:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cf25 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648114:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648120:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648125:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648129:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.648132:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648138:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648145:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x6be7ceb5 (ffff9bbe16e56400) 00010000:00010000:1.0:1787826391.648147:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.648150:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648155:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cf2c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x6be7ceb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648182:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf1e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcb1e expref: 47 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648191:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.648194:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826391.648198:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf1e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcb1e expref: 47 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648207:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c600, rc -2) 00000100:00100000:1.0:1787826391.648275:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17086d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2402:x1874668789922944:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 7350us (7613us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826391.648284:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3473 00000100:00100000:1.0:1787826391.648308:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789923072 00000100:00100000:1.0:1787826391.648315:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789923072 00000100:00100000:1.0:1787826391.648357:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3474 00000100:00100000:1.0:1787826391.648365:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2402:x1874668789923072:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826391.648387:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.648395:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf33 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fccde expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648419:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648427:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648433:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648444:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648449:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648455:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648470:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648476:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648482:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648487:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993cc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.648490:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648496:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648504:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.648507:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.648510:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648517:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf3a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648526:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648532:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648538:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648544:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.648547:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648553:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648559:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x47b2071b (ffff9bbe16e56600) 00010000:00010000:1.0:1787826391.648562:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.648565:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648571:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf41 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x47b2071b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648589:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf33 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fccde expref: 46 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648603:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.648605:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826391.648609:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349cf33 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fccde expref: 46 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.648618:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc -2) 00000100:00100000:1.0:1787826391.648641:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+45:2402:x1874668789923072:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 278us (1138us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826391.648649:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3474 00002000:00010000:0.0:1787826391.648830:0:8605:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1787826391.648834:0:8605:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb mtime: 0 -> 1787826391 00002000:00010000:0.0:1787826391.648837:0:8605:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb atime: 0 -> 1787826391 00002000:00010000:0.0:1787826391.648840:0:8605:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb ctime: 0 -> 1787826391 00002000:00010000:0.0:1787826391.648842:0:8605:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1787826391.648885:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a1070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778693760:192.168.203.9@tcp:106: 00010000:00010000:0.0:1787826391.648912:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004570ab88/0x68019081f349cf17 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcb17 expref: 7 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.648935:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004570ab88/0x68019081f349cf17 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcb17 expref: 7 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.648944:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204600, rc 0) 00000100:00100000:0.0:1787826391.648979:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789922816:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 16862us (17034us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826391.648987:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6386 00000100:00100000:3.0:1787826391.657843:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.657963:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789923200 00000100:00100000:2.0:1787826391.657973:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789923200 00000100:00100000:2.0:1787826391.658029:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111785 00000100:00100000:2.0:1787826391.658038:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+45:86729:x1874668789923200:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.658056:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.658076:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349cf48 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcce5 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658137:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658151:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658162:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658174:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658181:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658188:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658254:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f349cf5d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x135:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658262:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f349cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658269:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f349cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.658308:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x135:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.658312:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.658331:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f349cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658342:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f349cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658352:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658358:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658369:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658375:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658381:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.658385:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658392:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658403:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.658405:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.658409:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658414:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349cf4f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658426:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658431:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658436:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658440:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.658443:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658448:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658454:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9b50d0cc (ffff9bbe0bd66c00) 00010000:00010000:2.0:1787826391.658456:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.658458:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658463:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea600/0x68019081f349cf56 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658485:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349cf48 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcce5 expref: 47 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658497:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb200/0x68019081f349cf5d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcce5 expref: 46 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.658503:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x135:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:2.0:1787826391.658505:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.658507:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb200, rc 0) 00000100:00100000:2.0:1787826391.658570:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+46:86729:x1874668789923200:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 532us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.658577:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111785 00000100:00100000:2.0:1787826391.665311:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.665398:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789923328 00000100:00100000:3.0:1787826391.665408:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789923328 00000100:00100000:3.0:1787826391.665472:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6387 00000100:00100000:3.0:1787826391.665482:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789923328:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.665499:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.665517:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349cf64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fccec expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.665571:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb59680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778693888:192.168.203.9@tcp:106: 00000100:00100000:3.0:1787826391.665657:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170840 going to sleep for 11 seconds 00002000:00010000:1.0:1787826391.679969:0:19335:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826391.679980:0:19335:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb mtime: 0 -> 1787826389 00002000:00010000:1.0:1787826391.679982:0:19335:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb atime: 0 -> 1787826389 00002000:00010000:1.0:1787826391.679984:0:19335:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb ctime: 0 -> 1787826389 00002000:00010000:1.0:1787826391.679986:0:19335:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826391.680007:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb59680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19335:1874668778693888:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826391.680041:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349cf64 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fccec expref: 10 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.680066:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349cf64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fccec expref: 10 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.680079:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606e00, rc 0) 00000100:00100000:1.0:1787826391.680141:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789923328:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 14659us (14839us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826391.680153:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6387 00000100:00100000:2.0:1787826391.684729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.684885:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789923456 00000100:00100000:1.0:1787826391.684894:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789923456 00000100:00100000:1.0:1787826391.684942:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6388 00000100:00100000:1.0:1787826391.684952:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668789923456:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826391.684967:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.684985:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349cf6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fccf3 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.685042:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778694016:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826391.685120:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5480 going to sleep for 11 seconds 00002000:00010000:1.0:1787826391.687304:0:25038:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xd3:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826391.687313:0:25038:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xd3:0x0] updating lvb mtime: 0 -> 1787826391 00002000:00010000:1.0:1787826391.687315:0:25038:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xd3:0x0] updating lvb atime: 0 -> 1787826391 00002000:00010000:1.0:1787826391.687317:0:25038:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xd3:0x0] updating lvb ctime: 0 -> 1787826391 00002000:00010000:1.0:1787826391.687319:0:25038:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xd3:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826391.687339:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778694016:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826391.687370:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349cf6b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fccf3 expref: 10 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.687394:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349cf6b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fccf3 expref: 10 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.687407:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826391.687459:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668789923456:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2508us (2739us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826391.687468:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6388 00000100:00100000:3.0:1787826391.695247:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.695333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.695482:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789923712 00000100:00100000:1.0:1787826391.695490:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789923712 00000100:00100000:1.0:1787826391.695548:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3475 00000100:00100000:1.0:1787826391.695557:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+46:2400:x1874668789923712:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826391.695587:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.695610:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf72 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd01 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695657:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695675:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695685:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695708:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695715:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695721:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695758:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695768:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695775:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695790:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993cc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.695795:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695802:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695813:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.695815:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.695819:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695824:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349cf79 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695837:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695842:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695847:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695978:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.695982:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695989:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.695998:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x74d4d563 (ffff9bbe16e56600) 00010000:00010000:1.0:1787826391.696000:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.696003:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.696009:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c600/0x68019081f349cf80 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x74d4d563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.696038:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf72 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd01 expref: 47 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.696048:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.696050:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826391.696054:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349cf72 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd01 expref: 47 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.696062:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c800, rc -2) 00000100:00100000:2.0:1787826391.696439:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789923584 00000100:00100000:2.0:1787826391.696445:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789923584 00000100:00100000:2.0:1787826391.696493:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111786 00000100:00100000:2.0:1787826391.696503:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+47:86729:x1874668789923584:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.696514:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.696527:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349cf87 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fccfa expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696566:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696575:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696583:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696593:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696598:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696604:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696659:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f349cf9c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x136:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696680:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f349cf9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x136:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696687:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f349cf9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x136:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.696740:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x136:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.696744:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.696761:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f349cf9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x136:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696771:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f349cf9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x136:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696778:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696794:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696799:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696804:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.696807:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696813:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696821:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.696824:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.696828:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696834:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cf8e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696849:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696883:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696888:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696893:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.696896:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696900:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696907:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x7a94fdef (ffff9bbe0bd66600) 00010000:00010000:2.0:1787826391.696909:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.696912:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696917:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cf95 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696938:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349cf87 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fccfa expref: 49 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696949:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea200/0x68019081f349cf9c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x136:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fccfa expref: 48 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.696960:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x136:0x0].0x0 (ffff9bbe0bd66200) 00010000:00010000:2.0:1787826391.696962:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.696965:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09cea200, rc 0) 00000100:00100000:2.0:1787826391.697027:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:86729:x1874668789923584:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 527us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.697034:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111786 00000100:00100000:2.0:1787826391.700293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.703012:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+47:2400:x1874668789923712:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 7445us (7667us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826391.703028:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3475 00000100:00100000:1.0:1787826391.704507:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789923840 00000100:00100000:1.0:1787826391.704519:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789923840 00000100:00100000:2.0:1787826391.709387:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6389 00000100:00100000:2.0:1787826391.709400:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789923840:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.709418:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.709435:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078e282c3/0x68019081f349cfa3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd08 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826391.709497:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17084b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778694144:192.168.203.9@tcp:106: 00000100:00100000:2.0:1787826391.709653:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d180 going to sleep for 11 seconds 00002000:00010000:1.0:1787826391.721844:0:8433:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826391.721867:0:8433:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb mtime: 0 -> 1787826389 00002000:00010000:1.0:1787826391.721869:0:8433:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb atime: 0 -> 1787826389 00002000:00010000:1.0:1787826391.721871:0:8433:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb ctime: 0 -> 1787826389 00002000:00010000:1.0:1787826391.721873:0:8433:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826391.721894:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17084b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778694144:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826391.721930:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078e282c3/0x68019081f349cfa3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd08 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.721953:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078e282c3/0x68019081f349cfa3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd08 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.721966:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceae00, rc 0) 00000100:00100000:0.0:1787826391.722120:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789923840:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 12719us (21832us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826391.722130:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6389 00000100:00100000:3.0:1787826391.725524:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.725764:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789923968 00000100:00100000:0.0:1787826391.725772:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789923968 00000100:00100000:0.0:1787826391.725834:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111787 00000100:00100000:0.0:1787826391.725844:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+47:86729:x1874668789923968:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826391.725884:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.725906:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349cfaa lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd0f expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.725968:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.725983:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.725994:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726005:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726011:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726170:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726313:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205e00/0x68019081f349cfbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x137:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726322:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205e00/0x68019081f349cfbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x137:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726328:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205e00/0x68019081f349cfbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x137:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826391.726376:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x137:0x0]: returning size 1516 00000004:00200000:0.0:1787826391.726380:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826391.726400:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205e00/0x68019081f349cfbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x137:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726411:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205e00/0x68019081f349cfbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x137:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726420:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726430:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726435:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726442:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726447:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826391.726451:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726459:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726469:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:0.0:1787826391.726472:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826391.726476:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726482:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349cfb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726496:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726502:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726507:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726512:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826391.726515:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726520:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726528:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x59d92b11 (ffff9bbe12dd8900) 00010000:00010000:0.0:1787826391.726531:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826391.726534:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726539:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349cfb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726564:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349cfaa lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd0f expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726577:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205e00/0x68019081f349cfbf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x137:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd0f expref: 48 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.726584:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x137:0x0].0x0 (ffff9bbe12dd8e00) 00010000:00010000:0.0:1787826391.726586:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826391.726589:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205e00, rc 0) 00000100:00100000:0.0:1787826391.726658:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+48:86729:x1874668789923968:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 815us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826391.728007:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111787 00000100:00100000:3.0:1787826391.729427:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.729599:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789924096 00000100:00100000:0.0:1787826391.729609:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789924096 00000100:00100000:0.0:1787826391.729657:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6390 00000100:00100000:0.0:1787826391.729765:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789924096:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826391.729791:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.729809:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349cfc6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd16 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826391.729887:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a1070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778694272:192.168.203.9@tcp:106: 00000100:00100000:0.0:1787826391.729967:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60c00 going to sleep for 11 seconds 00002000:00010000:0.0:1787826391.736213:0:8605:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xcb:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1787826391.736222:0:8605:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xcb:0x0] updating lvb mtime: 0 -> 1787826389 00002000:00010000:0.0:1787826391.736224:0:8605:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xcb:0x0] updating lvb atime: 0 -> 1787826389 00002000:00010000:0.0:1787826391.736226:0:8605:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xcb:0x0] updating lvb ctime: 0 -> 1787826389 00002000:00010000:0.0:1787826391.736228:0:8605:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xcb:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1787826391.736251:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a1070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778694272:192.168.203.9@tcp:106: 00010000:00010000:0.0:1787826391.736287:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349cfc6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd16 expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.736312:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349cfc6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd16 expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.736325:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205400, rc 0) 00000100:00100000:0.0:1787826391.736390:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789924096:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 6628us (6967us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826391.736398:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6390 00000100:00100000:3.0:1787826391.739554:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.739822:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789924224 00000100:00100000:2.0:1787826391.739830:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789924224 00000100:00100000:2.0:1787826391.739928:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111788 00000100:00100000:2.0:1787826391.739938:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:86729:x1874668789924224:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.739958:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.739977:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cfcd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd1d expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740073:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740088:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740099:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740110:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740117:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740123:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740202:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f349cfe2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x138:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740440:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f349cfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x138:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740448:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f349cfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x138:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.740495:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x138:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.740500:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.740518:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f349cfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x138:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740529:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f349cfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740542:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740548:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740553:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740560:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740566:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.740570:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740583:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740595:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.740598:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.740602:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.740608:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349cfd4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741202:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741212:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741219:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741226:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cebe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.741229:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741236:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741247:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe12dd8a00) 00010000:00010000:2.0:1787826391.741250:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.741253:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741258:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349cfdb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741303:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349cfcd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd1d expref: 50 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741319:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea000/0x68019081f349cfe2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd1d expref: 49 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.741326:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x138:0x0].0x0 (ffff9bbe12dd8300) 00010000:00010000:2.0:1787826391.741328:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.741330:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09cea000, rc 0) 00000100:00100000:2.0:1787826391.741804:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+49:86729:x1874668789924224:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1865us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.741897:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111788 00000100:00100000:3.0:1787826391.747407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.752251:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789924352 00000100:00100000:1.0:1787826391.752280:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789924352 00000100:00100000:1.0:1787826391.752352:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6391 00000100:00100000:1.0:1787826391.752363:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789924352:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826391.752382:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.752401:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349cfe9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd24 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.752460:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778694400:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826391.752547:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5480 going to sleep for 11 seconds 00002000:00010000:3.0:1787826391.755617:0:19335:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xcb:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1787826391.755740:0:19335:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xcb:0x0] updating lvb mtime: 0 -> 1787826389 00002000:00010000:3.0:1787826391.755742:0:19335:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xcb:0x0] updating lvb atime: 0 -> 1787826389 00002000:00010000:3.0:1787826391.755744:0:19335:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xcb:0x0] updating lvb ctime: 0 -> 1787826389 00002000:00010000:3.0:1787826391.755745:0:19335:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xcb:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1787826391.755768:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778694400:192.168.203.9@tcp:106: 00010000:00010000:3.0:1787826391.755813:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349cfe9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd24 expref: 7 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.755933:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349cfe9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd24 expref: 7 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.755947:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c600, rc 0) 00000100:00100000:3.0:1787826391.756315:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789924352:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 3953us (8917us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.756325:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6391 00000100:00100000:3.0:1787826391.761504:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.761839:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789924480 00000100:00100000:1.0:1787826391.761849:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789924480 00000100:00100000:1.0:1787826391.761956:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111789 00000100:00100000:1.0:1787826391.761967:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+49:86729:x1874668789924480:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826391.761986:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.762009:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cff0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd2b expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762075:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762088:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762099:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762110:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762117:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762123:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762189:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349d005 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x139:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762197:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349d005 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x139:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762205:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349d005 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x139:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826391.762241:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x139:0x0]: returning size 1516 00000004:00200000:1.0:1787826391.762246:0:45682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826391.762263:0:45682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349d005 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x139:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762277:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349d005 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762284:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762304:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762311:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762317:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.762321:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762329:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762340:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.762342:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.762347:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762353:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349cff7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762366:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762371:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762376:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762381:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.762384:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762389:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762396:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x18618557 (ffff9bbe12dd8000) 00010000:00010000:1.0:1787826391.762398:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.762401:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762406:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349cffe lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762432:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349cff0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd2b expref: 51 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762446:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c400/0x68019081f349d005 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd2b expref: 50 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.762452:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x139:0x0].0x0 (ffff9bbe12dd8500) 00010000:00010000:1.0:1787826391.762455:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826391.762457:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c400, rc 0) 00000100:00100000:1.0:1787826391.762524:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+50:86729:x1874668789924480:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 558us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826391.762534:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111789 00000100:00100000:1.0:1787826391.771328:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.771433:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789924608 00000100:00100000:0.0:1787826391.771442:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789924608 00000100:00100000:0.0:1787826391.771510:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6392 00000100:00100000:0.0:1787826391.771520:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3d8b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789924608:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826391.771536:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.771553:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d00c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd32 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826391.771613:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a1070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778694528:192.168.203.9@tcp:106: 00000100:00100000:0.0:1787826391.771735:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60c00 going to sleep for 11 seconds 00002000:00010000:0.0:1787826391.790843:0:25038:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1787826391.790890:0:25038:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb mtime: 0 -> 1787826389 00002000:00010000:0.0:1787826391.790893:0:25038:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb atime: 0 -> 1787826389 00002000:00010000:0.0:1787826391.790895:0:25038:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb ctime: 0 -> 1787826389 00002000:00010000:0.0:1787826391.790897:0:25038:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1787826391.790921:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a1070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778694528:192.168.203.9@tcp:106: 00010000:00010000:0.0:1787826391.791072:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d00c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd32 expref: 10 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.791101:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d00c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd32 expref: 10 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.791114:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205400, rc 0) 00000100:00100000:0.0:1787826391.791176:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3d8b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789924608:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 19657us (19858us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826391.791185:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6392 00000100:00100000:3.0:1787826391.798239:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826391.798340:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789924736 00000100:00100000:2.0:1787826391.798350:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789924736 00000100:00100000:2.0:1787826391.798410:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111790 00000100:00100000:2.0:1787826391.798421:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+50:86729:x1874668789924736:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826391.798440:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826391.798461:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d013 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd39 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798526:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798540:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798551:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798563:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798571:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798577:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798645:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349d028 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798658:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349d028 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798664:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349d028 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826391.798707:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13a:0x0]: returning size 1516 00000004:00200000:2.0:1787826391.798712:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826391.798730:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349d028 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798742:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349d028 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798752:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798758:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798764:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798771:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798777:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.798792:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798801:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798814:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826391.798817:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.798822:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798828:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d01a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798844:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798913:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798920:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798926:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826391.798929:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.798934:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.799073:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xf7a5b27a (ffff9bbe12dd8600) 00010000:00010000:2.0:1787826391.799076:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826391.799080:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.799085:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d021 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.799118:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d013 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd39 expref: 52 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.799133:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceae00/0x68019081f349d028 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd39 expref: 51 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.799141:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13a:0x0].0x0 (ffff9bbe12dd8100) 00010000:00010000:2.0:1787826391.799143:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826391.799145:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceae00, rc 0) 00000100:00100000:2.0:1787826391.799301:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+51:86729:x1874668789924736:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 881us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.799310:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111790 00000100:00100000:1.0:1787826391.809304:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.809431:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789924864 00000100:00100000:0.0:1787826391.809442:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789924864 00000100:00100000:0.0:1787826391.809500:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6393 00000100:00100000:0.0:1787826391.809508:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789924864:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826391.809525:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.809540:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004570ab88/0x68019081f349d02f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd40 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826391.809602:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a105a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778694656:192.168.203.9@tcp:106: 00000100:00100000:0.0:1787826391.809680:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60c00 going to sleep for 11 seconds 00002000:00010000:2.0:1787826391.812875:0:8433:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb size: 0 -> 1516 00002000:00010000:2.0:1787826391.812885:0:8433:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb mtime: 0 -> 1787826389 00002000:00010000:2.0:1787826391.812887:0:8433:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb atime: 0 -> 1787826389 00002000:00010000:2.0:1787826391.812890:0:8433:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb ctime: 0 -> 1787826389 00002000:00010000:2.0:1787826391.812892:0:8433:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1787826391.812923:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a105a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778694656:192.168.203.9@tcp:106: 00010000:00010000:2.0:1787826391.812961:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004570ab88/0x68019081f349d02f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd40 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.812985:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004570ab88/0x68019081f349d02f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd40 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826391.812998:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204600, rc 0) 00000100:00100000:2.0:1787826391.813062:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789924864:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 3554us (3767us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826391.813071:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6393 00000100:00100000:3.0:1787826391.821059:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.823337:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789924992 00000100:00100000:1.0:1787826391.823351:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789924992 00000100:00100000:1.0:1787826391.823415:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111791 00000100:00100000:1.0:1787826391.823425:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+51:86729:x1874668789924992:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826391.823445:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.823468:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349d036 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd47 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823529:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823542:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823553:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823564:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823571:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823577:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823645:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c000/0x68019081f349d04b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823655:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c000/0x68019081f349d04b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823661:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c000/0x68019081f349d04b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826391.823698:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13b:0x0]: returning size 1516 00000004:00200000:1.0:1787826391.823702:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826391.823720:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c000/0x68019081f349d04b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823731:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c000/0x68019081f349d04b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823738:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823744:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823750:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823756:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.823760:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823768:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823788:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.823793:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.823798:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823804:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d200/0x68019081f349d03d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823819:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823825:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823830:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823835:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993ce00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.823838:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823843:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823876:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd6e9df9d (ffff9bbe0bd66300) 00010000:00010000:1.0:1787826391.823879:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.823882:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823888:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993ce00/0x68019081f349d044 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.823927:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d000/0x68019081f349d036 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd47 expref: 53 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.824066:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c000/0x68019081f349d04b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd47 expref: 52 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.824075:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13b:0x0].0x0 (ffff9bbe12458400) 00010000:00010000:1.0:1787826391.824078:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826391.824080:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c000, rc 0) 00000100:00100000:1.0:1787826391.824154:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+52:86729:x1874668789924992:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 729us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826391.824161:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111791 00000100:00100000:1.0:1787826391.828102:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826391.828222:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789925120 00000100:00100000:0.0:1787826391.828238:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789925120 00000100:00100000:0.0:1787826391.828297:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6394 00000100:00100000:0.0:1787826391.828307:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789925120:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826391.828322:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826391.828340:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d052 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd4e expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826391.828397:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a1070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778694784:192.168.203.9@tcp:106: 00000100:00100000:0.0:1787826391.828476:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60000 going to sleep for 11 seconds 00002000:00010000:0.0:1787826391.831090:0:8605:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xcd:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1787826391.831098:0:8605:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xcd:0x0] updating lvb mtime: 0 -> 1787826389 00002000:00010000:0.0:1787826391.831101:0:8605:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xcd:0x0] updating lvb atime: 0 -> 1787826389 00002000:00010000:0.0:1787826391.831103:0:8605:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xcd:0x0] updating lvb ctime: 0 -> 1787826389 00002000:00010000:0.0:1787826391.831106:0:8605:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xcd:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1787826391.831126:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a1070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778694784:192.168.203.9@tcp:106: 00010000:00010000:0.0:1787826391.831158:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d052 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd4e expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.831197:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d052 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd4e expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.831212:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204400, rc 0) 00000100:00100000:0.0:1787826391.831285:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789925120:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2979us (3191us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826391.831295:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6394 00000100:00100000:3.0:1787826391.835552:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.835627:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789925248 00000100:00100000:1.0:1787826391.835635:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789925248 00000100:00100000:1.0:1787826391.835696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111792 00000100:00100000:1.0:1787826391.835711:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+52:86729:x1874668789925248:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826391.835729:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.835748:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d059 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd55 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.835834:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.835847:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.835881:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.835897:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.835904:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.835911:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.835975:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349d06e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.835983:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349d06e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.835990:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349d06e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826391.836028:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13c:0x0]: returning size 1516 00000004:00200000:1.0:1787826391.836033:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826391.836050:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349d06e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836060:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349d06e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836069:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836075:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836085:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836091:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836096:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993da00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.836101:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836108:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836118:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826391.836121:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.836126:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836132:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d060 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836145:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836151:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836156:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836161:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826391.836165:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836170:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836177:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xb62e0cbf (ffff9bbe12458f00) 00010000:00010000:1.0:1787826391.836179:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826391.836182:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836188:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d067 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836213:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d059 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd55 expref: 54 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836226:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c200/0x68019081f349d06e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd55 expref: 53 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826391.836233:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13c:0x0].0x0 (ffff9bbe12458500) 00010000:00010000:1.0:1787826391.836235:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826391.836237:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c200, rc 0) 00000100:00100000:1.0:1787826391.836298:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+53:86729:x1874668789925248:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 587us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826391.836306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111792 00000100:00100000:1.0:1787826391.842065:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826391.850051:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789925376 00000100:00100000:3.0:1787826391.850065:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789925376 00000100:00100000:3.0:1787826391.850137:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6395 00000100:00100000:3.0:1787826391.850147:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789925376:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826391.850163:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826391.850182:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349d075 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd5c expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826391.850240:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778694912:192.168.203.9@tcp:106: 00000100:00100000:3.0:1787826391.850324:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170f00 going to sleep for 11 seconds 00002000:00010000:3.0:1787826391.854239:0:19335:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1787826391.854249:0:19335:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb mtime: 0 -> 1787826389 00002000:00010000:3.0:1787826391.854251:0:19335:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb atime: 0 -> 1787826389 00002000:00010000:3.0:1787826391.854253:0:19335:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb ctime: 0 -> 1787826389 00002000:00010000:3.0:1787826391.854255:0:19335:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1787826391.854279:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778694912:192.168.203.9@tcp:106: 00010000:00010000:3.0:1787826391.854315:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349d075 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd5c expref: 7 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.854339:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be55388a/0x68019081f349d075 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd5c expref: 7 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826391.854352:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:3.0:1787826391.854416:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789925376:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 4270us (12359us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826391.854425:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6395 00000100:00100000:0.0:1787826391.866672:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.867062:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789925504 00000100:00100000:1.0:1787826391.867072:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789925504 00000100:00100000:1.0:1787826391.867130:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6396 00000100:00100000:1.0:1787826391.867140:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789925504:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826391.867157:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826391.867184:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002318c342/0x68019081f349d07c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd63 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826391.867240:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778695040:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826391.867324:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826391.874518:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778695040:192.168.203.9@tcp:106: 00010000:00010000:0.0:1787826391.874557:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002318c342/0x68019081f349d07c lrc: 1/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd63 expref: 7 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.874580:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002318c342/0x68019081f349d07c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd63 expref: 7 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826391.874593:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d800, rc 0) 00000100:00100000:0.0:1787826391.874657:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789925504:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 7518us (7994us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826391.874675:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6396 00000100:00100000:2.0:1787826391.885090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826391.885894:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789925760 00000100:00100000:1.0:1787826391.885905:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789925760 00000100:00100000:1.0:1787826391.885969:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111793 00000100:00100000:1.0:1787826391.885978:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+53:86729:x1874668789925760:12345-192.168.203.9@tcp:58:lfs.0 00000040:00080000:1.0:1787826391.886151:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9704, 136 off1311400 00000040:00080000:1.0:1787826391.886199:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9705, 136 off1311536 00000040:00080000:1.0:1787826391.886232:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9706, 136 off1311672 00000040:00080000:1.0:1787826391.886263:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9707, 136 off1311808 00000040:00080000:1.0:1787826391.886294:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9708, 136 off1311944 00000040:00080000:1.0:1787826391.886328:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9709, 136 off1312080 00000040:00080000:1.0:1787826391.886359:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9710, 136 off1312216 00000040:00080000:1.0:1787826391.886389:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9711, 136 off1312352 00000040:00080000:1.0:1787826391.886420:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9712, 136 off1312488 00000040:00080000:1.0:1787826391.886453:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9713, 136 off1312624 00000040:00080000:1.0:1787826391.886481:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9714, 136 off1312760 00000040:00080000:1.0:1787826391.886511:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9715, 136 off1312896 00000040:00080000:1.0:1787826391.886545:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9716, 136 off1313032 00000040:00080000:1.0:1787826391.886573:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9717, 136 off1313168 00000040:00080000:1.0:1787826391.886601:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9718, 136 off1313304 00000040:00080000:1.0:1787826391.886631:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9719, 136 off1313440 00000040:00080000:1.0:1787826391.886660:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9720, 136 off1313576 00000040:00080000:0.0:1787826391.897380:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9721, 136 off1313712 00000040:00080000:0.0:1787826391.897467:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9722, 136 off1313848 00000040:00080000:0.0:1787826391.897499:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9723, 136 off1313984 00000100:00100000:0.0:1787826391.897577:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+53:86729:x1874668789925760:12345-192.168.203.9@tcp:58:lfs.0 Request processed in 11595us (12491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826391.897592:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111793 00010000:00010000:0.0:1787826391.936724:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787826392.066009:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826392.066019:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826392.066232:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9707 count 21 00000040:00080000:3.0:1787826392.066240:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826392.066512:0:58431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778695168:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826392.066603:0:58431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826392.078640:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.078721:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789925888 00000100:00100000:0.0:1787826392.078731:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789925888 00000100:00100000:0.0:1787826392.078801:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111794 00000100:00100000:0.0:1787826392.078810:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+109:86741:x1874668789925888:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826392.078841:0:45683:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x134:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826392.078989:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+109:86741:x1874668789925888:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 180us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.078996:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111794 00000100:00100000:3.0:1787826392.079677:0:58431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778695168:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826392.082694:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.082733:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.082810:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789926016 00000100:00100000:2.0:1787826392.082819:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789926016 00000100:00100000:2.0:1787826392.082899:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789926144 00000100:00100000:2.0:1787826392.082902:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789926144 00000100:00100000:2.0:1787826392.082941:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111795 00000100:00100000:2.0:1787826392.082950:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+109:86743:x1874668789926016:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826392.082980:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x13e:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826392.083093:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+109:86743:x1874668789926016:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 145us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.083100:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111795 00000100:00100000:2.0:1787826392.083119:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111796 00000100:00100000:2.0:1787826392.083125:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+108:86742:x1874668789926144:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826392.083137:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x13d:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826392.083188:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+108:86742:x1874668789926144:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 63us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.083195:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111796 00000100:00100000:0.0:1787826392.093459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.093490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.093517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.093547:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789926528 00000100:00100000:0.0:1787826392.093555:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789926528 00000100:00100000:0.0:1787826392.093600:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111797 00000100:00100000:0.0:1787826392.093610:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+108:86742:x1874668789926528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.093629:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.093648:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d083 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.093757:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d08a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.093772:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d08a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.093798:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d08a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826392.093808:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13d:0x0]: returning size 1516 00010000:00010000:0.0:1787826392.093927:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d083 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd71 expref: 111 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.093945:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d08a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd71 expref: 110 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.093953:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13d:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:0.0:1787826392.093956:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826392.093960:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205600, rc 0) 00000100:00100000:0.0:1787826392.094016:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+110:86742:x1874668789926528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 408us (567us total) trans 8590016761 rc 0/0 00000100:00100000:0.0:1787826392.094024:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111797 00000100:00100000:0.0:1787826392.094041:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789926656 00000100:00100000:0.0:1787826392.094045:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789926656 00000100:00100000:0.0:1787826392.094064:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789926912 00000100:00100000:0.0:1787826392.094068:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789926912 00000100:00100000:0.0:1787826392.094089:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111798 00000100:00100000:0.0:1787826392.094095:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86743:x1874668789926656:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.094104:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.094112:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d098 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd6a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094156:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d09f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094166:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d09f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094187:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d09f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826392.094196:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13e:0x0]: returning size 1516 00010000:00010000:0.0:1787826392.094244:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d098 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd6a expref: 114 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094257:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d09f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd6a expref: 113 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094264:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13e:0x0].0x0 (ffff9bbe12458700) 00010000:00010000:0.0:1787826392.094266:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826392.094269:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204000, rc 0) 00000100:00100000:0.0:1787826392.094291:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+113:86743:x1874668789926656:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 196us (801us total) trans 8590016762 rc 0/0 00000100:00100000:0.0:1787826392.094298:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111798 00000100:00100000:0.0:1787826392.094314:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111799 00000100:00100000:0.0:1787826392.094322:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+112:86741:x1874668789926912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.094329:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.094337:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d0ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd78 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094374:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d0b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x134:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094383:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094390:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826392.094398:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x134:0x0]: returning size 1516 00010000:00010000:0.0:1787826392.094441:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d0ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd78 expref: 115 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094454:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd78 expref: 114 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.094461:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x134:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:0.0:1787826392.094463:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826392.094465:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204600, rc 0) 00000100:00100000:0.0:1787826392.094485:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+114:86741:x1874668789926912:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 164us (967us total) trans 8590016763 rc 0/0 00000100:00100000:0.0:1787826392.094491:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111799 00000100:00100000:2.0:1787826392.098559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.098607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.098687:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789927168 00000100:00100000:3.0:1787826392.098704:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789927168 00000100:00100000:3.0:1787826392.098771:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17289 00000100:00100000:3.0:1787826392.098914:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+114:2399:x1874668789927168:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.098942:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.098967:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d09f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd6a expref: 114 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.098984:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13e:0x0].0x0 (ffff9bbe12458700) 00010000:00010000:3.0:1787826392.098989:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.099042:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+113:2399:x1874668789927168:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 263us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.099049:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17289 00000100:00100000:0.0:1787826392.099220:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789927040 00000100:00100000:0.0:1787826392.099224:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789927040 00000100:00100000:0.0:1787826392.099262:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6397 00000100:00100000:0.0:1787826392.099270:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2399:x1874668789927040:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.099302:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.099320:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 21 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.099329:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xce:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787826392.099334:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.099338:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.099368:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 21 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.099383:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 21 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.099397:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a104b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778695296:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826392.099449:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826392.103463:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.103760:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789927296 00000100:00100000:3.0:1787826392.103768:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789927296 00000100:00100000:3.0:1787826392.103834:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6398 00000100:00100000:3.0:1787826392.103844:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789927296:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.103906:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.103926:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 18 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.103936:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xce:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787826392.103940:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826392.103945:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.103980:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 18 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.103993:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 18 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.104009:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a31c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778695424:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826392.104082:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.104136:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.104215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.104254:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789927424 00000100:00100000:3.0:1787826392.104257:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789927424 00000100:00100000:3.0:1787826392.104291:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17290 00000100:00100000:3.0:1787826392.104298:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+113:2400:x1874668789927424:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.104310:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.104329:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d08a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd71 expref: 113 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.104346:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13d:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:3.0:1787826392.104352:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.104381:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+112:2400:x1874668789927424:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.104389:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17290 00000100:00100000:3.0:1787826392.104475:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a104b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778695296:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826392.104493:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.104527:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789927552 00000100:00100000:3.0:1787826392.104531:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789927552 00002000:00100000:3.0:1787826392.104557:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xce:0x0] (0->1515) req@ffff9bbe0a31f480 x1874668789927552/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.104568:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a31f480 with x1874668789927552 ext(0->1515) 00010000:00010000:3.0:1787826392.104574:0:26215:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 22 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.104584:0:26215:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 22 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.104591:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe0a31f480 00000100:00100000:3.0:1787826392.104609:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 49 00000100:00100000:3.0:1787826392.104617:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2401:x1874668789927552:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:3.0:1787826392.109683:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789927552:12345-192.168.203.9@tcp:4:cp.0 Request processed in 5056us (5456us total) trans 4294968202 rc 0/0 00000100:00100000:3.0:1787826392.109708:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 49 00002000:00100000:3.0:1787826392.109722:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xce:0x0] (0->1515) req@ffff9bbe0a31f480 x1874668789927552/t4294968202(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.109732:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a31f480 with x1874668789927552 ext(0->1515) 00010000:00010000:3.0:1787826392.109742:0:26215:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 24 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.109759:0:26215:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 24 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.109766:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe0a31f480 00000100:00100000:0.0:1787826392.111155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.111256:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.111304:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789927680 00000100:00100000:0.0:1787826392.111311:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789927680 00000100:00100000:0.0:1787826392.111360:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17291 00000100:00100000:0.0:1787826392.111369:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+112:2402:x1874668789927680:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826392.111383:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826392.111407:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d0b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd78 expref: 112 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.111424:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x134:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:0.0:1787826392.111429:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826392.111465:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+111:2402:x1874668789927680:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 98us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.111472:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17291 00000100:00100000:1.0:1787826392.111585:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789927808 00000100:00100000:1.0:1787826392.111589:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789927808 00002000:00100000:1.0:1787826392.111621:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xce:0x0] (0->1515) req@ffff9bbe0a105a40 x1874668789927808/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826392.111632:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a105a40 with x1874668789927808 ext(0->1515) 00010000:00010000:1.0:1787826392.111640:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 19 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.111653:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 19 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826392.111660:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0a105a40 00000100:00100000:1.0:1787826392.111680:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:1.0:1787826392.111687:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2401:x1874668789927808:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:2.0:1787826392.113024:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a31c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778695424:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826392.113051:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.113501:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789927808:12345-192.168.203.9@tcp:4:cp.0 Request processed in 1812us (2243us total) trans 4294968187 rc 0/0 00000100:00100000:1.0:1787826392.113511:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 50 00002000:00100000:1.0:1787826392.113522:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xce:0x0] (0->1515) req@ffff9bbe0a105a40 x1874668789927808/t4294968187(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826392.113531:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a105a40 with x1874668789927808 ext(0->1515) 00010000:00010000:1.0:1787826392.113538:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 21 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.113548:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 21 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826392.113560:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0a105a40 00000100:00100000:1.0:1787826392.117377:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.117487:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789927936 00000100:00100000:2.0:1787826392.117497:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789927936 00000100:00100000:2.0:1787826392.117553:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6399 00000100:00100000:2.0:1787826392.117564:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789927936:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.117606:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.117628:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 24 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.117637:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc9:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1787826392.117641:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826392.117646:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.117685:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 24 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.117710:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 24 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.117723:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778695552:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826392.117802:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826392.119530:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.119808:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789928064 00000100:00100000:1.0:1787826392.119816:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789928064 00010000:00010000:1.0:1787826392.119849:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 25 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.119910:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3127 00000100:00100000:1.0:1787826392.119919:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789928064:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826392.119933:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826392.119950:0:45686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xce:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:1.0:1787826392.119957:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 25 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.119970:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 25 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.119992:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349c6f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ad expref: 25 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.120008:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.120012:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.120018:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.120033:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.120060:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826392.120104:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789928064:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 187us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.120111:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3127 00010000:00010000:3.0:1787826392.120739:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.120751:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.120772:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.120789:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.120796:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.120803:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.120807:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.120815:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.120831:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.120894:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda338e9/0x68019081f349d0c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.120951:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789927040:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 21681us (22402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.120960:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6397 00000100:00100000:3.0:1787826392.122621:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.122756:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.122818:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789928448 00000100:00100000:3.0:1787826392.122825:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789928448 00000100:00100000:3.0:1787826392.122924:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111800 00000100:00100000:3.0:1787826392.122933:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86743:x1874668789928448:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.123021:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86743:x1874668789928448:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.123029:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111800 00000100:00100000:3.0:1787826392.123071:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778695552:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826392.123095:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.123263:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789928192 00000100:00100000:0.0:1787826392.123268:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789928192 00010000:00010000:0.0:1787826392.123293:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 21 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.123318:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3128 00000100:00100000:0.0:1787826392.123325:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789928192:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826392.123335:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787826392.123351:0:15760:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xce:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:0.0:1787826392.123357:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 21 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123368:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 21 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123386:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349c62d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc536 expref: 21 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123400:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.123404:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.123409:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123425:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123447:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826392.123469:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2401:x1874668789928192:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 145us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.123475:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3128 00010000:00010000:0.0:1787826392.123493:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123501:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123518:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123526:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123533:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123540:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826392.123543:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123556:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123567:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.123574:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.123612:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2402:x1874668789927296:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 19770us (20159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.123621:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6398 00000100:00100000:0.0:1787826392.124957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.125194:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789928576 00000100:00100000:3.0:1787826392.125201:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789928576 00002000:00100000:3.0:1787826392.125241:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc9:0x0] (0->1515) req@ffff9bbf410ee940 x1874668789928576/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.125252:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf410ee940 with x1874668789928576 ext(0->1515) 00010000:00010000:3.0:1787826392.125260:0:14373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 23 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.125276:0:14373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 23 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.125283:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbf410ee940 00000100:00100000:3.0:1787826392.125314:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:3.0:1787826392.125323:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789928576:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:3.0:1787826392.126225:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789928576:12345-192.168.203.9@tcp:4:cp.0 Request processed in 898us (1268us total) trans 4294968203 rc 0/0 00000100:00100000:3.0:1787826392.126235:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 51 00002000:00100000:3.0:1787826392.126244:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc9:0x0] (0->1515) req@ffff9bbf410ee940 x1874668789928576/t4294968203(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.126254:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf410ee940 with x1874668789928576 ext(0->1515) 00010000:00010000:3.0:1787826392.126262:0:14373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 25 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.126278:0:14373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 25 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.126285:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbf410ee940 00000100:00100000:3.0:1787826392.127057:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.127537:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789928704 00000100:00100000:1.0:1787826392.127545:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789928704 00000100:00100000:1.0:1787826392.127591:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6400 00000100:00100000:1.0:1787826392.127600:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789928704:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.127616:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826392.127636:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4943089/0x68019081f349d0d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd7f expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826392.127671:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xce:0x0] initial LVB size: 1516, mtime: 0x6a9010d6, atime: 0x0, ctime: 0x6a9010d6, blocks: 0x8 00010000:00010000:1.0:1787826392.127690:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:1.0:1787826392.127695:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.127705:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4943089/0x68019081f349d0d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd7f expref: 26 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.127721:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4943089/0x68019081f349d0d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd7f expref: 26 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.127733:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993ce00, rc 0) 00000100:00100000:1.0:1787826392.127792:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789928704:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 193us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.127800:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6400 00000100:00100000:3.0:1787826392.135524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.135584:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789929088 00000100:00100000:2.0:1787826392.135592:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789929088 00000100:00100000:2.0:1787826392.135642:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111801 00000100:00100000:2.0:1787826392.135651:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86743:x1874668789929088:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.135748:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86743:x1874668789929088:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.135755:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111801 00000100:00100000:0.0:1787826392.147535:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.147581:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.147650:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789928832 00000100:00100000:3.0:1787826392.147660:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789928832 00010000:00010000:3.0:1787826392.147712:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 26 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.147757:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3129 00000100:00100000:3.0:1787826392.147767:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2399:x1874668789928832:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.147793:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787826392.147813:0:9521:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1787826392.147821:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 26 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.147835:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 26 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.147889:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b0090aa/0x68019081f349c05a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc288 expref: 26 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.147905:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826392.147909:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826392.147914:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.147924:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.147956:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.148005:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789928832:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 239us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.148012:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3129 00010000:00010000:0.0:1787826392.148167:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.148177:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.148202:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.148209:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.148217:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.148224:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceba00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826392.148228:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.148237:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.148248:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.148254:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009110481f/0x68019081f349d0d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.148314:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789927936:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 30753us (30948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.148322:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6399 00000100:00100000:1.0:1787826392.155356:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789929344 00000100:00100000:1.0:1787826392.155370:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789929344 00000100:00100000:1.0:1787826392.155434:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111802 00000100:00100000:1.0:1787826392.155444:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86742:x1874668789929344:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.155559:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86742:x1874668789929344:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 116us (7976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.155566:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111802 00000100:00100000:3.0:1787826392.155726:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.155888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.155946:0:45404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789929472 00000100:00100000:2.0:1787826392.155951:0:45404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789929472 00002000:00100000:2.0:1787826392.155981:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xce:0x0] (0->4095) req@ffff9bbe102dc000 x1874668789929472/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.155992:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe102dc000 with x1874668789929472 ext(0->4095) 00002000:00010000:2.0:1787826392.155997:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe102dc000 00000100:00100000:2.0:1787826392.156021:0:45404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1588 00000100:00100000:2.0:1787826392.156029:0:45404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789929472:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.156153:0:45404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789929472:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 125us (427us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787826392.156160:0:45404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1588 00002000:00100000:2.0:1787826392.156166:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xce:0x0] (0->4095) req@ffff9bbe102dc000 x1874668789929472/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.156185:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe102dc000 with x1874668789929472 ext(0->4095) 00002000:00010000:2.0:1787826392.156189:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe102dc000 00000100:00100000:1.0:1787826392.156880:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789929728 00000100:00100000:1.0:1787826392.156887:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789929728 00000100:00100000:1.0:1787826392.156922:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111803 00000100:00100000:1.0:1787826392.156929:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86741:x1874668789929728:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.156995:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86741:x1874668789929728:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 66us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.157002:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111803 00000100:00100000:3.0:1787826392.159520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.159591:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789929984 00000100:00100000:1.0:1787826392.159600:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789929984 00000100:00100000:1.0:1787826392.159646:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6401 00000100:00100000:1.0:1787826392.159655:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2399:x1874668789929984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.159677:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826392.159695:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae8db2d/0x68019081f349d0de lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd8d expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826392.159718:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc9:0x0] initial LVB size: 1516, mtime: 0x6a9010d4, atime: 0x0, ctime: 0x6a9010d4, blocks: 0x8 00010000:00010000:1.0:1787826392.159736:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:1.0:1787826392.159740:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.159749:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae8db2d/0x68019081f349d0de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd8d expref: 25 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.159767:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ae8db2d/0x68019081f349d0de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd8d expref: 25 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.159789:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d200, rc 0) 00000100:00100000:1.0:1787826392.159846:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789929984:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 192us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.159870:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6401 00000100:00100000:2.0:1787826392.160531:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.160588:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789929856 00000100:00100000:3.0:1787826392.160594:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789929856 00000100:00100000:3.0:1787826392.160632:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6402 00000100:00100000:3.0:1787826392.160639:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2401:x1874668789929856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.160650:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826392.160673:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd86 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.160693:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xce:0x0] initial LVB size: 1516, mtime: 0x6a9010d6, atime: 0x0, ctime: 0x6a9010d6, blocks: 0x8 00010000:00010000:3.0:1787826392.160706:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:3.0:1787826392.160710:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.160716:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd86 expref: 20 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.160729:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be55388a/0x68019081f349d0e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd86 expref: 20 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.160738:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607c00, rc 0) 00000100:00100000:3.0:1787826392.160789:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2401:x1874668789929856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 141us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.160795:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6402 00000100:00100000:2.0:1787826392.166706:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.166749:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.166833:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789930240 00000100:00100000:3.0:1787826392.166843:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789930240 00000100:00100000:3.0:1787826392.166913:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789930496 00000100:00100000:3.0:1787826392.166916:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789930496 00000100:00100000:3.0:1787826392.166938:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111804 00000100:00100000:3.0:1787826392.166947:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+112:86741:x1874668789930240:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.167043:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+112:86741:x1874668789930240:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 97us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.167051:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111804 00000100:00100000:3.0:1787826392.167082:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111805 00000100:00100000:3.0:1787826392.167090:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86742:x1874668789930496:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.167123:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86742:x1874668789930496:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 35us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.167129:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111805 00000100:00100000:1.0:1787826392.172219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.172441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789930624 00000100:00100000:2.0:1787826392.172452:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789930624 00000100:00100000:2.0:1787826392.172549:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111806 00000100:00100000:2.0:1787826392.172560:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+111:86743:x1874668789930624:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.172579:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.172599:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d0ec lrc: 2/0,0 mode: --/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd94 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.172633:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.172646:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.172668:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.173019:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d0ec lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd94 expref: 113 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.173039:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd94 expref: 112 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.173048:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13e:0x0].0x0 (ffff9bbe12458700) 00010000:00010000:2.0:1787826392.173051:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.173055:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb800, rc 0) 00000100:00100000:2.0:1787826392.173212:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+112:86743:x1874668789930624:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 654us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.173220:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111806 00000100:00100000:2.0:1787826392.176771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.177507:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789930880 00000100:00100000:3.0:1787826392.177517:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789930880 00002000:00100000:3.0:1787826392.177564:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xce:0x0] (0->4095) req@ffff9bbe17084b40 x1874668789930880/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.177575:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe17084b40 with x1874668789930880 ext(0->4095) 00002000:00010000:3.0:1787826392.177579:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe17084b40 00000100:00100000:3.0:1787826392.177656:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1589 00000100:00100000:3.0:1787826392.177666:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2400:x1874668789930880:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.177914:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2400:x1874668789930880:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 248us (1151us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826392.177922:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1589 00002000:00100000:3.0:1787826392.177929:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xce:0x0] (0->4095) req@ffff9bbe17084b40 x1874668789930880/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.177939:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe17084b40 with x1874668789930880 ext(0->4095) 00002000:00010000:3.0:1787826392.177942:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe17084b40 00000100:00100000:0.0:1787826392.184704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.184752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.184844:0:45397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789930752 00000100:00100000:3.0:1787826392.184887:0:45397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789930752 00002000:00100000:3.0:1787826392.184937:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xc9:0x0] (0->4095) req@ffff9bbe0e68c780 x1874668789930752/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.184949:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e68c780 with x1874668789930752 ext(0->4095) 00002000:00010000:3.0:1787826392.184954:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0e68c780 00000100:00100000:3.0:1787826392.184985:0:45397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1590 00000100:00100000:3.0:1787826392.184996:0:45397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789930752:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.185205:0:45397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789930752:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 210us (452us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826392.185214:0:45397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1590 00002000:00100000:3.0:1787826392.185221:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xc9:0x0] (0->4095) req@ffff9bbe0e68c780 x1874668789930752/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.185229:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e68c780 with x1874668789930752 ext(0->4095) 00002000:00010000:3.0:1787826392.185233:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0e68c780 00000100:00100000:1.0:1787826392.186388:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789931008 00000100:00100000:1.0:1787826392.186398:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789931008 00000100:00100000:1.0:1787826392.186490:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111807 00000100:00100000:1.0:1787826392.186499:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+112:86743:x1874668789931008:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826392.186525:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x13e:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826392.186647:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+112:86743:x1874668789931008:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 149us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.186654:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111807 00000100:00100000:0.0:1787826392.188669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.188798:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789931136 00000100:00100000:2.0:1787826392.188807:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789931136 00000100:00100000:2.0:1787826392.188879:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111808 00000100:00100000:2.0:1787826392.188889:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+112:86742:x1874668789931136:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.188906:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.188925:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d0fa lrc: 2/0,0 mode: --/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcd9b expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.188957:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.188969:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.188980:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.189085:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d0fa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd9b expref: 114 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.189103:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd9b expref: 113 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.189111:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13d:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:2.0:1787826392.189113:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.189117:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb600, rc 0) 00000100:00100000:2.0:1787826392.189189:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+113:86742:x1874668789931136:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 302us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.189196:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111808 00000100:00100000:3.0:1787826392.190700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.190793:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789931264 00000100:00100000:0.0:1787826392.190801:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789931264 00000100:00100000:0.0:1787826392.190879:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111809 00000100:00100000:0.0:1787826392.190889:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+113:86741:x1874668789931264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.190906:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.190923:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d108 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x134:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcda2 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.190954:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x134:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.190968:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.190978:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.191080:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d108 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda2 expref: 115 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.191099:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda2 expref: 114 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.191108:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x134:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:0.0:1787826392.191111:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826392.191115:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826392.191165:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+114:86741:x1874668789931264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 277us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.191182:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111809 00000100:00100000:3.0:1787826392.195263:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.195402:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789931392 00000100:00100000:1.0:1787826392.195412:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789931392 00000100:00100000:1.0:1787826392.195472:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6403 00000100:00100000:1.0:1787826392.195481:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789931392:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.195523:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.195541:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.195545:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.195551:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.195563:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.195587:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.195595:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.195602:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.195608:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826392.195613:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.195622:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.195637:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.195645:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d116 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.195733:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789931392:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 252us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.195741:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6403 00000100:00100000:3.0:1787826392.197151:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.197308:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789931520 00000100:00100000:2.0:1787826392.197315:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789931520 00000100:00100000:2.0:1787826392.197398:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111810 00000100:00100000:2.0:1787826392.197407:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+114:86742:x1874668789931520:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826392.197435:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x13d:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826392.197537:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+114:86742:x1874668789931520:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 131us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.197544:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111810 00000100:00100000:2.0:1787826392.199242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.199312:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789931648 00000100:00100000:3.0:1787826392.199320:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789931648 00000100:00100000:3.0:1787826392.199374:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111811 00000100:00100000:3.0:1787826392.199384:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+114:86741:x1874668789931648:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826392.199409:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x134:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826392.199511:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+114:86741:x1874668789931648:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 128us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.199519:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111811 00000100:00100000:3.0:1787826392.202541:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.202622:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789931904 00000100:00100000:2.0:1787826392.202630:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789931904 00000100:00100000:2.0:1787826392.202681:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111812 00000100:00100000:2.0:1787826392.202690:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+114:86743:x1874668789931904:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.202763:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.202788:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd94 expref: 114 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.202798:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 4/0,1 mode: --/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.202831:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd94 expref: 114 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.202845:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd94 expref: 114 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.202905:0:12105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17085e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778695680:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826392.202975:0:12105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826392.205560:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.205637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.210255:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.210339:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789932288 00000100:00100000:1.0:1787826392.210348:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789932288 00010000:00010000:1.0:1787826392.210387:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd94 expref: 115 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.210427:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3130 00000100:00100000:1.0:1787826392.210438:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+115:2401:x1874668789932288:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826392.210452:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826392.210459:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd94 expref: 115 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.210474:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd94 expref: 115 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.210497:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13e:0x0].0x0 (ffff9bbe12458700) 00010000:00010000:1.0:1787826392.210502:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.210513:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.210522:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.210542:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826392.210592:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+115:2401:x1874668789932288:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 156us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.210600:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3130 00010000:00010000:2.0:1787826392.210714:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d0f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd94 expref: 114 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.210731:0:12105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17085e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12105:1874668778695680:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826392.210753:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.210763:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.210769:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.210958:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.210967:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.210974:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.210980:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceba00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826392.210984:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.210997:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.211006:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13e:0x0].0x0 (ffff9bbe12458700) 00010000:00010000:2.0:1787826392.211009:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.211013:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.211019:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d11d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x13e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.211096:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+114:86743:x1874668789931904:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 8407us (8562us total) trans 8590016764 rc 0/0 00000100:00100000:2.0:1787826392.211105:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111812 00000100:00100000:3.0:1787826392.214086:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789932032 00000100:00100000:3.0:1787826392.214100:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789932032 00000100:00100000:3.0:1787826392.214165:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789932160 00000100:00100000:3.0:1787826392.214169:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789932160 00000100:00100000:3.0:1787826392.214215:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6404 00000100:00100000:3.0:1787826392.214225:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789932032:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.214267:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214285:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.214289:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.214295:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214309:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214339:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214348:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214357:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214364:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606a00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.214369:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214378:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214394:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214403:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5074492/0x68019081f349d124 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.214479:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789932032:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 255us (8926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.214491:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6404 00000100:00100000:3.0:1787826392.214510:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6405 00000100:00100000:3.0:1787826392.214518:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2402:x1874668789932160:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.214540:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214549:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.214552:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.214557:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214568:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214585:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214593:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214602:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214608:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.214612:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214620:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214630:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.214639:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d12b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.214688:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2402:x1874668789932160:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 170us (9049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.214705:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6405 00000100:00100000:0.0:1787826392.220210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.220255:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.220283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.222914:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789932544 00000100:00100000:2.0:1787826392.222927:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789932544 00000100:00100000:2.0:1787826392.222989:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2751 00000100:00100000:2.0:1787826392.222999:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+114:86743:x1874668789932544:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.223285:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+115:86743:x1874668789932544:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 286us (3083us total) trans 8590016765 rc 0/0 00000100:00100000:2.0:1787826392.223294:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2751 00000100:00100000:1.0:1787826392.223555:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789932800 00000100:00100000:1.0:1787826392.223561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789932800 00000100:00100000:1.0:1787826392.223599:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789933056 00000100:00100000:1.0:1787826392.223602:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789933056 00000100:00100000:1.0:1787826392.223624:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111813 00000100:00100000:1.0:1787826392.223631:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+116:86741:x1874668789932800:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.223698:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x134:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.223716:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda2 expref: 116 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.223724:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.223757:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda2 expref: 116 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.223769:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda2 expref: 116 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.223798:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12804000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778695808:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.223871:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826392.223891:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111814 00000100:00100000:1.0:1787826392.223899:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+116:86742:x1874668789933056:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.223927:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.223939:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd9b expref: 116 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.223946:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.223964:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd9b expref: 116 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.223973:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd9b expref: 116 pid: 45682 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.223981:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12805680 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778695936:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.224005:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.230418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.230452:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.230480:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789933184 00000100:00100000:3.0:1787826392.230487:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789933184 00010000:00010000:3.0:1787826392.230525:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda2 expref: 117 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.230554:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789933312 00000100:00100000:3.0:1787826392.230557:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789933312 00010000:00010000:3.0:1787826392.230572:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd9b expref: 118 pid: 45682 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.230589:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3131 00000100:00100000:3.0:1787826392.230597:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+118:2401:x1874668789933184:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.230612:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.230617:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda2 expref: 118 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.230630:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda2 expref: 118 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.230653:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x134:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:3.0:1787826392.230659:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.230674:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.230682:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.230971:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.231022:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+118:2401:x1874668789933184:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 424us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.231030:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3131 00000100:00100000:3.0:1787826392.231048:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3132 00000100:00100000:3.0:1787826392.231055:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+117:2401:x1874668789933312:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.231063:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.231069:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd9b expref: 117 pid: 45682 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.231079:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd9b expref: 117 pid: 45682 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.231092:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13d:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:3.0:1787826392.231096:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.231103:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.231108:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.231119:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.231137:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+117:2401:x1874668789933312:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 83us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.231142:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3132 00010000:00010000:2.0:1787826392.231287:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d101 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcd9b expref: 116 pid: 45682 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.231306:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12805680 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778695936:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826392.231337:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.231347:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.231352:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.231500:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.231507:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.231513:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.231519:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826392.231523:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.231530:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.231539:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13d:0x0].0x0 (ffff9bbf41389f00) 00010000:00010000:2.0:1787826392.231542:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.231545:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.231551:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d139 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.231624:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+116:86742:x1874668789933056:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 7726us (11339us total) trans 8590016766 rc 0/0 00000100:00100000:2.0:1787826392.231633:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111814 00010000:00010000:0.0:1787826392.233534:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d10f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda2 expref: 115 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.233556:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12804000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778695808:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826392.233590:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.233599:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.233604:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.233758:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.233766:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.233772:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.233788:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826392.233793:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.233800:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.233814:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x134:0x0].0x0 (ffff9bbe0bd66500) 00010000:00010000:0.0:1787826392.233818:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826392.233821:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.233827:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d132 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x134:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.233955:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+115:86741:x1874668789932800:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 10320us (13696us total) trans 8590016767 rc 0/0 00000100:00100000:0.0:1787826392.233965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111813 00000040:00080000:1.0:1787826392.234308:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826392.234313:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826392.234427:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9710 count 21 00000040:00080000:1.0:1787826392.234435:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787826392.234664:0:58431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe12804000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778696064:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826392.234736:0:58431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826392.237121:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.237472:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789933568 00000100:00100000:3.0:1787826392.237480:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789933568 00000100:00100000:3.0:1787826392.237528:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2752 00000100:00100000:3.0:1787826392.237537:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+116:86741:x1874668789933568:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.237831:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+117:86741:x1874668789933568:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 293us (718us total) trans 8590016768 rc 0/0 00000100:00100000:3.0:1787826392.237838:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2752 00000100:00100000:1.0:1787826392.240886:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.240988:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.241014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.241043:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789933952 00000100:00100000:1.0:1787826392.241050:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789933952 00000100:00100000:1.0:1787826392.241089:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789934080 00000100:00100000:1.0:1787826392.241092:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789934080 00000100:00100000:1.0:1787826392.241109:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111815 00000100:00100000:1.0:1787826392.241118:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+118:86744:x1874668789933952:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826392.241148:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x13f:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826392.241269:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+118:86744:x1874668789933952:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 151us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.241277:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111815 00000100:00100000:1.0:1787826392.241295:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111816 00000100:00100000:1.0:1787826392.241301:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3db75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+117:86745:x1874668789934080:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826392.241312:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x140:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826392.241348:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3db75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+117:86745:x1874668789934080:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 48us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.241354:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111816 00000100:00100000:1.0:1787826392.241391:0:58431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe12804000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778696064:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826392.241974:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789933824 00000100:00100000:3.0:1787826392.241980:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789933824 00000100:00100000:3.0:1787826392.242022:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2753 00000100:00100000:3.0:1787826392.242029:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+116:86742:x1874668789933824:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.242215:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+117:86742:x1874668789933824:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 185us (1336us total) trans 8590016769 rc 0/0 00000100:00100000:3.0:1787826392.242223:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2753 00000100:00100000:1.0:1787826392.253105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.253255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.253487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.253526:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789934592 00000100:00100000:2.0:1787826392.253535:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789934592 00000100:00100000:2.0:1787826392.253587:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789934336 00000100:00100000:2.0:1787826392.253590:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789934336 00000100:00100000:2.0:1787826392.253614:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111817 00000100:00100000:2.0:1787826392.253623:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+118:86745:x1874668789934592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.253647:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.253677:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d140 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdb0 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.253776:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d147 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x140:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.253800:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d147 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.253812:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d147 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826392.253823:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x140:0x0]: returning size 1516 00010000:00010000:2.0:1787826392.253950:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d140 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdb0 expref: 121 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.253968:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d147 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdb0 expref: 120 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.253976:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x140:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:2.0:1787826392.253981:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826392.253984:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb800, rc 0) 00000100:00100000:2.0:1787826392.254042:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+120:86745:x1874668789934592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 420us (951us total) trans 8590016770 rc 0/0 00000100:00100000:2.0:1787826392.254050:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111817 00000100:00100000:2.0:1787826392.254070:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111818 00000100:00100000:2.0:1787826392.254078:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+119:86744:x1874668789934336:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.254086:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.254095:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d155 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcda9 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.254141:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d15c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.254151:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d15c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.254159:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d15c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826392.254166:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13f:0x0]: returning size 1516 00010000:00010000:2.0:1787826392.254227:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d155 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda9 expref: 122 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.254240:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d15c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda9 expref: 121 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.254247:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13f:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:2.0:1787826392.254249:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826392.254252:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceba00, rc 0) 00000100:00100000:2.0:1787826392.254274:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+121:86744:x1874668789934336:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 197us (1020us total) trans 8590016771 rc 0/0 00000100:00100000:2.0:1787826392.254280:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111818 00000100:00100000:2.0:1787826392.254917:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789934720 00000100:00100000:2.0:1787826392.254924:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789934720 00000100:00100000:2.0:1787826392.255060:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111819 00000100:00100000:2.0:1787826392.255069:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+121:86746:x1874668789934720:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826392.255090:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x141:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826392.255192:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+121:86746:x1874668789934720:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 124us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.255199:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111819 00000100:00100000:2.0:1787826392.259563:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.259640:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789934848 00000100:00100000:1.0:1787826392.259650:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789934848 00000100:00100000:1.0:1787826392.259721:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17292 00000100:00100000:1.0:1787826392.259732:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+121:2399:x1874668789934848:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826392.259748:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826392.259774:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d15c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcda9 expref: 121 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.259804:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13f:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:1.0:1787826392.259810:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826392.259903:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+120:2399:x1874668789934848:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 172us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.259911:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17292 00000100:00100000:1.0:1787826392.271613:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.271718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.271796:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.271832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.271881:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789935360 00000100:00100000:0.0:1787826392.271891:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789935360 00000100:00100000:0.0:1787826392.271944:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111820 00000100:00100000:0.0:1787826392.271952:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+120:86746:x1874668789935360:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.271976:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.271995:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d16a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdb7 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.272096:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d171 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x141:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.272112:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d171 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.272123:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d171 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826392.272133:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x141:0x0]: returning size 1516 00010000:00010000:0.0:1787826392.272233:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d16a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdb7 expref: 123 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.272253:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d171 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdb7 expref: 122 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.272261:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x141:0x0].0x0 (ffff9bbe12458b00) 00010000:00010000:0.0:1787826392.272264:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826392.272268:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205c00, rc 0) 00000100:00100000:0.0:1787826392.272336:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+122:86746:x1874668789935360:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 385us (540us total) trans 8590016772 rc 0/0 00000100:00100000:0.0:1787826392.272344:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111820 00000100:00100000:3.0:1787826392.272679:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789935104 00000100:00100000:3.0:1787826392.272685:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789935104 00000100:00100000:3.0:1787826392.272732:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17293 00000100:00100000:3.0:1787826392.272740:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+122:2401:x1874668789935104:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.272751:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.272767:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d147 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdb0 expref: 122 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.272791:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x140:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:3.0:1787826392.272796:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.272818:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+121:2401:x1874668789935104:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 80us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.272825:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17293 00000100:00100000:2.0:1787826392.273537:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789934976 00000100:00100000:2.0:1787826392.273544:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789934976 00000100:00100000:2.0:1787826392.273578:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789935488 00000100:00100000:2.0:1787826392.273581:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789935488 00000100:00100000:2.0:1787826392.273635:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6406 00000100:00100000:2.0:1787826392.273642:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2401:x1874668789934976:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.273682:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.273707:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 20 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.273716:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xcf:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787826392.273721:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826392.273725:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.273755:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 20 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.273768:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 20 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.273791:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778696192:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826392.273869:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826392.274193:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6407 00000100:00100000:0.0:1787826392.274203:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789935488:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.274226:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.274239:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 25 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.274245:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xcf:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787826392.274248:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.274253:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.274274:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 25 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.274298:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 25 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.274308:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778696320:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826392.274357:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826392.282464:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.284570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.284745:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e8083c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25038:1874668778696320:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826392.284769:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.285133:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778696192:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826392.285149:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.285381:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789935744 00000100:00100000:3.0:1787826392.285388:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789935744 00000100:00100000:3.0:1787826392.285449:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17294 00000100:00100000:3.0:1787826392.285460:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+121:2402:x1874668789935744:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.285476:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.285500:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d171 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x141:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdb7 expref: 121 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.285517:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x141:0x0].0x0 (ffff9bbe12458b00) 00010000:00010000:3.0:1787826392.285522:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.285570:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+120:2402:x1874668789935744:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 112us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.285578:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17294 00000100:00100000:2.0:1787826392.285754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.286106:0:25758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789935872 00000100:00100000:3.0:1787826392.286111:0:25758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789935872 00002000:00100000:3.0:1787826392.286145:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xcf:0x0] (0->1515) req@ffff9bbe0c0303c0 x1874668789935872/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.286156:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c0303c0 with x1874668789935872 ext(0->1515) 00010000:00010000:3.0:1787826392.286164:0:25758:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 21 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.286190:0:25758:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 21 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.286198:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0c0303c0 00000100:00100000:3.0:1787826392.286226:0:25758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:3.0:1787826392.286234:0:25758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2399:x1874668789935872:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:0.0:1787826392.288470:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789935616 00000100:00100000:0.0:1787826392.288483:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789935616 00000100:00100000:0.0:1787826392.288533:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6408 00000100:00100000:0.0:1787826392.288543:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2400:x1874668789935616:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.288589:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.288609:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 22 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.288618:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xd0:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787826392.288622:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.288626:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.288658:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 22 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.288671:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 22 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.288685:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e80a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778696448:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826392.289023:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826392.292615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.292775:0:45405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789936000 00000100:00100000:0.0:1787826392.292793:0:45405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789936000 00002000:00100000:0.0:1787826392.292841:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xcf:0x0] (0->1515) req@ffff9bbe0c0330c0 x1874668789936000/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826392.292874:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c0330c0 with x1874668789936000 ext(0->1515) 00010000:00010000:0.0:1787826392.292884:0:45405:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 26 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.292900:0:45405:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 26 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826392.292907:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe0c0330c0 00000100:00100000:0.0:1787826392.292944:0:45405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:0.0:1787826392.292955:0:45405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2402:x1874668789936000:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:3.0:1787826392.293292:0:25758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2399:x1874668789935872:12345-192.168.203.9@tcp:4:cp.0 Request processed in 6942us (7422us total) trans 4294968188 rc 0/0 00000100:00100000:3.0:1787826392.293302:0:25758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 52 00002000:00100000:3.0:1787826392.293310:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xcf:0x0] (0->1515) req@ffff9bbe0c0303c0 x1874668789935872/t4294968188(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.293319:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c0303c0 with x1874668789935872 ext(0->1515) 00010000:00010000:3.0:1787826392.293326:0:25758:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.293344:0:25758:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.293350:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0c0303c0 00000100:00100000:0.0:1787826392.295894:0:45405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2402:x1874668789936000:12345-192.168.203.9@tcp:4:cp.0 Request processed in 2931us (3279us total) trans 4294968204 rc 0/0 00000100:00100000:0.0:1787826392.295907:0:45405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 53 00002000:00100000:0.0:1787826392.295918:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xcf:0x0] (0->1515) req@ffff9bbe0c0330c0 x1874668789936000/t4294968204(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826392.295929:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c0330c0 with x1874668789936000 ext(0->1515) 00010000:00010000:0.0:1787826392.295939:0:45405:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 28 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.295953:0:45405:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 28 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826392.295960:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe0c0330c0 00000100:00100000:1.0:1787826392.301589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.301661:0:45401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789936128 00000100:00100000:3.0:1787826392.301671:0:45401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789936128 00002000:00100000:3.0:1787826392.302020:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xd0:0x0] (0->1515) req@ffff9bbe0dc8f840 x1874668789936128/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.302032:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8f840 with x1874668789936128 ext(0->1515) 00010000:00010000:3.0:1787826392.302042:0:45401:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.302060:0:45401:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.302068:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0dc8f840 00000100:00100000:3.0:1787826392.302136:0:45401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00100000:3.0:1787826392.302149:0:45401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789936128:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:2.0:1787826392.302619:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.302984:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e80a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778696448:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826392.303011:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.303110:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789936256 00000100:00100000:0.0:1787826392.303116:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789936256 00010000:00010000:0.0:1787826392.303142:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 25 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.303168:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3133 00000100:00100000:0.0:1787826392.303761:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2400:x1874668789936256:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826392.303788:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787826392.303804:0:45686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xcf:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:0.0:1787826392.303812:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 25 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.303823:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 25 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.303845:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1a9baf3/0x68019081f349c7a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc5ec expref: 25 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.303877:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.303882:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.303887:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.303897:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.303920:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826392.304007:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.304017:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.304041:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.304049:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.304057:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.304065:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826392.304069:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.304078:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.304089:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.304096:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f858f23/0x68019081f349d17f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.307298:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789936256:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4110us (4668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.307314:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3133 00000100:00100000:2.0:1787826392.307514:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789934976:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 33869us (35906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.307528:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6406 00000100:00100000:2.0:1787826392.309537:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.310104:0:45401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789936128:12345-192.168.203.9@tcp:4:cp.0 Request processed in 7954us (8520us total) trans 4294968189 rc 0/0 00000100:00100000:3.0:1787826392.310117:0:45401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 54 00002000:00100000:3.0:1787826392.310130:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xd0:0x0] (0->1515) req@ffff9bbe0dc8f840 x1874668789936128/t4294968189(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.310147:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8f840 with x1874668789936128 ext(0->1515) 00010000:00010000:3.0:1787826392.310157:0:45401:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.310171:0:45401:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.310187:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0dc8f840 00000100:00100000:3.0:1787826392.310220:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789936384 00000100:00100000:3.0:1787826392.310431:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789936384 00010000:00010000:3.0:1787826392.310462:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 28 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.310499:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3134 00000100:00100000:3.0:1787826392.310510:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789936384:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.310564:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787826392.310584:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xcf:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1787826392.310592:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 28 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.310606:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 28 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.310629:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066c4ad8e/0x68019081f349c83a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc624 expref: 28 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.310647:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826392.310652:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826392.310657:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.310668:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.310695:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.311049:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2401:x1874668789936384:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 466us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.311056:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3134 00010000:00010000:3.0:1787826392.311082:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.311091:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.311111:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.311118:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.311126:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.311134:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.311138:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.311147:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.311160:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.311168:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079b6a941/0x68019081f349d186 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.311342:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2401:x1874668789935488:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 37140us (39508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.311350:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6407 00000100:00100000:2.0:1787826392.315547:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.315944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.316022:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789936512 00000100:00100000:1.0:1787826392.316031:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789936512 00010000:00010000:1.0:1787826392.316073:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.316125:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3135 00000100:00100000:1.0:1787826392.316135:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789936512:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826392.316151:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826392.316169:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xd0:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:1.0:1787826392.316187:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316202:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316226:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0cb3896/0x68019081f349c8d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc65c expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316241:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.316245:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.316250:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316260:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316289:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826392.316340:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789936512:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 206us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.316352:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3135 00010000:00010000:1.0:1787826392.316380:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316390:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316410:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316419:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316427:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316435:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826392.316439:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316449:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316461:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.316475:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdb8eaa/0x68019081f349d18d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.316519:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2400:x1874668789935616:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 27978us (34065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.316527:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6408 00000100:00100000:3.0:1787826392.319254:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789936768 00000100:00100000:3.0:1787826392.319265:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789936768 00000100:00100000:3.0:1787826392.319319:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111821 00000100:00100000:3.0:1787826392.319329:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+120:86744:x1874668789936768:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.319424:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+120:86744:x1874668789936768:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 97us (3887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.319431:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111821 00000100:00100000:2.0:1787826392.320405:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.320490:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.320515:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789937024 00000100:00100000:2.0:1787826392.320522:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789937024 00000100:00100000:2.0:1787826392.320556:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789937280 00000100:00100000:2.0:1787826392.320559:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789937280 00000100:00100000:2.0:1787826392.320579:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111822 00000100:00100000:2.0:1787826392.320586:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+121:86745:x1874668789937024:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.320655:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c0312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+121:86745:x1874668789937024:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.320662:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111822 00000100:00100000:2.0:1787826392.320679:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111823 00000100:00100000:2.0:1787826392.320686:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+120:86746:x1874668789937280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.320719:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+120:86746:x1874668789937280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 34us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.320726:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111823 00000100:00100000:2.0:1787826392.324045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.324075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.324128:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789937408 00000100:00100000:3.0:1787826392.324136:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789937408 00000100:00100000:3.0:1787826392.324183:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789937536 00000100:00100000:3.0:1787826392.324185:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789937536 00000100:00100000:3.0:1787826392.324207:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6409 00000100:00100000:3.0:1787826392.324216:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789937408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.324232:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826392.324253:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d194 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdbe expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.324278:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcf:0x0] initial LVB size: 1516, mtime: 0x6a9010d6, atime: 0x0, ctime: 0x6a9010d6, blocks: 0x8 00010000:00010000:3.0:1787826392.324295:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:3.0:1787826392.324300:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.324310:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d194 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdbe expref: 24 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.324326:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbbcee0a/0x68019081f349d194 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdbe expref: 24 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.324338:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606800, rc 0) 00000100:00100000:3.0:1787826392.324390:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789937408:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 175us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.324398:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6409 00000100:00100000:3.0:1787826392.324414:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6410 00000100:00100000:3.0:1787826392.324421:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789937536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.324427:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826392.324435:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349d19b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdc5 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.324447:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd0:0x0] initial LVB size: 1516, mtime: 0x6a9010d6, atime: 0x0, ctime: 0x6a9010d6, blocks: 0x8 00010000:00010000:3.0:1787826392.324455:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:3.0:1787826392.324458:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.324463:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349d19b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdc5 expref: 24 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.324473:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5074492/0x68019081f349d19b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdc5 expref: 24 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.324481:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606a00, rc 0) 00000100:00100000:3.0:1787826392.324499:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789937536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 80us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.324505:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6410 00000100:00100000:2.0:1787826392.329576:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.329661:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789937664 00000100:00100000:1.0:1787826392.329671:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789937664 00000100:00100000:1.0:1787826392.329738:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6411 00000100:00100000:1.0:1787826392.329749:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789937664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.329765:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826392.329796:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349d1a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdcc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826392.329822:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcf:0x0] initial LVB size: 1516, mtime: 0x6a9010d6, atime: 0x0, ctime: 0x6a9010d6, blocks: 0x8 00010000:00010000:1.0:1787826392.329843:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:1.0:1787826392.329847:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.329887:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349d1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdcc expref: 27 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.329905:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024658e88/0x68019081f349d1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdcc expref: 27 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.329919:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d000, rc 0) 00000100:00100000:1.0:1787826392.329975:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2400:x1874668789937664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 228us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.329983:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6411 00000100:00100000:3.0:1787826392.332547:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.333543:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.334060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.334115:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789937920 00000100:00100000:2.0:1787826392.334125:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789937920 00000100:00100000:2.0:1787826392.334227:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789938176 00000100:00100000:2.0:1787826392.334230:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789938176 00000100:00100000:0.0:1787826392.334487:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789938432 00000100:00100000:0.0:1787826392.334492:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789938432 00000100:00100000:0.0:1787826392.334526:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111824 00000100:00100000:0.0:1787826392.334535:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+122:86744:x1874668789937920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826392.334639:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+122:86744:x1874668789937920:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 104us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.334646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111824 00000100:00100000:0.0:1787826392.334678:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111825 00000100:00100000:0.0:1787826392.334686:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+121:86746:x1874668789938176:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826392.334722:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+121:86746:x1874668789938176:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 36us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.334729:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111825 00000100:00100000:0.0:1787826392.334743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111826 00000100:00100000:0.0:1787826392.334750:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a104b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+120:86745:x1874668789938432:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826392.334792:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a104b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+120:86745:x1874668789938432:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 42us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.334799:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111826 00000100:00100000:3.0:1787826392.337379:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.337417:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.337516:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789938560 00000100:00100000:0.0:1787826392.337525:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789938560 00002000:00100000:0.0:1787826392.337568:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xcf:0x0] (0->4095) req@ffff9bbf0cb59a40 x1874668789938560/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826392.337579:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf0cb59a40 with x1874668789938560 ext(0->4095) 00002000:00010000:0.0:1787826392.337584:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf0cb59a40 00000100:00100000:0.0:1787826392.337609:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789938688 00000100:00100000:0.0:1787826392.337612:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789938688 00002000:00100000:0.0:1787826392.337626:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xcf:0x0] (0->4095) req@ffff9bbe0a31c780 x1874668789938688/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826392.337633:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a31c780 with x1874668789938688 ext(0->4095) 00002000:00010000:0.0:1787826392.337636:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a31c780 00000100:00100000:0.0:1787826392.337666:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1591 00000100:00100000:0.0:1787826392.337675:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789938560:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787826392.338352:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789938560:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 675us (978us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787826392.338361:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1591 00002000:00100000:0.0:1787826392.338369:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xcf:0x0] (0->4095) req@ffff9bbf0cb59a40 x1874668789938560/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826392.338385:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf0cb59a40 with x1874668789938560 ext(0->4095) 00002000:00010000:0.0:1787826392.338390:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf0cb59a40 00000100:00100000:0.0:1787826392.338410:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1592 00000100:00100000:0.0:1787826392.338418:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2399:x1874668789938688:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787826392.338484:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2399:x1874668789938688:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 67us (1066us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787826392.338491:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1592 00002000:00100000:0.0:1787826392.338497:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xcf:0x0] (0->4095) req@ffff9bbe0a31c780 x1874668789938688/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826392.338505:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0a31c780 with x1874668789938688 ext(0->4095) 00002000:00010000:0.0:1787826392.338509:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0a31c780 00000100:00100000:0.0:1787826392.339234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.339431:0:45397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789938816 00000100:00100000:3.0:1787826392.339438:0:45397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789938816 00002000:00100000:3.0:1787826392.339470:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xd0:0x0] (0->4095) req@ffff9bbe0e80a580 x1874668789938816/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.339479:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e80a580 with x1874668789938816 ext(0->4095) 00002000:00010000:3.0:1787826392.339484:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0e80a580 00000100:00100000:3.0:1787826392.339507:0:45397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1593 00000100:00100000:3.0:1787826392.339516:0:45397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e80a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789938816:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.339616:0:45397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e80a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789938816:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 101us (383us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826392.339623:0:45397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1593 00002000:00100000:3.0:1787826392.339629:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xd0:0x0] (0->4095) req@ffff9bbe0e80a580 x1874668789938816/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.339637:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e80a580 with x1874668789938816 ext(0->4095) 00002000:00010000:3.0:1787826392.339640:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0e80a580 00000100:00100000:0.0:1787826392.343383:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.343474:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789938944 00000100:00100000:2.0:1787826392.343483:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789938944 00000100:00100000:2.0:1787826392.343544:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111827 00000100:00100000:2.0:1787826392.343554:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+120:86746:x1874668789938944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.343573:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.343594:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d1a9 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x141:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdd3 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.343624:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x141:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.343638:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.343649:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.343759:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d1a9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdd3 expref: 122 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.343787:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdd3 expref: 121 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.343796:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x141:0x0].0x0 (ffff9bbe12458b00) 00010000:00010000:2.0:1787826392.343799:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.343803:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09cea800, rc 0) 00000100:00100000:2.0:1787826392.343959:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+121:86746:x1874668789938944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 405us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.343970:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111827 00000100:00100000:0.0:1787826392.360522:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.360597:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.360703:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.360784:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789939072 00000100:00100000:2.0:1787826392.360794:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789939072 00000100:00100000:2.0:1787826392.360848:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789939200 00000100:00100000:2.0:1787826392.360875:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789939200 00000100:00100000:2.0:1787826392.360905:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111828 00000100:00100000:2.0:1787826392.360916:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+122:86744:x1874668789939072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.360936:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.360959:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d1b7 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdda expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.360997:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361012:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361025:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361141:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d1b7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdda expref: 124 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361158:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdda expref: 123 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361167:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13f:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:2.0:1787826392.361170:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.361174:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceba00, rc 0) 00000100:00100000:2.0:1787826392.361246:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+123:86744:x1874668789939072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 333us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.361254:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111828 00000100:00100000:2.0:1787826392.361273:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111829 00000100:00100000:2.0:1787826392.361282:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+122:86745:x1874668789939200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.361290:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.361301:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d1c5 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x140:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcde1 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361320:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x140:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361328:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361337:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361398:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d1c5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde1 expref: 124 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361411:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde1 expref: 123 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.361417:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x140:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:2.0:1787826392.361420:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.361423:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb400, rc 0) 00000100:00100000:2.0:1787826392.361449:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+123:86745:x1874668789939200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 168us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.361456:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111829 00000100:00100000:0.0:1787826392.361678:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789939328 00000100:00100000:0.0:1787826392.361684:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789939328 00000100:00100000:0.0:1787826392.361718:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111830 00000100:00100000:0.0:1787826392.361726:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+123:86746:x1874668789939328:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826392.361747:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x141:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826392.361822:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+123:86746:x1874668789939328:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 97us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.361833:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111830 00000100:00100000:0.0:1787826392.371532:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.371580:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789939456 00000100:00100000:3.0:1787826392.371591:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789939456 00000100:00100000:3.0:1787826392.371644:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6412 00000100:00100000:3.0:1787826392.371655:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789939456:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.371718:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.371735:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.371739:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.371745:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.371760:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.371806:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.371815:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.371823:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.371830:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.371834:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.371842:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.371875:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.371884:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002480845e/0x68019081f349d1d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.371957:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789939456:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 302us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.371964:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6412 00000100:00100000:0.0:1787826392.374931:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.374987:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.375022:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789939584 00000100:00100000:0.0:1787826392.375031:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789939584 00000100:00100000:0.0:1787826392.375078:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789939712 00000100:00100000:0.0:1787826392.375081:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789939712 00000100:00100000:0.0:1787826392.375100:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111831 00000100:00100000:0.0:1787826392.375111:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+124:86745:x1874668789939584:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826392.375139:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x140:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826392.375286:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111832 00000100:00100000:3.0:1787826392.375297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+124:86744:x1874668789939712:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826392.375314:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x13f:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826392.375406:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+124:86744:x1874668789939712:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 112us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.375413:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111832 00000100:00100000:0.0:1787826392.375492:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+123:86745:x1874668789939584:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 384us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.375499:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111831 00000100:00100000:0.0:1787826392.381237:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.381400:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789939840 00000100:00100000:3.0:1787826392.381410:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789939840 00000100:00100000:3.0:1787826392.381469:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6413 00000100:00100000:3.0:1787826392.381478:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789939840:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.381519:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.381536:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.381540:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.381546:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.381559:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.381585:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.381594:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.381603:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.381611:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.381615:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.381625:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.381638:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.381645:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d1da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.381784:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789939840:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 298us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.381803:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6413 00000100:00100000:1.0:1787826392.388961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.389000:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789940096 00000100:00100000:1.0:1787826392.389009:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789940096 00000100:00100000:1.0:1787826392.389061:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111833 00000100:00100000:1.0:1787826392.389071:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+123:86746:x1874668789940096:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.389148:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x141:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.389164:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdd3 expref: 123 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.389172:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.389210:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdd3 expref: 123 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.389224:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdd3 expref: 123 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.389238:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dc8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778696576:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.389317:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826392.390396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.390423:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789940224 00000100:00100000:1.0:1787826392.390430:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789940224 00000100:00100000:1.0:1787826392.390466:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6414 00000100:00100000:1.0:1787826392.390473:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2401:x1874668789940224:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.390505:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.390519:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.390524:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.390529:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.390543:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.390566:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.390573:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.390581:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.390588:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993cc00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826392.390592:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.390602:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.390617:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.390625:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d1e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.390680:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2401:x1874668789940224:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 207us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.390688:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6414 00000100:00100000:1.0:1787826392.393753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.393803:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.393883:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789940608 00000100:00100000:0.0:1787826392.393891:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789940608 00010000:00010000:0.0:1787826392.393926:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdd3 expref: 124 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.393956:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3136 00000100:00100000:0.0:1787826392.393964:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+124:2401:x1874668789940608:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826392.393978:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826392.393984:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdd3 expref: 124 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.394001:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdd3 expref: 124 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.394023:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x141:0x0].0x0 (ffff9bbe12458b00) 00010000:00010000:0.0:1787826392.394028:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.394037:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.394044:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.394060:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826392.394109:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+124:2401:x1874668789940608:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 146us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.394116:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3136 00000100:00100000:0.0:1787826392.394167:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789940480 00000100:00100000:0.0:1787826392.394170:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789940480 00000100:00100000:0.0:1787826392.394278:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111834 00000100:00100000:0.0:1787826392.394287:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+124:86744:x1874668789940480:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.394347:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.394360:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdda expref: 124 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.394367:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 4/0,1 mode: --/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.394394:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdda expref: 124 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.394407:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdda expref: 124 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.394419:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778696704:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826392.394463:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787826392.394676:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d1b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdd3 expref: 124 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.394692:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dc8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778696576:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826392.394708:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.394716:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.394726:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.397501:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.397520:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.397527:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.397534:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826392.397539:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.397547:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.397563:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x141:0x0].0x0 (ffff9bbe12458b00) 00010000:00010000:3.0:1787826392.397566:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826392.397571:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.397578:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d1e1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x141:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.397800:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+124:86746:x1874668789940096:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 8725us (8840us total) trans 8590016773 rc 0/0 00000100:00100000:3.0:1787826392.397810:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111833 00000100:00100000:1.0:1787826392.397974:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.398111:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.398162:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789940864 00000100:00100000:3.0:1787826392.398170:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789940864 00000100:00100000:3.0:1787826392.398287:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111835 00000100:00100000:3.0:1787826392.398296:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+124:86745:x1874668789940864:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.398371:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x140:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.398385:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde1 expref: 124 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.398392:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.398421:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde1 expref: 124 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.398433:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde1 expref: 124 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.398447:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778696832:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826392.398508:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a1706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.398528:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789940992 00000100:00100000:3.0:1787826392.398531:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789940992 00010000:00010000:3.0:1787826392.398550:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdda expref: 125 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.398623:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3137 00000100:00100000:3.0:1787826392.398631:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+125:2402:x1874668789940992:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.398643:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.398648:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdda expref: 125 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.398658:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdda expref: 125 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.398673:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13f:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:3.0:1787826392.398677:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.398684:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.398691:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.398704:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.398725:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+125:2402:x1874668789940992:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 95us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.398731:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3137 00000100:00100000:2.0:1787826392.407400:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:0.0:1787826392.407917:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d1be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdda expref: 124 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.407938:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778696704:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826392.407960:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.407970:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.407976:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.408120:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.408128:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.408136:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.408142:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826392.408146:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.408152:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.408168:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13f:0x0].0x0 (ffff9bbf41389000) 00010000:00010000:0.0:1787826392.408172:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826392.410299:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 2/0,0 mode: --/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.410319:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d1ef lrc: 0/0,0 mode: --/PW res: [0x200000403:0x13f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.410481:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+124:86744:x1874668789940480:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 16191us (16730us total) trans 8590016774 rc 0/0 00000100:00100000:0.0:1787826392.410491:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111834 00000100:00100000:3.0:1787826392.413083:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789941248 00000100:00100000:3.0:1787826392.413097:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789941248 00000100:00100000:2.0:1787826392.417748:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2754 00000100:00100000:2.0:1787826392.417762:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+124:86746:x1874668789941248:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.418088:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+125:86746:x1874668789941248:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 328us (10695us total) trans 8590016775 rc 0/0 00000100:00100000:2.0:1787826392.418096:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2754 00000100:00100000:2.0:1787826392.418458:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.422166:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789941504 00000100:00100000:3.0:1787826392.422188:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789941504 00000100:00100000:3.0:1787826392.422248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2755 00000100:00100000:3.0:1787826392.422258:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+125:86744:x1874668789941504:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.422545:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+126:86744:x1874668789941504:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 286us (4086us total) trans 8590016776 rc 0/0 00000100:00100000:3.0:1787826392.422554:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2755 00000100:00100000:3.0:1787826392.426249:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778696832:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826392.426281:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.437765:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.437838:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789941632 00000100:00100000:3.0:1787826392.437848:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789941632 00010000:00010000:3.0:1787826392.437905:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde1 expref: 126 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.437940:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3138 00000100:00100000:3.0:1787826392.437950:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+126:2401:x1874668789941632:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.437965:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.437971:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde1 expref: 126 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.437983:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde1 expref: 126 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438006:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d1cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde1 expref: 126 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438022:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x140:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:3.0:1787826392.438028:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438036:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438044:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438067:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.438117:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+125:2401:x1874668789941632:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 169us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.438125:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3138 00010000:00010000:3.0:1787826392.438150:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438158:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438447:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438456:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438462:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438468:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826392.438472:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438478:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438486:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x140:0x0].0x0 (ffff9bbe12458300) 00010000:00010000:3.0:1787826392.438489:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826392.438493:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.438499:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d1f6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x140:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.438592:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+125:86745:x1874668789940864:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 40297us (40618us total) trans 8590016777 rc 0/0 00000100:00100000:3.0:1787826392.438600:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111835 00000040:00080000:2.0:1787826392.438718:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826392.438723:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826392.438900:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9713 count 21 00000040:00080000:2.0:1787826392.438907:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787826392.439111:0:58431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778696960:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787826392.439160:0:58431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.457284:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.457312:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789941760 00000100:00100000:3.0:1787826392.457320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789941760 00000100:00100000:3.0:1787826392.457411:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111836 00000100:00100000:3.0:1787826392.457423:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+126:86747:x1874668789941760:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826392.457454:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x142:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826392.457564:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+126:86747:x1874668789941760:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 145us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.457571:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111836 00000100:00100000:3.0:1787826392.457607:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.457690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.457708:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789942144 00000100:00100000:3.0:1787826392.457711:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789942144 00000100:00100000:3.0:1787826392.457735:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2756 00000100:00100000:3.0:1787826392.457741:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+126:86745:x1874668789942144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.457983:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+127:86745:x1874668789942144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 240us (291us total) trans 8590016778 rc 0/0 00000100:00100000:3.0:1787826392.457994:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2756 00000100:00100000:0.0:1787826392.458185:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789941888 00000100:00100000:0.0:1787826392.458189:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789941888 00000100:00100000:0.0:1787826392.458221:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111837 00000100:00100000:0.0:1787826392.458227:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+127:86748:x1874668789941888:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826392.458245:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x143:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826392.458298:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+127:86748:x1874668789941888:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 71us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.458305:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111837 00000100:00100000:3.0:1787826392.459137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.459955:0:58431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778696960:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826392.460302:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789942272 00000100:00100000:1.0:1787826392.460309:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789942272 00000100:00100000:1.0:1787826392.460364:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111838 00000100:00100000:1.0:1787826392.460373:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+126:86749:x1874668789942272:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826392.460400:0:45683:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x144:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826392.460488:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+126:86749:x1874668789942272:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 115us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.460496:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111838 00000100:00100000:3.0:1787826392.462962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.463305:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789942784 00000100:00100000:1.0:1787826392.463314:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789942784 00000100:00100000:1.0:1787826392.463371:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111839 00000100:00100000:1.0:1787826392.463381:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+126:86748:x1874668789942784:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.463403:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826392.463423:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d1fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdef expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.463529:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d204 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x143:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.463544:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d204 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.463555:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d204 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826392.463566:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x143:0x0]: returning size 1516 00010000:00010000:1.0:1787826392.463677:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d1fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdef expref: 129 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.463697:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d204 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdef expref: 128 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.463706:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x143:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:1.0:1787826392.463709:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826392.463713:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d600, rc 0) 00000100:00100000:1.0:1787826392.463791:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+128:86748:x1874668789942784:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 411us (837us total) trans 8590016779 rc 0/0 00000100:00100000:1.0:1787826392.463798:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111839 00000100:00100000:0.0:1787826392.469096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.469139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.469161:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789943040 00000100:00100000:0.0:1787826392.469169:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789943040 00000100:00100000:1.0:1787826392.469264:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789942912 00000100:00100000:1.0:1787826392.469268:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789942912 00000100:00100000:1.0:1787826392.469314:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6415 00000100:00100000:1.0:1787826392.469323:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789942912:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.469363:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.469382:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 24 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.469390:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xd1:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787826392.469394:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.469399:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.469432:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 24 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.469445:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 24 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.469459:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778697088:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.469528:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826392.470597:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17295 00000100:00100000:0.0:1787826392.470607:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+128:2400:x1874668789943040:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826392.470618:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826392.470640:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d204 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdef expref: 128 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.470655:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x143:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:0.0:1787826392.470660:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826392.470698:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+127:2400:x1874668789943040:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 92us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.470705:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17295 00000100:00100000:1.0:1787826392.475350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.475610:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789942528 00000100:00100000:0.0:1787826392.475619:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789942528 00000100:00100000:0.0:1787826392.475688:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111840 00000100:00100000:0.0:1787826392.475698:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+127:86747:x1874668789942528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.475716:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.475736:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d219 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcde8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.475845:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d220 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x142:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.475880:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d220 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.475897:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d220 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826392.475909:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x142:0x0]: returning size 1516 00010000:00010000:0.0:1787826392.476011:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d219 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde8 expref: 130 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.476029:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d220 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde8 expref: 129 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.476038:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x142:0x0].0x0 (ffff9bbe12458000) 00010000:00010000:0.0:1787826392.476041:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826392.476045:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204400, rc 0) 00000100:00100000:0.0:1787826392.476100:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86747:x1874668789942528:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 404us (759us total) trans 8590016780 rc 0/0 00000100:00100000:0.0:1787826392.476108:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111840 00000100:00100000:3.0:1787826392.477795:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778697088:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826392.477823:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.478644:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.482491:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789943296 00000100:00100000:1.0:1787826392.482503:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789943296 00000100:00100000:1.0:1787826392.482574:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111841 00000100:00100000:1.0:1787826392.482583:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86749:x1874668789943296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.482607:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826392.482626:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d22e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.482726:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d235 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x144:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.482740:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d235 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.482751:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d235 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826392.482762:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x144:0x0]: returning size 1516 00010000:00010000:1.0:1787826392.482897:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d22e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdf6 expref: 132 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.482913:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d235 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdf6 expref: 131 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.482923:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x144:0x0].0x0 (ffff9bbe16e56100) 00010000:00010000:1.0:1787826392.482926:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826392.482929:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d800, rc 0) 00000100:00100000:1.0:1787826392.482988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+131:86749:x1874668789943296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 406us (4347us total) trans 8590016781 rc 0/0 00000100:00100000:1.0:1787826392.482996:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111841 00000100:00100000:1.0:1787826392.485256:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.485286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.485315:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789943680 00000100:00100000:1.0:1787826392.485317:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.485322:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789943680 00000100:00100000:1.0:1787826392.485337:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789943552 00000100:00100000:1.0:1787826392.485341:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789943552 00000100:00100000:1.0:1787826392.485371:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6416 00000100:00100000:3.0:1787826392.485371:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17296 00000100:00100000:1.0:1787826392.485380:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2402:x1874668789943552:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.485380:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+131:2402:x1874668789943680:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.485393:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826392.485412:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.485413:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d220 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcde8 expref: 131 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.485427:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x142:0x0].0x0 (ffff9bbe12458000) 00010000:00010000:1.0:1787826392.485429:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 27 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.485431:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826392.485437:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd0:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787826392.485441:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.485445:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.485473:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 27 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.485473:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+130:2402:x1874668789943680:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.485480:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17296 00010000:00010000:1.0:1787826392.485485:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 27 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.485499:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778697216:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.485546:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826392.487151:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789943424 00000100:00100000:2.0:1787826392.487162:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789943424 00002000:00100000:2.0:1787826392.487208:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xd1:0x0] (0->1515) req@ffff9bbe0e6bd2c0 x1874668789943424/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.487218:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e6bd2c0 with x1874668789943424 ext(0->1515) 00010000:00010000:2.0:1787826392.487227:0:26215:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 25 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.487242:0:26215:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 25 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826392.487254:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0e6bd2c0 00000100:00100000:2.0:1787826392.487280:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:2.0:1787826392.487289:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789943424:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:1.0:1787826392.492033:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.492114:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.492707:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789943808 00000100:00100000:3.0:1787826392.492716:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789943808 00000100:00100000:3.0:1787826392.492762:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6417 00000100:00100000:3.0:1787826392.492770:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789943808:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.492821:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.492841:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 28 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.492867:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd1:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787826392.492872:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826392.492877:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 4/1,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.492909:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 28 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.492921:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 28 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.492935:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778697344:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.493310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.493358:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778697216:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826392.493381:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.494132:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789944064 00000100:00100000:1.0:1787826392.494140:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789944064 00002000:00100000:1.0:1787826392.494176:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xd0:0x0] (0->1515) req@ffff9bbe16079a40 x1874668789944064/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826392.494188:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe16079a40 with x1874668789944064 ext(0->1515) 00010000:00010000:1.0:1787826392.494196:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 29 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.494208:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 29 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826392.494215:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe16079a40 00000100:00100000:1.0:1787826392.494238:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:1.0:1787826392.494247:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789944064:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:1.0:1787826392.495051:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789944064:12345-192.168.203.9@tcp:4:cp.0 Request processed in 802us (1738us total) trans 4294968205 rc 0/0 00000100:00100000:1.0:1787826392.495062:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 56 00002000:00100000:1.0:1787826392.495069:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xd0:0x0] (0->1515) req@ffff9bbe16079a40 x1874668789944064/t4294968205(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826392.495078:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe16079a40 with x1874668789944064 ext(0->1515) 00010000:00010000:1.0:1787826392.495086:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.495101:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826392.495109:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe16079a40 00000100:00100000:1.0:1787826392.501380:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.504950:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789943936 00000100:00100000:1.0:1787826392.504962:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789943936 00000100:00100000:1.0:1787826392.505013:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789944192 00000100:00100000:1.0:1787826392.505017:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789944192 00010000:00010000:1.0:1787826392.505037:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.505064:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3139 00000100:00100000:1.0:1787826392.505073:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2402:x1874668789944192:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826392.505088:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826392.505108:0:15760:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd0:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:1.0:1787826392.505114:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505128:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505152:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a9860f/0x68019081f349c983 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc6cc expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505173:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.505178:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.505184:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505194:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505222:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826392.505284:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789944192:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 210us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.505292:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3139 00000100:00100000:1.0:1787826392.505312:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17297 00000100:00100000:1.0:1787826392.505318:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+130:2402:x1874668789943936:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826392.505328:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826392.505343:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d235 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdf6 expref: 130 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505357:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x144:0x0].0x0 (ffff9bbe16e56100) 00010000:00010000:1.0:1787826392.505360:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826392.505378:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+129:2402:x1874668789943936:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 61us (13265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.505384:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17297 00010000:00010000:1.0:1787826392.505411:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505420:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505439:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505448:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505456:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505462:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826392.505466:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505474:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505485:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.505493:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d243 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.505540:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668789943552:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 20161us (20222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.505548:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6416 00000100:00100000:3.0:1787826392.509142:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.509248:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778697344:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826392.509271:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.509310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.510952:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789944320 00000100:00100000:3.0:1787826392.510965:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789944320 00002000:00100000:3.0:1787826392.511015:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xd1:0x0] (0->1515) req@ffff9bbe083fcf00 x1874668789944320/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.511027:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe083fcf00 with x1874668789944320 ext(0->1515) 00010000:00010000:3.0:1787826392.511036:0:14373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 29 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.511049:0:14373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 29 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.511057:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe083fcf00 00000100:00100000:3.0:1787826392.511082:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:3.0:1787826392.511090:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668789944320:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:3.0:1787826392.512109:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2402:x1874668789944320:12345-192.168.203.9@tcp:4:cp.0 Request processed in 1014us (2793us total) trans 4294968206 rc 0/0 00000100:00100000:3.0:1787826392.512120:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 57 00002000:00100000:3.0:1787826392.512131:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xd1:0x0] (0->1515) req@ffff9bbe083fcf00 x1874668789944320/t4294968206(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.512141:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe083fcf00 with x1874668789944320 ext(0->1515) 00010000:00010000:3.0:1787826392.512150:0:14373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.512161:0:14373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.512174:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe083fcf00 00000100:00100000:3.0:1787826392.512557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.512581:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789944448 00000100:00100000:3.0:1787826392.512586:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789944448 00010000:00010000:3.0:1787826392.512612:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 28 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.512639:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3140 00000100:00100000:3.0:1787826392.512648:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2402:x1874668789944448:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.513547:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787826392.513569:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xd1:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1787826392.513577:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 28 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513592:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 28 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513616:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349ca47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc743 expref: 28 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513635:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826392.513639:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826392.513644:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513659:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513707:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.513755:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2402:x1874668789944448:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1108us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.513763:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3140 00010000:00010000:3.0:1787826392.513838:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513847:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513879:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513887:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513895:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513902:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.513906:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513920:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513932:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.513940:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d212 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.513987:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2401:x1874668789942912:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 44664us (44900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.513995:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6415 00000100:00100000:3.0:1787826392.514048:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.514076:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789944704 00000100:00100000:0.0:1787826392.514082:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789944704 00000100:00100000:0.0:1787826392.514123:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111842 00000100:00100000:0.0:1787826392.514131:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86747:x1874668789944704:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.514346:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789943424:12345-192.168.203.9@tcp:4:cp.0 Request processed in 27056us (29096us total) trans 4294968190 rc 0/0 00000100:00100000:2.0:1787826392.514355:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 55 00002000:00100000:2.0:1787826392.514364:0:26215:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xd1:0x0] (0->1515) req@ffff9bbe0e6bd2c0 x1874668789943424/t4294968190(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.514374:0:26215:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e6bd2c0 with x1874668789943424 ext(0->1515) 00010000:00010000:2.0:1787826392.514380:0:26215:0:(ldlm_extent.c:823:ldlm_resource_prolong()) Failed to get resource for resid 11811161089/209 00002000:00010000:2.0:1787826392.514383:0:26215:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0e6bd2c0 00000100:00100000:0.0:1787826392.514574:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86747:x1874668789944704:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 443us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.514581:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111842 00000100:00100000:3.0:1787826392.531097:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.531140:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.531174:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.532448:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789944832 00000100:00100000:0.0:1787826392.532460:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789944832 00010000:00010000:0.0:1787826392.532517:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.532571:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3141 00000100:00100000:0.0:1787826392.532580:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789944832:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826392.532596:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787826392.532614:0:15760:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:0.0:1787826392.532622:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.532636:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.532660:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054e2cf9e/0x68019081f349caf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc782 expref: 31 pid: 8433 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.532676:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.532681:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.532687:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.532697:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.532729:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826392.532796:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.532798:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789944832:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 219us (1710us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826392.532807:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.532810:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3141 00010000:00010000:3.0:1787826392.532830:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.532844:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.532870:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.532878:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.532882:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.532891:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.532903:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.532911:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d24a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.532943:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789944960 00000100:00100000:1.0:1787826392.532947:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789944960 00000100:00100000:3.0:1787826392.532956:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789943808:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 40187us (40933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.532963:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6417 00000100:00100000:1.0:1787826392.532974:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6418 00000100:00100000:1.0:1787826392.532981:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789944960:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.532994:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826392.533009:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d251 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcdfd expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826392.533025:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd0:0x0] initial LVB size: 1516, mtime: 0x6a9010d6, atime: 0x0, ctime: 0x6a9010d6, blocks: 0x8 00010000:00010000:1.0:1787826392.533037:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:1.0:1787826392.533040:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.533045:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d251 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdfd expref: 30 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.533058:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7584702/0x68019081f349d251 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcdfd expref: 30 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.533068:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c600, rc 0) 00000100:00100000:1.0:1787826392.533089:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789944960:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 108us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.533095:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6418 00000100:00100000:1.0:1787826392.533114:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789945216 00000100:00100000:1.0:1787826392.533118:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789945216 00000100:00100000:1.0:1787826392.533152:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111843 00000100:00100000:1.0:1787826392.533160:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86748:x1874668789945216:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.533236:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86748:x1874668789945216:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 77us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.533244:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111843 00000100:00100000:3.0:1787826392.540487:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.541358:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789945472 00000100:00100000:1.0:1787826392.541369:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789945472 00000100:00100000:1.0:1787826392.541422:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111844 00000100:00100000:1.0:1787826392.541431:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86747:x1874668789945472:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.541542:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86747:x1874668789945472:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 111us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.541550:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111844 00000100:00100000:0.0:1787826392.542291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.545604:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789945728 00000100:00100000:3.0:1787826392.545619:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789945728 00000100:00100000:3.0:1787826392.545696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111845 00000100:00100000:3.0:1787826392.545707:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86749:x1874668789945728:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.545867:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86749:x1874668789945728:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 146us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.545876:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111845 00000100:00100000:1.0:1787826392.552109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.552165:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.552278:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789945856 00000100:00100000:3.0:1787826392.552288:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789945856 00000100:00100000:3.0:1787826392.552347:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6419 00000100:00100000:3.0:1787826392.552356:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789945856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.552374:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826392.552395:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d258 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce04 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.552421:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd1:0x0] initial LVB size: 1516, mtime: 0x6a9010d6, atime: 0x0, ctime: 0x6a9010d6, blocks: 0x8 00010000:00010000:3.0:1787826392.552440:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:3.0:1787826392.552445:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.552454:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d258 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce04 expref: 26 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.552472:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c92e3861/0x68019081f349d258 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce04 expref: 26 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.552485:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607000, rc 0) 00000100:00100000:3.0:1787826392.552545:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2399:x1874668789945856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 191us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.552556:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6419 00000100:00100000:2.0:1787826392.552732:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789945984 00000100:00100000:2.0:1787826392.552737:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789945984 00002000:00100000:2.0:1787826392.552771:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xd0:0x0] (0->4095) req@ffff9bbe1607ad00 x1874668789945984/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.552790:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1607ad00 with x1874668789945984 ext(0->4095) 00002000:00010000:2.0:1787826392.552795:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe1607ad00 00000100:00100000:2.0:1787826392.552818:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1594 00000100:00100000:2.0:1787826392.552824:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789945984:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.552971:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789945984:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 146us (805us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787826392.552978:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1594 00002000:00100000:2.0:1787826392.552985:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xd0:0x0] (0->4095) req@ffff9bbe1607ad00 x1874668789945984/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.552993:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1607ad00 with x1874668789945984 ext(0->4095) 00002000:00010000:2.0:1787826392.552996:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe1607ad00 00000100:00100000:1.0:1787826392.554425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.554514:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789946112 00000100:00100000:2.0:1787826392.554521:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789946112 00000100:00100000:2.0:1787826392.554558:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6420 00000100:00100000:2.0:1787826392.554566:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2399:x1874668789946112:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.554579:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.554596:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7552dce/0x68019081f349d25f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce0b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826392.554623:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd1:0x0] initial LVB size: 1516, mtime: 0x6a9010d7, atime: 0x0, ctime: 0x6a9010d7, blocks: 0x8 00010000:00010000:2.0:1787826392.554640:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:2.0:1787826392.554644:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826392.554652:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7552dce/0x68019081f349d25f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce0b expref: 31 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.554669:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7552dce/0x68019081f349d25f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce0b expref: 31 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.554682:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09cea600, rc 0) 00000100:00100000:2.0:1787826392.554811:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2399:x1874668789946112:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 245us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.554818:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6420 00000100:00100000:3.0:1787826392.558188:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.558352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789946240 00000100:00100000:1.0:1787826392.558363:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789946240 00000100:00100000:1.0:1787826392.558418:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111846 00000100:00100000:1.0:1787826392.558428:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+129:86747:x1874668789946240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.558449:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826392.558471:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d266 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x142:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce12 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.558606:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x142:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.558620:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.558631:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.558736:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d266 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce12 expref: 131 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.558752:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce12 expref: 130 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.558760:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x142:0x0].0x0 (ffff9bbe12458000) 00010000:00010000:1.0:1787826392.558763:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826392.558767:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826392.558841:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+130:86747:x1874668789946240:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 414us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.558848:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111846 00000100:00100000:3.0:1787826392.559636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.559847:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789946496 00000100:00100000:1.0:1787826392.559884:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789946496 00000100:00100000:1.0:1787826392.559924:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111847 00000100:00100000:1.0:1787826392.559932:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+130:86748:x1874668789946496:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.559997:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+130:86748:x1874668789946496:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 66us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.560005:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111847 00000100:00100000:2.0:1787826392.561903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.561979:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789946752 00000100:00100000:3.0:1787826392.561988:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789946752 00000100:00100000:3.0:1787826392.562037:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111848 00000100:00100000:3.0:1787826392.562047:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+130:86749:x1874668789946752:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.563296:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+130:86749:x1874668789946752:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 1243us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.563307:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111848 00000100:00100000:3.0:1787826392.571824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.571968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.572361:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789947008 00000100:00100000:1.0:1787826392.572371:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789947008 00002000:00100000:1.0:1787826392.572418:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xd1:0x0] (0->4095) req@ffff9bbe083fc3c0 x1874668789947008/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826392.572431:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe083fc3c0 with x1874668789947008 ext(0->4095) 00002000:00010000:1.0:1787826392.572436:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe083fc3c0 00000100:00100000:1.0:1787826392.572462:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1595 00000100:00100000:1.0:1787826392.572471:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2402:x1874668789947008:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.572749:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2402:x1874668789947008:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 278us (780us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787826392.572757:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1595 00002000:00100000:1.0:1787826392.572764:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xd1:0x0] (0->4095) req@ffff9bbe083fc3c0 x1874668789947008/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826392.572771:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe083fc3c0 with x1874668789947008 ext(0->4095) 00002000:00010000:1.0:1787826392.572785:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe083fc3c0 00000100:00100000:1.0:1787826392.572813:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789946880 00000100:00100000:1.0:1787826392.572817:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789946880 00000100:00100000:1.0:1787826392.572844:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111849 00000100:00100000:1.0:1787826392.572866:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+130:86747:x1874668789946880:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826392.572889:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x142:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826392.572964:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+130:86747:x1874668789946880:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 113us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.572971:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111849 00000100:00100000:0.0:1787826392.576055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.576093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.576155:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789947264 00000100:00100000:3.0:1787826392.576165:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789947264 00000100:00100000:3.0:1787826392.576233:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6421 00000100:00100000:3.0:1787826392.576243:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789947264:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.576285:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.576302:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.576307:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.576314:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.576327:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.576356:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.576364:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.576371:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.576378:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.576382:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.576390:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.576406:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.576414:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4e4fd53/0x68019081f349d274 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.576499:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789947264:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 258us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.576511:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6421 00000100:00100000:2.0:1787826392.577155:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789947136 00000100:00100000:2.0:1787826392.577162:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789947136 00002000:00100000:2.0:1787826392.577261:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xd1:0x0] (0->4095) req@ffff9bbe159f0f00 x1874668789947136/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.577272:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe159f0f00 with x1874668789947136 ext(0->4095) 00002000:00010000:2.0:1787826392.577278:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe159f0f00 00000100:00100000:2.0:1787826392.577305:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1596 00000100:00100000:2.0:1787826392.577313:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2402:x1874668789947136:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.577473:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2402:x1874668789947136:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 160us (1427us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787826392.577583:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1596 00002000:00100000:2.0:1787826392.577591:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xd1:0x0] (0->4095) req@ffff9bbe159f0f00 x1874668789947136/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.577599:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe159f0f00 with x1874668789947136 ext(0->4095) 00002000:00010000:2.0:1787826392.577602:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe159f0f00 00000100:00100000:0.0:1787826392.579569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.579633:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789947392 00000100:00100000:3.0:1787826392.579641:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789947392 00000100:00100000:3.0:1787826392.579706:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111850 00000100:00100000:3.0:1787826392.579716:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+130:86748:x1874668789947392:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.579734:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826392.579752:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d27b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x143:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.579795:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x143:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.579809:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.579819:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.579950:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d27b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce19 expref: 132 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.579969:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce19 expref: 131 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.579977:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x143:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:3.0:1787826392.579980:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826392.579983:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:3.0:1787826392.580033:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+131:86748:x1874668789947392:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 319us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.580041:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111850 00000100:00100000:2.0:1787826392.585144:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.585193:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.585320:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789947648 00000100:00100000:0.0:1787826392.585329:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789947648 00000100:00100000:0.0:1787826392.585381:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789947776 00000100:00100000:0.0:1787826392.585385:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789947776 00000100:00100000:0.0:1787826392.585410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111851 00000100:00100000:0.0:1787826392.585418:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+132:86747:x1874668789947648:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.585495:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x142:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585512:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce12 expref: 132 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585521:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585554:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce12 expref: 132 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585568:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce12 expref: 132 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.585582:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778697472:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826392.585672:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826392.585693:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111852 00000100:00100000:0.0:1787826392.585701:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+132:86749:x1874668789947776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.585711:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.585724:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d290 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x144:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce20 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585746:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x144:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585757:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585766:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585895:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d290 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce20 expref: 134 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585914:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce20 expref: 133 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.585922:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x144:0x0].0x0 (ffff9bbe16e56100) 00010000:00010000:0.0:1787826392.585926:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826392.585930:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204000, rc 0) 00000100:00100000:0.0:1787826392.585964:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+133:86749:x1874668789947776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 263us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.585971:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111852 00000100:00100000:2.0:1787826392.592955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.592989:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.593017:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789947904 00000100:00100000:2.0:1787826392.593021:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.593026:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789947904 00000100:00100000:1.0:1787826392.593075:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789948160 00000100:00100000:1.0:1787826392.593079:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789948160 00000100:00100000:1.0:1787826392.593103:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111853 00000100:00100000:2.0:1787826392.593109:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111854 00000100:00100000:1.0:1787826392.593112:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+134:86749:x1874668789947904:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.593117:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+134:86748:x1874668789948160:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826392.593143:0:45683:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x144:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1787826392.593143:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x143:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826392.593245:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+134:86748:x1874668789948160:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 128us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.593253:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111854 00000100:00100000:3.0:1787826392.593255:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789948032 00000100:00100000:3.0:1787826392.593259:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789948032 00010000:00010000:3.0:1787826392.593282:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce12 expref: 134 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.593317:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3142 00000100:00100000:3.0:1787826392.593324:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+134:2400:x1874668789948032:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.593335:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.593342:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce12 expref: 134 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.593354:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce12 expref: 134 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.593379:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x142:0x0].0x0 (ffff9bbe12458000) 00010000:00010000:3.0:1787826392.593385:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.593396:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.593404:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.593426:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826392.594003:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d26d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce12 expref: 134 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.594022:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778697472:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826392.594041:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.594051:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.594057:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.594314:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.594323:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.594329:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.594335:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826392.594339:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.594347:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.594358:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x142:0x0].0x0 (ffff9bbe12458000) 00010000:00010000:0.0:1787826392.594361:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826392.594365:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.594372:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d289 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x142:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.596070:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+134:86749:x1874668789947904:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 2948us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.596083:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111853 00000100:00100000:3.0:1787826392.596184:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+133:2400:x1874668789948032:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2859us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.596197:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3142 00000100:00100000:0.0:1787826392.596269:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+132:86747:x1874668789947648:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 10849us (11132us total) trans 8590016782 rc 0/0 00000100:00100000:0.0:1787826392.596276:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111851 00000100:00100000:2.0:1787826392.601647:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.601753:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789948416 00000100:00100000:1.0:1787826392.601762:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789948416 00000100:00100000:1.0:1787826392.601829:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6422 00000100:00100000:1.0:1787826392.601840:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2402:x1874668789948416:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.601905:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.601924:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.601929:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.601935:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.601950:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.601976:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.601984:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.601994:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.602001:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826392.602007:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.602016:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.602030:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.602037:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002318c342/0x68019081f349d29e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.602111:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2402:x1874668789948416:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 273us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.602119:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6422 00000100:00100000:2.0:1787826392.604077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.604152:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789948288 00000100:00100000:1.0:1787826392.604161:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789948288 00000100:00100000:1.0:1787826392.604214:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6423 00000100:00100000:1.0:1787826392.604223:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789948288:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.604264:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.604281:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.604285:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.604290:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.604301:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.604325:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.604334:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.604342:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.604351:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826392.604354:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.604363:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.604376:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.604384:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d2a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.604455:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789948288:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 232us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.604463:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6423 00000100:00100000:0.0:1787826392.605937:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.606011:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789948672 00000100:00100000:3.0:1787826392.606019:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789948672 00000100:00100000:3.0:1787826392.606072:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2757 00000100:00100000:3.0:1787826392.606081:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+132:86747:x1874668789948672:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.606349:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+133:86747:x1874668789948672:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 269us (417us total) trans 8590016783 rc 0/0 00000100:00100000:3.0:1787826392.606357:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2757 00000100:00100000:3.0:1787826392.610504:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.610551:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.610622:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789948928 00000100:00100000:0.0:1787826392.610631:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789948928 00000100:00100000:1.0:1787826392.610665:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789949184 00000100:00100000:1.0:1787826392.610669:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789949184 00000100:00100000:0.0:1787826392.610701:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111855 00000100:00100000:1.0:1787826392.610707:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111856 00000100:00100000:0.0:1787826392.610711:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+134:86748:x1874668789948928:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.610713:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+134:86749:x1874668789949184:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.610789:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x143:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.610789:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x144:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.610807:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce19 expref: 134 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.610807:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce20 expref: 134 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.610818:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.610818:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 4/0,1 mode: --/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.610848:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce19 expref: 134 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.610849:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce20 expref: 134 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.610879:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce19 expref: 134 pid: 6515 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.610881:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce20 expref: 134 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.610894:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778697728:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.610894:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6be1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778697600:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.611753:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826392.611800:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.614574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.614667:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1874668778697728:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.614667:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6be1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778697600:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826392.614691:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.614691:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.614754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.615501:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789949440 00000100:00100000:2.0:1787826392.615510:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789949440 00010000:00010000:2.0:1787826392.615548:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce19 expref: 135 pid: 6515 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.615585:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789949312 00000100:00100000:2.0:1787826392.615589:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789949312 00010000:00010000:2.0:1787826392.615602:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce20 expref: 136 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.615631:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3143 00000100:00100000:2.0:1787826392.615639:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+136:2402:x1874668789949440:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826392.615652:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826392.615665:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce19 expref: 136 pid: 6515 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615677:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce19 expref: 136 pid: 6515 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615706:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d282 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce19 expref: 136 pid: 6515 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615721:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x143:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:2.0:1787826392.615727:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615736:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615744:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615768:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826392.615822:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+135:2402:x1874668789949440:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 184us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.615829:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3143 00000100:00100000:2.0:1787826392.615846:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3144 00000100:00100000:2.0:1787826392.615873:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+134:2402:x1874668789949312:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826392.615881:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826392.615886:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce20 expref: 134 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615895:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce20 expref: 134 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615906:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d297 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce20 expref: 134 pid: 25756 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615918:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x144:0x0].0x0 (ffff9bbe16e56100) 00010000:00010000:2.0:1787826392.615922:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615929:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615937:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.615949:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826392.615966:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+133:2402:x1874668789949312:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 114us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.615971:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3144 00010000:00010000:1.0:1787826392.616683:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.616695:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.616896:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.616905:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.616911:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.616918:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993da00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826392.616923:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.616930:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.616943:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x144:0x0].0x0 (ffff9bbe16e56100) 00010000:00010000:1.0:1787826392.616946:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826392.616950:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 2/0,0 mode: --/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.616962:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d2ac lrc: 0/0,0 mode: --/PW res: [0x200000403:0x144:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.617060:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+133:86749:x1874668789949184:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 6343us (6506us total) trans 8590016784 rc 0/0 00000100:00100000:1.0:1787826392.617069:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111856 00010000:00010000:1.0:1787826392.618561:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.618577:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.618719:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.618727:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.618734:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.618740:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826392.618744:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.618752:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.618768:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x143:0x0].0x0 (ffff9bbf41389800) 00010000:00010000:1.0:1787826392.618771:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826392.618785:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.618792:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d2b3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x143:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.618940:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+133:86748:x1874668789948928:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 8226us (8439us total) trans 8590016785 rc 0/0 00000100:00100000:1.0:1787826392.618950:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111855 00000040:00080000:3.0:1787826392.619402:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826392.619408:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826392.619527:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9716 count 21 00000040:00080000:3.0:1787826392.619533:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826392.619973:0:58431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283b840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778697856:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826392.620067:0:58431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.625082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.625129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.625542:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789949696 00000100:00100000:2.0:1787826392.625550:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789949696 00000100:00100000:2.0:1787826392.625609:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789949952 00000100:00100000:2.0:1787826392.625612:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789949952 00000100:00100000:2.0:1787826392.625628:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2758 00000100:00100000:2.0:1787826392.625636:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+135:86749:x1874668789949696:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.625990:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2759 00000100:00100000:1.0:1787826392.626001:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+136:86748:x1874668789949952:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.626126:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+137:86748:x1874668789949952:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 127us (995us total) trans 8590016787 rc 0/0 00000100:00100000:2.0:1787826392.626126:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+137:86749:x1874668789949696:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 489us (1053us total) trans 8590016786 rc 0/0 00000100:00100000:1.0:1787826392.626133:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2759 00000100:00100000:3.0:1787826392.626295:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.626418:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.626438:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2758 00000100:00100000:2.0:1787826392.627090:0:58431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283b840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778697856:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826392.627722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.629123:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789950080 00000100:00100000:1.0:1787826392.629135:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789950080 00000100:00100000:0.0:1787826392.629386:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789950208 00000100:00100000:0.0:1787826392.629391:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789950208 00000100:00100000:0.0:1787826392.629421:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111857 00000100:00100000:0.0:1787826392.629432:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+136:86750:x1874668789950080:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826392.629464:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x145:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826392.629616:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+136:86750:x1874668789950080:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 185us (3321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.629624:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111857 00000100:00100000:0.0:1787826392.629642:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111858 00000100:00100000:0.0:1787826392.629648:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+135:86751:x1874668789950208:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826392.629672:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x146:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826392.629720:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+135:86751:x1874668789950208:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 72us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.629727:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111858 00000100:00100000:1.0:1787826392.630821:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789950336 00000100:00100000:1.0:1787826392.630830:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789950336 00000100:00100000:1.0:1787826392.630906:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111859 00000100:00100000:1.0:1787826392.630916:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+135:86752:x1874668789950336:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826392.630939:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x135:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826392.631303:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+135:86752:x1874668789950336:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 388us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.631311:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111859 00000100:00100000:3.0:1787826392.636942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.636971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.637035:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789950592 00000100:00100000:0.0:1787826392.637044:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789950592 00000100:00100000:0.0:1787826392.637086:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789950848 00000100:00100000:0.0:1787826392.637088:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789950848 00000100:00100000:0.0:1787826392.637115:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111860 00000100:00100000:0.0:1787826392.637123:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+136:86751:x1874668789950592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.637146:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.637164:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349d2ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce27 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637271:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d2c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x146:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637285:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637296:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826392.637306:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x146:0x0]: returning size 1516 00010000:00010000:0.0:1787826392.637394:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349d2ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce27 expref: 139 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637411:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce27 expref: 138 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637420:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x146:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:0.0:1787826392.637423:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826392.637426:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204400, rc 0) 00000100:00100000:0.0:1787826392.637470:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+138:86751:x1874668789950592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 349us (538us total) trans 8590016788 rc 0/0 00000100:00100000:0.0:1787826392.637477:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111860 00000100:00100000:0.0:1787826392.637494:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111861 00000100:00100000:0.0:1787826392.637500:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+137:86752:x1874668789950848:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.637508:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.637515:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d2cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce2e expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637556:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d2d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x135:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637564:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637572:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826392.637579:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x135:0x0]: returning size 1516 00010000:00010000:0.0:1787826392.637614:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204600/0x68019081f349d2cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce2e expref: 140 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637627:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce2e expref: 139 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.637634:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x135:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:0.0:1787826392.637637:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826392.637639:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205800, rc 0) 00000100:00100000:0.0:1787826392.637668:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+139:86752:x1874668789950848:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 157us (684us total) trans 8590016789 rc 0/0 00000100:00100000:0.0:1787826392.637674:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111861 00000100:00100000:3.0:1787826392.643561:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.643650:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789951104 00000100:00100000:0.0:1787826392.643668:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789951104 00000100:00100000:0.0:1787826392.643739:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111862 00000100:00100000:0.0:1787826392.643750:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+139:86750:x1874668789951104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.643786:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.643808:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d2e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce35 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.643961:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d2eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x145:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.643978:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d2eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.643988:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d2eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826392.643998:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x145:0x0]: returning size 1516 00010000:00010000:0.0:1787826392.644099:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d2e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce35 expref: 142 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.644119:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d2eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce35 expref: 141 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.644127:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x145:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:0.0:1787826392.644130:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826392.644134:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205200, rc 0) 00000100:00100000:0.0:1787826392.644416:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+141:86750:x1874668789951104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 668us (866us total) trans 8590016790 rc 0/0 00000100:00100000:0.0:1787826392.644425:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111862 00000100:00100000:3.0:1787826392.652260:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.652304:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.652377:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789951232 00000100:00100000:1.0:1787826392.652386:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789951232 00000100:00100000:1.0:1787826392.652442:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6424 00000100:00100000:1.0:1787826392.652452:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2402:x1874668789951232:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.652495:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.652516:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 31 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.652524:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826392.652529:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.652534:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.652567:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 31 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.652583:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 31 pid: 8605 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.652599:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6be1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778697984:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.652676:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826392.652733:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789951360 00000100:00100000:0.0:1787826392.652738:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789951360 00000100:00100000:0.0:1787826392.652792:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17298 00000100:00100000:0.0:1787826392.652800:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+141:2401:x1874668789951360:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826392.652810:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826392.652830:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d2c1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce27 expref: 141 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.652846:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x146:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:0.0:1787826392.652875:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826392.652903:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+140:2401:x1874668789951360:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 104us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.652911:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17298 00000100:00100000:3.0:1787826392.663960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.664065:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6be1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778697984:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826392.664094:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.664186:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789951488 00000100:00100000:0.0:1787826392.664194:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789951488 00000100:00100000:0.0:1787826392.664245:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6425 00000100:00100000:0.0:1787826392.664254:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2401:x1874668789951488:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.664296:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.664314:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 26 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.664324:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xd2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826392.664328:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.664333:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.664366:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 26 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.664379:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 26 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.664394:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778698112:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826392.664476:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.665770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.665845:0:25758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789951616 00000100:00100000:2.0:1787826392.665882:0:25758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789951616 00002000:00100000:2.0:1787826392.665923:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xd2:0x0] (0->1515) req@ffff9bbe1283b840 x1874668789951616/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.665941:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283b840 with x1874668789951616 ext(0->1515) 00010000:00010000:2.0:1787826392.665950:0:25758:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 32 pid: 8605 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.665964:0:25758:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 32 pid: 8605 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826392.665971:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe1283b840 00000100:00100000:2.0:1787826392.665997:0:25758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 58 00000100:00100000:2.0:1787826392.666006:0:25758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2400:x1874668789951616:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:3.0:1787826392.669367:0:25758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+34:2400:x1874668789951616:12345-192.168.203.9@tcp:4:cp.0 Request processed in 3352us (3593us total) trans 4294968207 rc 0/0 00000100:00100000:3.0:1787826392.669382:0:25758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 58 00002000:00100000:3.0:1787826392.669394:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xd2:0x0] (0->1515) req@ffff9bbe1283b840 x1874668789951616/t4294968207(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.669405:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283b840 with x1874668789951616 ext(0->1515) 00010000:00010000:3.0:1787826392.669416:0:25758:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 34 pid: 8605 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.669431:0:25758:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 34 pid: 8605 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.669439:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe1283b840 00000100:00100000:2.0:1787826392.671915:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.671958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.672030:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789951872 00000100:00100000:3.0:1787826392.672038:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789951872 00000100:00100000:3.0:1787826392.672097:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789951744 00000100:00100000:3.0:1787826392.672101:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789951744 00000100:00100000:3.0:1787826392.672131:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17299 00000100:00100000:3.0:1787826392.672140:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+141:2401:x1874668789951872:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.672157:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.672197:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d2d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x135:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce2e expref: 141 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.672222:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x135:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:3.0:1787826392.672227:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.672278:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+140:2401:x1874668789951872:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 139us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.672286:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17299 00000100:00100000:3.0:1787826392.672304:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17300 00000100:00100000:3.0:1787826392.672311:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+139:2401:x1874668789951744:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.672319:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.672331:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d2eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce35 expref: 139 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.672341:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x145:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:3.0:1787826392.672344:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.672360:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+138:2401:x1874668789951744:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.672366:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17300 00000100:00100000:2.0:1787826392.676012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.676086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.676144:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789952000 00000100:00100000:3.0:1787826392.676152:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789952000 00000100:00100000:3.0:1787826392.676213:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6426 00000100:00100000:3.0:1787826392.676222:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2402:x1874668789952000:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.676266:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.676285:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 27 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.676294:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xca:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1787826392.676299:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826392.676304:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.676336:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 27 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.676349:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 27 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.676362:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe128392c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778698240:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826392.676438:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.678519:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.678785:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789952256 00000100:00100000:2.0:1787826392.678794:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789952256 00002000:00100000:2.0:1787826392.678841:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xd2:0x0] (0->1515) req@ffff9bbe12839e00 x1874668789952256/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.678898:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12839e00 with x1874668789952256 ext(0->1515) 00010000:00010000:2.0:1787826392.678907:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 28 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.678921:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 28 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826392.678933:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe12839e00 00000100:00100000:2.0:1787826392.678954:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:2.0:1787826392.678963:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2399:x1874668789952256:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:0.0:1787826392.679926:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778698112:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826392.679951:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.679991:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789952128 00000100:00100000:0.0:1787826392.679997:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789952128 00010000:00010000:0.0:1787826392.680023:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 34 pid: 8605 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.680052:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3145 00000100:00100000:0.0:1787826392.680060:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+34:2399:x1874668789952128:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826392.680073:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787826392.680090:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:0.0:1787826392.680096:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 34 pid: 8605 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.680108:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 34 pid: 8605 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.680138:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a64e5ab9/0x68019081f349cc2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7f2 expref: 34 pid: 8605 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.680153:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.680158:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826392.680164:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.680190:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.680214:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826392.680266:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2399:x1874668789952128:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 207us (4180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.680274:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3145 00010000:00010000:2.0:1787826392.680347:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.680357:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.680375:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.680384:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.680393:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.680400:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993da00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826392.680404:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.680412:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.680430:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.680438:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c64e7b/0x68019081f349d2f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.680483:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2402:x1874668789951232:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 28033us (28233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.680492:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6424 00000100:00100000:2.0:1787826392.681517:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12839e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2399:x1874668789952256:12345-192.168.203.9@tcp:4:cp.0 Request processed in 2549us (3001us total) trans 4294968191 rc 0/0 00000100:00100000:2.0:1787826392.681528:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 59 00002000:00100000:2.0:1787826392.681539:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xd2:0x0] (0->1515) req@ffff9bbe12839e00 x1874668789952256/t4294968191(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.681550:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe12839e00 with x1874668789952256 ext(0->1515) 00010000:00010000:2.0:1787826392.681559:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 30 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.681571:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 30 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826392.681579:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe12839e00 00000100:00100000:2.0:1787826392.688477:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe128392c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778698240:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826392.688507:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.689329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.689884:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789952384 00000100:00100000:0.0:1787826392.689892:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789952384 00002000:00100000:0.0:1787826392.689937:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xca:0x0] (0->1515) req@ffff9bbe0c031e00 x1874668789952384/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826392.689948:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c031e00 with x1874668789952384 ext(0->1515) 00010000:00010000:0.0:1787826392.689956:0:14373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 30 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.689971:0:14373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 30 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826392.689985:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0c031e00 00000100:00100000:0.0:1787826392.690014:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:0.0:1787826392.690023:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789952384:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:2.0:1787826392.693105:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2401:x1874668789952384:12345-192.168.203.9@tcp:4:cp.0 Request processed in 3074us (3770us total) trans 4294968192 rc 0/0 00000100:00100000:2.0:1787826392.693120:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 60 00002000:00100000:2.0:1787826392.693131:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xca:0x0] (0->1515) req@ffff9bbe0c031e00 x1874668789952384/t4294968192(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 2008/448 e 0 to 0 dl 1787826403 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.693142:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c031e00 with x1874668789952384 ext(0->1515) 00010000:00010000:2.0:1787826392.693152:0:14373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 32 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.693182:0:14373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 32 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826392.693191:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0c031e00 00000100:00100000:1.0:1787826392.710901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.711359:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789952640 00000100:00100000:3.0:1787826392.711369:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789952640 00000100:00100000:3.0:1787826392.711423:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111863 00000100:00100000:3.0:1787826392.711432:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+138:86751:x1874668789952640:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.711539:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+138:86751:x1874668789952640:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 108us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.711547:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111863 00000100:00100000:3.0:1787826392.717208:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.717245:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.717427:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789952768 00000100:00100000:1.0:1787826392.717437:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789952768 00010000:00010000:1.0:1787826392.717475:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 32 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.717513:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789952896 00000100:00100000:1.0:1787826392.717517:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789952896 00010000:00010000:1.0:1787826392.717529:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 33 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.717550:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3146 00000100:00100000:1.0:1787826392.717557:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668789952768:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826392.717571:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826392.717588:0:45686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xd2:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:1.0:1787826392.717594:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 33 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717607:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 33 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717627:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349cb90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc7ba expref: 33 pid: 8430 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717644:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.717648:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.717664:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717674:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717700:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826392.717750:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2402:x1874668789952768:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 191us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.717758:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3146 00000100:00100000:1.0:1787826392.717786:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3147 00000100:00100000:1.0:1787826392.717793:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2400:x1874668789952896:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826392.717804:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826392.717812:0:45686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:1.0:1787826392.717816:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 31 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717826:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 31 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717837:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0694f9e/0x68019081f349c0f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc2c0 expref: 31 pid: 25038 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717847:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.717890:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826392.717896:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717903:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717921:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826392.717941:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2400:x1874668789952896:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 148us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.717950:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3147 00010000:00010000:1.0:1787826392.717978:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.717987:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718007:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718015:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718023:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718030:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826392.718034:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718043:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718054:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718067:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c4594c7/0x68019081f349d300 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.718109:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789951488:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 53856us (54159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.718116:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6425 00010000:00010000:1.0:1787826392.718139:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718147:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718161:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718298:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718307:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718314:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826392.718317:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718331:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718344:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.718352:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d307 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.718389:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2402:x1874668789952000:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 42167us (42385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.718396:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6426 00000100:00100000:3.0:1787826392.730614:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.730714:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789953024 00000100:00100000:0.0:1787826392.730725:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789953024 00000100:00100000:0.0:1787826392.730789:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6427 00000100:00100000:0.0:1787826392.730800:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2402:x1874668789953024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.730816:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826392.730837:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004570ab88/0x68019081f349d30e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce3c expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826392.730891:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd2:0x0] initial LVB size: 1516, mtime: 0x6a9010d7, atime: 0x0, ctime: 0x6a9010d7, blocks: 0x8 00010000:00010000:0.0:1787826392.730912:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:0.0:1787826392.730917:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826392.730927:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004570ab88/0x68019081f349d30e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce3c expref: 33 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.730944:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004570ab88/0x68019081f349d30e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce3c expref: 33 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.730956:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204600, rc 0) 00000100:00100000:0.0:1787826392.731015:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668789953024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 217us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.731022:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6427 00000100:00100000:3.0:1787826392.741645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.741696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.741752:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789953280 00000100:00100000:2.0:1787826392.741762:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789953280 00000100:00100000:2.0:1787826392.741827:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789953536 00000100:00100000:2.0:1787826392.741830:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789953536 00000100:00100000:2.0:1787826392.741872:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111864 00000100:00100000:2.0:1787826392.741882:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+139:86752:x1874668789953280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.741984:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+139:86752:x1874668789953280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 103us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.741992:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111864 00000100:00100000:2.0:1787826392.742011:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111865 00000100:00100000:2.0:1787826392.742019:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+138:86750:x1874668789953536:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.742053:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+138:86750:x1874668789953536:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.742059:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111865 00000100:00100000:2.0:1787826392.744761:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.744842:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789953792 00000100:00100000:3.0:1787826392.744870:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789953792 00000100:00100000:3.0:1787826392.744920:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111866 00000100:00100000:3.0:1787826392.744928:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+138:86751:x1874668789953792:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.745017:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+138:86751:x1874668789953792:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.745024:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111866 00000100:00100000:3.0:1787826392.745434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.745469:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.745490:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789953920 00000100:00100000:3.0:1787826392.745495:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789953920 00000100:00100000:3.0:1787826392.745523:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789954048 00000100:00100000:3.0:1787826392.745526:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789954048 00000100:00100000:3.0:1787826392.745546:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6428 00000100:00100000:3.0:1787826392.745553:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789953920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.745564:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826392.745582:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349d315 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce43 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.745606:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd2:0x0] initial LVB size: 1516, mtime: 0x6a9010d7, atime: 0x0, ctime: 0x6a9010d7, blocks: 0x8 00010000:00010000:3.0:1787826392.745621:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:3.0:1787826392.745626:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.745634:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349d315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce43 expref: 30 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.745667:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8c302eb/0x68019081f349d315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce43 expref: 30 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.745680:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2200, rc 0) 00000100:00100000:3.0:1787826392.745706:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789953920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 153us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.745712:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6428 00000100:00100000:3.0:1787826392.745726:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6429 00000100:00100000:3.0:1787826392.745733:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668789954048:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.745739:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826392.745749:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e22f34f/0x68019081f349d31c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce4a expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826392.745760:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xca:0x0] initial LVB size: 1516, mtime: 0x6a9010d5, atime: 0x0, ctime: 0x6a9010d5, blocks: 0x8 00010000:00010000:3.0:1787826392.745770:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=3030s v=(0 0) 00010000:00010000:3.0:1787826392.745773:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.745789:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e22f34f/0x68019081f349d31c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce4a expref: 30 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.745799:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e22f34f/0x68019081f349d31c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce4a expref: 30 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.745807:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3000, rc 0) 00000100:00100000:3.0:1787826392.745828:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789954048:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 96us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.745834:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6429 00000100:00100000:3.0:1787826392.749806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.750515:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.750549:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.750573:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789954304 00000100:00100000:3.0:1787826392.750581:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789954304 00000100:00100000:3.0:1787826392.750620:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789954688 00000100:00100000:3.0:1787826392.750622:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789954688 00000100:00100000:3.0:1787826392.750637:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111867 00000100:00100000:3.0:1787826392.750645:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+139:86752:x1874668789954304:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.750790:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789954432 00000100:00100000:1.0:1787826392.750794:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789954432 00002000:00100000:1.0:1787826392.750822:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xd2:0x0] (0->4095) req@ffff9bbf05cbcb40 x1874668789954432/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826392.750833:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf05cbcb40 with x1874668789954432 ext(0->4095) 00002000:00010000:1.0:1787826392.750838:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf05cbcb40 00000100:00100000:1.0:1787826392.750874:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1597 00000100:00100000:1.0:1787826392.750881:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2399:x1874668789954432:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787826392.751055:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111868 00000100:00100000:0.0:1787826392.751064:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+139:86750:x1874668789954688:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.753002:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2399:x1874668789954432:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 2112us (2480us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787826392.753015:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1597 00002000:00100000:1.0:1787826392.753030:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xd2:0x0] (0->4095) req@ffff9bbf05cbcb40 x1874668789954432/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826392.753041:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf05cbcb40 with x1874668789954432 ext(0->4095) 00002000:00010000:1.0:1787826392.753047:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbf05cbcb40 00000100:00100000:0.0:1787826392.753342:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+139:86750:x1874668789954688:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 2278us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.753351:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111868 00000100:00100000:3.0:1787826392.756341:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+138:86752:x1874668789954304:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 5684us (6530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.756356:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111867 00000100:00100000:0.0:1787826392.765056:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.765641:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.770296:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789954944 00000100:00100000:2.0:1787826392.770311:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789954944 00000100:00100000:2.0:1787826392.770371:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111869 00000100:00100000:2.0:1787826392.770380:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+138:86751:x1874668789954944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.770400:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.770421:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d323 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x146:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce51 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.770453:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x146:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.770466:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.770477:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.770582:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d323 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce51 expref: 140 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.770600:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce51 expref: 139 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.770612:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x146:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:2.0:1787826392.770615:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.770618:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09cea800, rc 0) 00000100:00100000:2.0:1787826392.770698:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+139:86751:x1874668789954944:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 316us (5055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.770705:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111869 00000100:00100000:3.0:1787826392.773582:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789954816 00000100:00100000:3.0:1787826392.773597:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789954816 00002000:00100000:3.0:1787826392.773647:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xd2:0x0] (0->4095) req@ffff9bbe159f1a40 x1874668789954816/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.773670:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe159f1a40 with x1874668789954816 ext(0->4095) 00002000:00010000:3.0:1787826392.773675:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe159f1a40 00000100:00100000:3.0:1787826392.773701:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1598 00000100:00100000:3.0:1787826392.773709:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789954816:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787826392.777542:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789954816:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 3823us (12483us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826392.777558:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1598 00002000:00100000:3.0:1787826392.777573:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xd2:0x0] (0->4095) req@ffff9bbe159f1a40 x1874668789954816/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826392.777584:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe159f1a40 with x1874668789954816 ext(0->4095) 00002000:00010000:3.0:1787826392.777590:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe159f1a40 00000100:00100000:1.0:1787826392.778240:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.785041:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789955072 00000100:00100000:3.0:1787826392.785053:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789955072 00002000:00100000:2.0:1787826392.785155:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xca:0x0] (0->4095) req@ffff9bbe0e6be1c0 x1874668789955072/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/0 e 0 to 0 dl 1787826403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.785169:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e6be1c0 with x1874668789955072 ext(0->4095) 00002000:00010000:2.0:1787826392.785174:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0e6be1c0 00000100:00100000:2.0:1787826392.785202:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1599 00000100:00100000:2.0:1787826392.785210:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789955072:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.789895:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789955072:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 4673us (11646us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787826392.789910:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1599 00002000:00100000:2.0:1787826392.789925:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xca:0x0] (0->4095) req@ffff9bbe0e6be1c0 x1874668789955072/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:748/0 lens 488/4536 e 0 to 0 dl 1787826403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826392.789935:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e6be1c0 with x1874668789955072 ext(0->4095) 00002000:00010000:2.0:1787826392.789941:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0e6be1c0 00000100:00100000:1.0:1787826392.793095:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.794276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789955328 00000100:00100000:2.0:1787826392.794288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789955328 00000100:00100000:2.0:1787826392.794346:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111870 00000100:00100000:2.0:1787826392.794355:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+139:86750:x1874668789955328:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826392.794375:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826392.794396:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d331 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x145:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce58 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.794429:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x145:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.794443:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.794455:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.794591:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d331 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce58 expref: 141 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.794608:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce58 expref: 140 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.794616:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x145:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:2.0:1787826392.794619:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.794622:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb600, rc 0) 00000100:00100000:2.0:1787826392.796615:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+140:86750:x1874668789955328:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2251us (3516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.796627:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111870 00000100:00100000:1.0:1787826392.807225:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.807265:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789955200 00000100:00100000:1.0:1787826392.807274:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789955200 00000100:00100000:1.0:1787826392.807328:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111871 00000100:00100000:1.0:1787826392.807337:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+140:86751:x1874668789955200:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826392.807366:0:45682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x146:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826392.809915:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+140:86751:x1874668789955200:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 2566us (2687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.809931:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111871 00000100:00100000:1.0:1787826392.810039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.810069:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789955456 00000100:00100000:1.0:1787826392.810078:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789955456 00000100:00100000:1.0:1787826392.810119:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111872 00000100:00100000:1.0:1787826392.810128:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+140:86752:x1874668789955456:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.810146:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826392.810167:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d33f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x135:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.810201:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x135:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.810218:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.810229:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.810339:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d33f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce5f expref: 142 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.810356:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce5f expref: 141 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.810363:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x135:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:1.0:1787826392.810366:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826392.810369:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826392.810407:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+141:86752:x1874668789955456:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 281us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.810414:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111872 00000100:00100000:0.0:1787826392.823281:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.823566:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789955584 00000100:00100000:2.0:1787826392.823576:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789955584 00000100:00100000:2.0:1787826392.823632:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111873 00000100:00100000:2.0:1787826392.823642:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+141:86750:x1874668789955584:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826392.823754:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x145:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826392.823916:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+141:86750:x1874668789955584:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 275us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.823925:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111873 00000100:00100000:0.0:1787826392.824217:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.826245:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789955712 00000100:00100000:2.0:1787826392.826258:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789955712 00000100:00100000:2.0:1787826392.826645:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111874 00000100:00100000:2.0:1787826392.826656:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+141:86752:x1874668789955712:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787826392.826686:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x135:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787826392.826820:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+141:86752:x1874668789955712:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 166us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.826827:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111874 00000100:00100000:1.0:1787826392.829958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.830001:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789955840 00000100:00100000:1.0:1787826392.830010:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789955840 00000100:00100000:1.0:1787826392.830056:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6430 00000100:00100000:1.0:1787826392.830066:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2401:x1874668789955840:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.830108:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.830125:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.830130:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826392.830137:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.830150:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.830173:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.830181:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.830189:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.830196:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826392.830200:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.830209:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.830223:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.830230:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000693a6f98/0x68019081f349d34d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.830307:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2401:x1874668789955840:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 241us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.830315:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6430 00000100:00100000:1.0:1787826392.833216:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.833286:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789955968 00000100:00100000:0.0:1787826392.833296:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789955968 00000100:00100000:0.0:1787826392.833348:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6431 00000100:00100000:0.0:1787826392.833358:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3d6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2399:x1874668789955968:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826392.833399:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.833415:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826392.833419:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826392.833425:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.833439:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.833464:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.838831:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.838866:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.838876:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826392.838881:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.838893:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.838914:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.838923:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079b6a941/0x68019081f349d354 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.839017:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3d6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2399:x1874668789955968:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 5655us (5804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.839027:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6431 00000100:00100000:3.0:1787826392.839666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.840614:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.840677:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789956352 00000100:00100000:3.0:1787826392.840685:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789956352 00000100:00100000:3.0:1787826392.840736:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6432 00000100:00100000:3.0:1787826392.840746:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789956352:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.840792:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.840810:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.840814:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826392.840820:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.840833:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.840882:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.840891:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.840905:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.840912:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826392.840916:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.840925:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.840939:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.840946:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0090aa/0x68019081f349d35b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.841004:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789956352:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 260us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.841012:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6432 00000100:00100000:3.0:1787826392.844708:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789956224 00000100:00100000:3.0:1787826392.844723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789956224 00000100:00100000:3.0:1787826392.844877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111875 00000100:00100000:3.0:1787826392.844888:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+141:86751:x1874668789956224:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.844964:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x146:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.844982:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce51 expref: 141 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.844992:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.845027:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce51 expref: 141 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.845041:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce51 expref: 141 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.845056:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778698368:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826392.845153:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.845395:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.845616:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789956608 00000100:00100000:1.0:1787826392.845622:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789956608 00000100:00100000:1.0:1787826392.845667:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111876 00000100:00100000:1.0:1787826392.845676:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+142:86750:x1874668789956608:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787826392.845715:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x145:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.845728:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce58 expref: 142 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.845735:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.845757:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce58 expref: 142 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.845766:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce58 expref: 142 pid: 6516 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.845787:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41046d00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778698496:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826392.845820:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826392.846495:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.846794:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789956864 00000100:00100000:3.0:1787826392.846800:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789956864 00000100:00100000:3.0:1787826392.846845:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111877 00000100:00100000:3.0:1787826392.846876:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+143:86752:x1874668789956864:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826392.846927:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x135:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.846941:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce5f expref: 143 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.846949:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.846977:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce5f expref: 143 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.846987:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce5f expref: 143 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.846999:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778698624:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826392.847044:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826392.847076:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778698368:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826392.847093:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.847270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826392.847388:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789956992 00000100:00100000:1.0:1787826392.847393:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789956992 00010000:00010000:1.0:1787826392.847414:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce51 expref: 144 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826392.847447:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3148 00000100:00100000:1.0:1787826392.847455:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+144:2402:x1874668789956992:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826392.847465:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826392.847471:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce51 expref: 144 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.847492:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce51 expref: 144 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.847511:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d32a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce51 expref: 144 pid: 25759 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.847526:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x146:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:1.0:1787826392.847531:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.847538:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.847544:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826392.847563:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826392.847597:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+143:2402:x1874668789956992:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 142us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.847604:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3148 00010000:00010000:3.0:1787826392.847772:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.847790:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.847992:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.848000:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.848006:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.848197:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826392.848201:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.848208:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.848218:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x146:0x0].0x0 (ffff9bbf41389300) 00010000:00010000:3.0:1787826392.848221:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826392.848225:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.848232:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d362 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x146:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.848459:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+143:86751:x1874668789956224:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 3572us (8792us total) trans 8590016791 rc 0/0 00000100:00100000:3.0:1787826392.848536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111875 00000100:00100000:0.0:1787826392.848897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.848998:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41046d00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778698496:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826392.849022:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.849218:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789957120 00000100:00100000:3.0:1787826392.849223:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789957120 00010000:00010000:3.0:1787826392.849249:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce58 expref: 143 pid: 6516 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.849297:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3149 00000100:00100000:3.0:1787826392.849306:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+143:2402:x1874668789957120:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826392.849317:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826392.849323:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce58 expref: 143 pid: 6516 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.849333:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce58 expref: 143 pid: 6516 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.849350:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d338 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce58 expref: 143 pid: 6516 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.849361:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x145:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:3.0:1787826392.849365:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.849374:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.849381:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.849403:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826392.849436:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+142:2402:x1874668789957120:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 131us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.849442:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3149 00010000:00010000:2.0:1787826392.849558:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.849566:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.849682:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.849690:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.849701:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.849707:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993da00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826392.849710:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.849717:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.849725:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x145:0x0].0x0 (ffff9bbe08124900) 00010000:00010000:2.0:1787826392.849728:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826392.849730:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826392.849736:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d369 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x145:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826392.849836:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+142:86750:x1874668789956608:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 4161us (4445us total) trans 8590016792 rc 0/0 00000100:00100000:2.0:1787826392.849845:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111876 00000100:00100000:1.0:1787826392.850425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.850818:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789957376 00000100:00100000:3.0:1787826392.850825:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789957376 00000100:00100000:2.0:1787826392.854120:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2760 00000100:00100000:2.0:1787826392.854139:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+142:86751:x1874668789957376:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.854792:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+143:86751:x1874668789957376:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 656us (4364us total) trans 8590016793 rc 0/0 00000100:00100000:2.0:1787826392.854802:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2760 00000100:00100000:0.0:1787826392.855206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826392.855370:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789957632 00000100:00100000:2.0:1787826392.855378:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789957632 00000100:00100000:2.0:1787826392.855459:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2761 00000100:00100000:2.0:1787826392.855468:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+143:86750:x1874668789957632:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826392.855655:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+144:86750:x1874668789957632:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 188us (451us total) trans 8590016794 rc 0/0 00000100:00100000:2.0:1787826392.855663:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2761 00000100:00100000:1.0:1787826392.860915:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826392.860982:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789957760 00000100:00100000:0.0:1787826392.860991:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789957760 00010000:00010000:0.0:1787826392.861030:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce5f expref: 144 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826392.861092:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3150 00000100:00100000:0.0:1787826392.861102:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+144:2401:x1874668789957760:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826392.861117:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826392.861123:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce5f expref: 144 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.861136:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce5f expref: 144 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.861159:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x135:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:0.0:1787826392.861164:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.861174:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.861181:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826392.861199:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826392.861257:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41046d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+144:2401:x1874668789957760:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 157us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.861265:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3150 00010000:00010000:3.0:1787826392.861584:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d346 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce5f expref: 143 pid: 6517 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.861602:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778698624:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826392.861621:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.861631:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.861642:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.861881:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.861889:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.861896:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.861901:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826392.861905:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.861912:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.861923:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x135:0x0].0x0 (ffff9bbe0bd66800) 00010000:00010000:3.0:1787826392.861926:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826392.861929:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826392.861935:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d370 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x135:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826392.862086:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+143:86752:x1874668789956864:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 15233us (15594us total) trans 8590016795 rc 0/0 00000100:00100000:3.0:1787826392.862094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111877 00000040:00080000:0.0:1787826392.863414:0:58820:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826392.863422:0:58820:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826392.863703:0:58820:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9724 count 21 00000040:00080000:0.0:1787826392.863714:0:58820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1787826392.864205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826392.864663:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789958016 00000100:00100000:3.0:1787826392.864672:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789958016 00000100:00100000:1.0:1787826392.864787:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2762 00000100:00100000:1.0:1787826392.864800:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+143:86752:x1874668789958016:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826392.865115:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+144:86752:x1874668789958016:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 318us (913us total) trans 8590016796 rc 0/0 00000100:00100000:1.0:1787826392.865124:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2762 00010000:00010000:0.0:1787826392.960015:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826393.032907:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826393.032949:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826393.032969:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826393.032988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826393.033014:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826393.033030:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826393.033048:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826393.033064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826393.033084:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826393.033113:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789958528 00000100:00100000:2.0:1787826393.033122:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789958528 00000100:00100000:2.0:1787826393.033175:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789959040 00000100:00100000:2.0:1787826393.033178:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789959040 00000100:00100000:2.0:1787826393.033194:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789958656 00000100:00100000:2.0:1787826393.033197:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789958656 00000100:00100000:2.0:1787826393.033216:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789959168 00000100:00100000:2.0:1787826393.033218:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789959168 00000100:00100000:2.0:1787826393.033236:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3561 00000100:00100000:2.0:1787826393.033245:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668789958528:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826393.033309:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668789958528:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 66us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.033316:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3561 00000100:00100000:2.0:1787826393.033332:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3562 00000100:00100000:2.0:1787826393.033337:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789959040:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826393.033357:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789959040:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 20us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.033363:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3562 00000100:00100000:2.0:1787826393.033371:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3563 00000100:00100000:2.0:1787826393.033376:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe100383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789958656:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826393.033393:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe100383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668789958656:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 17us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.033398:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3563 00000100:00100000:2.0:1787826393.033407:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3564 00000100:00100000:2.0:1787826393.033412:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789959168:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826393.033429:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789959168:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 17us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.033435:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3564 00000100:00100000:2.0:1787826393.033448:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789958272 00000100:00100000:2.0:1787826393.033451:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789958272 00000100:00100000:2.0:1787826393.033472:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789958784 00000100:00100000:2.0:1787826393.033474:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789958784 00000100:00100000:2.0:1787826393.033488:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789958400 00000100:00100000:2.0:1787826393.033490:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789958400 00000100:00100000:2.0:1787826393.033503:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789958912 00000100:00100000:2.0:1787826393.033505:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789958912 00000100:00100000:2.0:1787826393.033518:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5143 00000100:00100000:2.0:1787826393.033523:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c033840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+144:2402:x1874668789958272:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826393.033548:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c033840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+144:2402:x1874668789958272:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.033554:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5143 00000100:00100000:2.0:1787826393.033564:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5144 00000100:00100000:2.0:1787826393.033569:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+53:2402:x1874668789958784:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826393.033585:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c031680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+53:2402:x1874668789958784:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 17us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.033591:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5144 00000100:00100000:2.0:1787826393.033599:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5145 00000100:00100000:2.0:1787826393.033604:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789958400:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826393.033620:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789958400:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 16us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.033625:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5145 00000100:00100000:2.0:1787826393.033633:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5146 00000100:00100000:2.0:1787826393.033638:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789958912:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826393.033653:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789958912:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 15us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.033658:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5146 00000100:00080000:2.0:1787826393.033678:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826393.033682:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826393.033685:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826393.033686:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826393.033781:0:38188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789958144 00000100:00100000:3.0:1787826393.033786:0:38188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789958144 00000100:00100000:3.0:1787826393.033820:0:38188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 807 00000100:00100000:3.0:1787826393.033827:0:38188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3ddc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789958144:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826393.033869:0:38188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3ddc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789958144:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826393.033876:0:38188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 807 00000040:00080000:3.0:1787826393.920461:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826393.920468:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826393.920581:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9724 count 21 00000040:00080000:3.0:1787826393.920949:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1787826393.921078:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778698752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826393.921149:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826393.921608:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778698752 00000100:00100000:3.0:1787826393.921617:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778698752 00000100:00100000:3.0:1787826393.921694:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:3.0:1787826393.921703:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778698752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826393.921735:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 114688 granted 570305984 pending 172032 free 3828563968 avail 3597041664 00000100:00100000:3.0:1787826393.921800:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778698752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826393.921808:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:1.0:1787826393.922129:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778698752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787826393.922260:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826393.925608:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778699136:0@lo:400:kworker.0 00000100:00100000:2.0:1787826393.925676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826393.925722:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874668778699648:0@lo:400:kworker.0 00000100:00100000:2.0:1787826393.925748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826393.925784:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10038b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778700160:0@lo:400:kworker.0 00000100:00100000:2.0:1787826393.925808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.925890:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10038f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778699008:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.925923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.925942:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778699520:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.925960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.925973:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778700032:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.925990:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.926024:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778699008 00000100:00100000:1.0:1787826393.926031:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778699008 00000100:00100000:1.0:1787826393.926087:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3476 00000100:00100000:1.0:1787826393.926095:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778699008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926145:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778699008:12345-0@lo:400:kworker.0 Request processed in 50us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.926153:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3476 00000100:00100000:1.0:1787826393.926204:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10038f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778699008:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926229:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10039e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778699264:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926252:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.926268:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778699776:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926287:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.926303:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778700288:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926321:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.926353:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787826393.926359:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778698880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926387:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.926411:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10039680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778699392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926432:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.926449:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe100392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778699904:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826393.926485:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778699136 00000100:00100000:1.0:1787826393.926493:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778700160 00000100:00100000:2.0:1787826393.926494:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778699136 00000100:00100000:1.0:1787826393.926496:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778700160 00000100:00100000:2.0:1787826393.926524:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778699648 00000100:00100000:2.0:1787826393.926527:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778699648 00000100:00100000:1.0:1787826393.926530:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778700032 00000100:00100000:1.0:1787826393.926532:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778700032 00000100:00100000:1.0:1787826393.926548:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778699776 00000100:00100000:2.0:1787826393.926549:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778699520 00000100:00100000:1.0:1787826393.926551:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778699776 00000100:00100000:2.0:1787826393.926551:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778699520 00000100:00100000:2.0:1787826393.926566:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778699264 00000100:00100000:1.0:1787826393.926567:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3565 00000100:00100000:2.0:1787826393.926568:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778699264 00000100:00100000:1.0:1787826393.926573:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3646:x1874668778700160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826393.926582:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778700288 00000100:00100000:2.0:1787826393.926584:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778700288 00000100:00100000:2.0:1787826393.926593:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778699392 00000100:00100000:2.0:1787826393.926595:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778699392 00000100:00100000:2.0:1787826393.926608:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5147 00000100:00100000:2.0:1787826393.926614:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778699136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926622:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3646:x1874668778700160:12345-0@lo:400:kworker.0 Request processed in 49us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.926631:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3565 00000100:00100000:2.0:1787826393.926642:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778699136:12345-0@lo:400:kworker.0 Request processed in 28us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.926648:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5147 00000100:00100000:1.0:1787826393.926657:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3566 00000100:00100000:1.0:1787826393.926663:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3645:x1874668778700032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926697:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3645:x1874668778700032:12345-0@lo:400:kworker.0 Request processed in 34us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.926704:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3566 00000100:00100000:1.0:1787826393.926714:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3567 00000100:00100000:1.0:1787826393.926720:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778699776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926749:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778699776:12345-0@lo:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.926755:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3567 00000100:00100000:1.0:1787826393.926781:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778698880 00000100:00100000:1.0:1787826393.926784:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778698880 00000100:00100000:1.0:1787826393.926811:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:1.0:1787826393.926817:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3ddc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778698880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926846:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3ddc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778698880:12345-0@lo:400:kworker.0 Request processed in 29us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.926873:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:1.0:1787826393.926899:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5148 00000100:00100000:1.0:1787826393.926906:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874668778699648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926933:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874668778699648:12345-0@lo:400:kworker.0 Request processed in 28us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.926939:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5148 00000100:00100000:1.0:1787826393.926952:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5149 00000100:00100000:1.0:1787826393.926958:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778699520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.926984:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778699520:12345-0@lo:400:kworker.0 Request processed in 27us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.926990:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5149 00000100:00100000:1.0:1787826393.927001:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5150 00000100:00100000:1.0:1787826393.927007:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778699264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927030:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778699264:12345-0@lo:400:kworker.0 Request processed in 24us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.927036:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5150 00000100:00100000:1.0:1787826393.927047:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5151 00000100:00100000:1.0:1787826393.927053:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778700288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927078:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778700288:12345-0@lo:400:kworker.0 Request processed in 26us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.927083:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5151 00000100:00100000:1.0:1787826393.927094:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5152 00000100:00100000:1.0:1787826393.927100:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778699392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927125:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778699392:12345-0@lo:400:kworker.0 Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.927131:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5152 00000100:00100000:1.0:1787826393.927149:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778699904 00000100:00100000:1.0:1787826393.927153:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778699904 00000100:00100000:1.0:1787826393.927175:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3477 00000100:00100000:1.0:1787826393.927181:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778699904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927208:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778699904:12345-0@lo:400:kworker.0 Request processed in 28us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.927214:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3477 00000100:00080000:1.0:1787826393.927245:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826393.927250:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826393.927252:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826393.927254:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826393.927273:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778699520:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927282:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778700032:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927304:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778698880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927313:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10039680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778699392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927321:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe100392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778699904:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927329:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10039e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778699264:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927336:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778699776:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927344:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778700288:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927368:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778699136:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927376:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874668778699648:0@lo:400:kworker.0 00000100:00100000:1.0:1787826393.927385:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10038b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778700160:0@lo:400:kworker.0 00000001:00080000:2.0:1787826393.938942:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016796 is committed 00010000:00010000:0.0:1787826393.938992:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939004:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939011:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939017:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.939021:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939029:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939046:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xbc0ca3a9 (ffff9bbe0bd66a00) 00010000:00010000:0.0:1787826393.939048:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.939053:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826393.939083:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016760 is committed 00010000:00010000:0.0:1787826393.939131:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349c03e lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939230:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939241:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939248:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939253:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.939256:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939264:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939271:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9b50d0cc (ffff9bbe0bd66c00) 00010000:00010000:0.0:1787826393.939274:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.939277:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939282:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6800/0x68019081f349c0d8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939296:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939302:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939307:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939312:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.939315:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939320:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.939327:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x7a94fdef (ffff9bbe0bd66600) 00010000:00010000:3.0:1787826393.939618:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939626:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939631:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939637:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826393.939776:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939784:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939793:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1b19522f (ffff9bbe0fe8c100) 00010000:00010000:3.0:1787826393.939796:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826393.939799:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939805:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349bf65 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1b19522f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939819:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939825:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939829:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939834:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826393.939837:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.939844:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.940043:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826393.940046:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826393.940049:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.940054:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349bf6c lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940130:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.940136:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940143:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349c172 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940231:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940239:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940245:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940250:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.940253:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940258:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940266:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x59d92b11 (ffff9bbe12dd8900) 00010000:00010000:0.0:1787826393.940268:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.940271:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940276:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349c20c lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940289:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940295:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940300:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940304:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.940306:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940311:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940317:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x391d5834 (ffff9bbe12dd8a00) 00010000:00010000:0.0:1787826393.940319:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.940322:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940327:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349c2e5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940791:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940801:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940807:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940812:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.940815:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940821:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940829:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x18618557 (ffff9bbe12dd8000) 00010000:00010000:0.0:1787826393.940832:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.940835:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.940841:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349c37f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941242:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941251:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941256:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941261:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.941265:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941271:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941279:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xf7a5b27a (ffff9bbe12dd8600) 00010000:00010000:0.0:1787826393.941281:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.941284:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941290:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349c42e lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941306:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941311:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941316:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941321:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ec00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.941323:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941777:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941792:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd6e9df9d (ffff9bbe0bd66300) 00010000:00010000:0.0:1787826393.941794:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.941799:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941805:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349c4c8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941825:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941831:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941836:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941841:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ea00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.941843:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.941849:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942237:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xb62e0cbf (ffff9bbe12458f00) 00010000:00010000:0.0:1787826393.942240:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.942243:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942249:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349c562 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942267:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942277:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942283:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942288:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.942291:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942297:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942304:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x84832a57 (ffff9bbe12dd8800) 00010000:00010000:0.0:1787826393.942306:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.942308:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942314:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349c5fc lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.942326:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943021:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943029:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943035:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.943039:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943046:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943057:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc8b04d25 (ffff9bbe12458100) 00010000:00010000:0.0:1787826393.943429:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.943435:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943442:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349c6d5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943473:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943479:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943485:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943491:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.943493:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943498:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943507:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xcdd6ff3 (ffff9bbf41389100) 00010000:00010000:0.0:1787826393.943509:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.943512:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943517:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349c784 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943531:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943537:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943543:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943548:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.943551:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943556:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943563:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x510a92c1 (ffff9bbe12458600) 00010000:00010000:0.0:1787826393.943564:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.943567:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943572:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349c81e lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943584:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943606:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943611:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943615:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.943618:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943623:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.943629:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x9537b590 (ffff9bbe12458800) 00010000:00010000:0.0:1787826393.943631:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.943634:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.944511:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349c8b8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.944549:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.944556:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.944562:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.944568:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.944572:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.944579:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.945619:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xd964d85e (ffff9bbe12458900) 00010000:00010000:0.0:1787826393.945627:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.945633:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946108:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349c952 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946144:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946151:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946157:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946163:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.946166:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946173:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946183:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x1d91fb2c (ffff9bbf41389200) 00010000:00010000:0.0:1787826393.946186:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.946190:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946195:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349ca2b lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946210:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946216:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946221:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946226:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.946229:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946234:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946241:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x61bf1dfb (ffff9bbe16e56e00) 00010000:00010000:0.0:1787826393.946243:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.946246:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946253:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349cada lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946266:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946287:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946294:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946299:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.946301:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946306:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946322:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa5ec40c9 (ffff9bbe08124b00) 00010000:00010000:0.0:1787826393.946325:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.946328:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946342:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349cb74 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946357:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946363:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946378:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946384:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.946388:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946394:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946402:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xea196397 (ffff9bbf41389600) 00010000:00010000:0.0:1787826393.946404:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.946407:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946413:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349cc0e lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946427:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946433:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946439:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946445:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826393.946447:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946452:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946459:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x63c75779 (ffff9bbe08124700) 00010000:00010000:0.0:1787826393.946461:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.946464:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.946470:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349cca8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4c:0x0].0x63c75779 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.985014:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826394.059469:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826394.059560:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826394.059651:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789959424 00000100:00100000:0.0:1787826394.059659:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789959424 00000100:00100000:0.0:1787826394.059711:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6433 00000100:00100000:0.0:1787826394.059720:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668789959424:12345-192.168.203.9@tcp:16:kworker.0 00000100:00100000:0.0:1787826394.059828:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668789959424:12345-192.168.203.9@tcp:16:kworker.0 Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.059835:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6433 00000100:00100000:2.0:1787826394.066682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826394.066882:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789959680 00000100:00100000:1.0:1787826394.066891:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789959680 00000100:00100000:1.0:1787826394.066951:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6434 00000100:00100000:1.0:1787826394.066960:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789959680:12345-192.168.203.9@tcp:16:kworker.0 00000100:00100000:1.0:1787826394.067071:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789959680:12345-192.168.203.9@tcp:16:kworker.0 Request processed in 112us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.067079:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6434 00000100:00100000:2.0:1787826394.076425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826394.076540:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789959936 00000100:00100000:0.0:1787826394.076550:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789959936 00000100:00100000:0.0:1787826394.076611:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6435 00000100:00100000:0.0:1787826394.076622:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2401:x1874668789959936:12345-192.168.203.9@tcp:16:kworker.0 00000100:00100000:0.0:1787826394.076742:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2401:x1874668789959936:12345-192.168.203.9@tcp:16:kworker.0 Request processed in 122us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.076750:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6435 00000100:00100000:3.0:1787826394.081982:0:45405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789959296 00000100:00100000:3.0:1787826394.081998:0:45405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789959296 00002000:00100000:3.0:1787826394.082054:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xca:0x0] (0->1515) req@ffff9bbe0dd28000 x1874668789959296/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826394.082431:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dd28000 with x1874668789959296 ext(0->1515) 00002000:00010000:3.0:1787826394.082436:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0dd28000 00000100:00100000:3.0:1787826394.082477:0:45405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1600 00000100:00100000:3.0:1787826394.082487:0:45405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668789959296:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:1.0:1787826394.083303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826394.083344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826394.083480:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789959552 00000100:00100000:0.0:1787826394.083487:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789959552 00002000:00100000:0.0:1787826394.083518:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xcb:0x0] (0->1515) req@ffff9bbe0c1f6d00 x1874668789959552/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826394.083528:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c1f6d00 with x1874668789959552 ext(0->1515) 00002000:00010000:0.0:1787826394.083532:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0c1f6d00 00000100:00100000:0.0:1787826394.083555:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789959808 00000100:00100000:0.0:1787826394.083559:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789959808 00002000:00100000:0.0:1787826394.083574:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xcb:0x0] (0->1515) req@ffff9bbe0c1f61c0 x1874668789959808/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826394.083582:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c1f61c0 with x1874668789959808 ext(0->1515) 00002000:00010000:0.0:1787826394.083585:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0c1f61c0 00000100:00100000:0.0:1787826394.083600:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1601 00000100:00100000:0.0:1787826394.083607:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789959552:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:2.0:1787826394.083944:0:25758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1602 00000100:00100000:2.0:1787826394.083954:0:25758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+36:2401:x1874668789959808:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:1.0:1787826394.089013:0:45405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+38:2402:x1874668789959296:12345-192.168.203.9@tcp:4:cp.0 Request processed in 6516us (29541us total) trans 4294968208 rc 0/0 00000100:00100000:1.0:1787826394.089028:0:45405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1600 00002000:00100000:1.0:1787826394.089041:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xca:0x0] (0->1515) req@ffff9bbe0dd28000 x1874668789959296/t4294968208(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826394.089052:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dd28000 with x1874668789959296 ext(0->1515) 00002000:00010000:1.0:1787826394.089064:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0dd28000 00000100:00100000:2.0:1787826394.089753:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2401:x1874668789959552:12345-192.168.203.9@tcp:4:cp.0 Request processed in 6142us (6448us total) trans 4294968193 rc 0/0 00000100:00100000:2.0:1787826394.089763:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1601 00002000:00100000:2.0:1787826394.089781:0:8438:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xcb:0x0] (0->1515) req@ffff9bbe0c1f6d00 x1874668789959552/t4294968193(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826394.089791:0:8438:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c1f6d00 with x1874668789959552 ext(0->1515) 00002000:00010000:2.0:1787826394.089795:0:8438:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0c1f6d00 00000100:00100000:3.0:1787826394.090209:0:25758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2401:x1874668789959808:12345-192.168.203.9@tcp:4:cp.0 Request processed in 6255us (6862us total) trans 4294968209 rc 0/0 00000100:00100000:3.0:1787826394.090217:0:25758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1602 00002000:00100000:3.0:1787826394.090223:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xcb:0x0] (0->1515) req@ffff9bbe0c1f61c0 x1874668789959808/t4294968209(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826394.090231:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0c1f61c0 with x1874668789959808 ext(0->1515) 00002000:00010000:3.0:1787826394.090235:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0c1f61c0 00000100:00100000:3.0:1787826394.094222:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826394.094270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826394.094370:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789960064 00000100:00100000:1.0:1787826394.094379:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789960064 00002000:00100000:1.0:1787826394.094428:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xcc:0x0] (0->1515) req@ffff9bbf05cbf840 x1874668789960064/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826394.094441:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf05cbf840 with x1874668789960064 ext(0->1515) 00002000:00010000:1.0:1787826394.094447:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf05cbf840 00000100:00100000:1.0:1787826394.094483:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1603 00000100:00100000:1.0:1787826394.094492:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2402:x1874668789960064:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:2.0:1787826394.095279:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789960192 00000100:00100000:2.0:1787826394.095285:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789960192 00000100:00100000:2.0:1787826394.095333:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6436 00000100:00100000:2.0:1787826394.095342:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2402:x1874668789960192:12345-192.168.203.9@tcp:16:kworker.0 00000100:00100000:1.0:1787826394.098116:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+35:2402:x1874668789960064:12345-192.168.203.9@tcp:4:cp.0 Request processed in 3614us (3893us total) trans 4294968194 rc 0/0 00000100:00100000:1.0:1787826394.098130:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1603 00002000:00100000:1.0:1787826394.098143:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xcc:0x0] (0->1515) req@ffff9bbf05cbf840 x1874668789960064/t4294968194(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826394.098154:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf05cbf840 with x1874668789960064 ext(0->1515) 00002000:00010000:1.0:1787826394.100076:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf05cbf840 00000001:00080000:0.0:1787826394.101013:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968194 is committed 00000001:00080000:0.0:1787826394.101052:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968186 is committed 00000100:00100000:2.0:1787826394.110987:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789960192:12345-192.168.203.9@tcp:16:kworker.0 Request processed in 15634us (16704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.111001:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6436 00000100:00100000:0.0:1787826394.132909:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826394.132977:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826394.133178:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789960320 00000100:00100000:1.0:1787826394.133190:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789960320 00002000:00100000:1.0:1787826394.133239:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xcc:0x0] (0->1515) req@ffff9bbe1283e940 x1874668789960320/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826394.133251:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283e940 with x1874668789960320 ext(0->1515) 00002000:00010000:1.0:1787826394.133257:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe1283e940 00000100:00100000:1.0:1787826394.133297:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1604 00000100:00100000:1.0:1787826394.133308:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+37:2402:x1874668789960320:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:1.0:1787826394.134494:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2402:x1874668789960320:12345-192.168.203.9@tcp:4:cp.0 Request processed in 1182us (1589us total) trans 4294968210 rc 0/0 00000100:00100000:1.0:1787826394.134506:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1604 00002000:00100000:1.0:1787826394.134516:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xcc:0x0] (0->1515) req@ffff9bbe1283e940 x1874668789960320/t4294968210(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826394.134526:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283e940 with x1874668789960320 ext(0->1515) 00002000:00010000:1.0:1787826394.134531:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe1283e940 00000100:00100000:2.0:1787826394.136228:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789960448 00000100:00100000:2.0:1787826394.136241:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789960448 00000100:00100000:2.0:1787826394.136309:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6437 00000100:00100000:2.0:1787826394.136319:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+39:2401:x1874668789960448:12345-192.168.203.9@tcp:16:kworker.0 00000001:00080000:2.0:1787826394.146314:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968210 is committed 00000001:00080000:2.0:1787826394.146363:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968201 is committed 00000100:00100000:1.0:1787826394.150510:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789960448:12345-192.168.203.9@tcp:16:kworker.0 Request processed in 14181us (17520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.150525:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6437 00000100:00100000:3.0:1787826394.155268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826394.155313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826394.155623:0:45404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789960576 00000100:00100000:2.0:1787826394.155633:0:45404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789960576 00002000:00100000:2.0:1787826394.155690:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xcd:0x0] (0->1515) req@ffff9bbf05cbed00 x1874668789960576/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826394.155701:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf05cbed00 with x1874668789960576 ext(0->1515) 00002000:00010000:2.0:1787826394.155707:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf05cbed00 00000100:00100000:2.0:1787826394.155739:0:45404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1605 00000100:00100000:2.0:1787826394.155749:0:45404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789960576:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:1.0:1787826394.156714:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789960704 00000100:00100000:1.0:1787826394.156723:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789960704 00000100:00100000:1.0:1787826394.156782:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6438 00000100:00100000:1.0:1787826394.156791:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2402:x1874668789960704:12345-192.168.203.9@tcp:16:kworker.0 00000100:00100000:0.0:1787826394.157551:0:45404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2402:x1874668789960576:12345-192.168.203.9@tcp:4:cp.0 Request processed in 1799us (2288us total) trans 4294968195 rc 0/0 00000100:00100000:0.0:1787826394.157560:0:45404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1605 00002000:00100000:0.0:1787826394.157569:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xcd:0x0] (0->1515) req@ffff9bbf05cbed00 x1874668789960576/t4294968195(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826394.157580:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf05cbed00 with x1874668789960576 ext(0->1515) 00002000:00010000:0.0:1787826394.157585:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf05cbed00 00000001:00080000:0.0:1787826394.160333:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968195 is committed 00000100:00100000:1.0:1787826394.160491:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789960704:12345-192.168.203.9@tcp:16:kworker.0 Request processed in 3697us (5172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.160502:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6438 00000100:00100000:0.0:1787826394.169793:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826394.171781:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789960832 00000100:00100000:2.0:1787826394.171794:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789960832 00002000:00100000:2.0:1787826394.171891:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xcd:0x0] (0->1515) req@ffff9bbe1283ed00 x1874668789960832/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826394.171903:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283ed00 with x1874668789960832 ext(0->1515) 00002000:00010000:2.0:1787826394.171909:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe1283ed00 00000100:00100000:2.0:1787826394.171940:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1606 00000100:00100000:2.0:1787826394.171948:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2402:x1874668789960832:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:2.0:1787826394.173279:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789960832:12345-192.168.203.9@tcp:4:cp.0 Request processed in 1324us (3488us total) trans 4294968211 rc 0/0 00000100:00100000:2.0:1787826394.173290:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1606 00002000:00100000:2.0:1787826394.173299:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xcd:0x0] (0->1515) req@ffff9bbe1283ed00 x1874668789960832/t4294968211(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826394.173310:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283ed00 with x1874668789960832 ext(0->1515) 00002000:00010000:2.0:1787826394.173315:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe1283ed00 00000100:00100000:0.0:1787826394.179393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826394.180093:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789960960 00000100:00100000:2.0:1787826394.180103:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789960960 00000100:00100000:2.0:1787826394.180534:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6439 00000100:00100000:2.0:1787826394.180546:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789960960:12345-192.168.203.9@tcp:16:kworker.0 00000001:00080000:0.0:1787826394.182516:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968211 is committed 00000100:00100000:2.0:1787826394.183091:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2402:x1874668789960960:12345-192.168.203.9@tcp:16:kworker.0 Request processed in 2467us (3626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.183104:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6439 00000100:00100000:0.0:1787826394.186759:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826394.186965:0:45401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789961088 00000100:00100000:3.0:1787826394.186975:0:45401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789961088 00002000:00100000:3.0:1787826394.187036:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xd3:0x0] (0->1515) req@ffff9bbe102dcf00 x1874668789961088/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826394.187048:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe102dcf00 with x1874668789961088 ext(0->1515) 00002000:00010000:3.0:1787826394.187054:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe102dcf00 00000100:00100000:3.0:1787826394.187085:0:45401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1607 00000100:00100000:3.0:1787826394.187095:0:45401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789961088:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:3.0:1787826394.188262:0:45401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2402:x1874668789961088:12345-192.168.203.9@tcp:4:cp.0 Request processed in 1163us (1508us total) trans 4294968196 rc 0/0 00000100:00100000:3.0:1787826394.188273:0:45401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1607 00002000:00100000:3.0:1787826394.188282:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xd3:0x0] (0->1515) req@ffff9bbe102dcf00 x1874668789961088/t4294968196(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:750/0 lens 2008/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826394.188291:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe102dcf00 with x1874668789961088 ext(0->1515) 00002000:00010000:3.0:1787826394.188296:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe102dcf00 00000100:00100000:0.0:1787826394.190236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826394.190395:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789961216 00000100:00100000:2.0:1787826394.190406:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789961216 00000100:00100000:2.0:1787826394.190462:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6440 00000100:00100000:2.0:1787826394.190471:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2402:x1874668789961216:12345-192.168.203.9@tcp:16:kworker.0 00000001:00080000:0.0:1787826394.193503:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968196 is committed 00000100:00100000:2.0:1787826394.193703:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789961216:12345-192.168.203.9@tcp:16:kworker.0 Request processed in 3227us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.193715:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6440 00000040:00080000:3.0:1787826394.240980:0:58868:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787826394.240990:0:58868:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826394.241545:0:58868:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787826394.241558:0:58868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787826394.440769:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778700416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826394.440991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826394.441142:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778700416 00000100:00100000:1.0:1787826394.441150:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778700416 00000100:00100000:1.0:1787826394.441197:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:1.0:1787826394.441206:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778700416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826394.441231:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671100352 pending 0 free 3894738944 avail 3662929920 00000100:00100000:1.0:1787826394.441275:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778700416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.441281:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:1.0:1787826394.441327:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778700416:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826395.011519:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826395.968132:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778700544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826395.968203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826395.968559:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778700544 00000100:00100000:0.0:1787826395.968567:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778700544 00000100:00100000:0.0:1787826395.968620:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3478 00000100:00100000:0.0:1787826395.968628:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778700544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826395.968662:0:45684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440518144 avail 1294278656 00000100:00100000:0.0:1787826395.968719:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778700544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826395.968726:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3478 00000100:00100000:2.0:1787826395.968816:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778700544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826395.969080:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826395.969090:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778700672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826395.969121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826395.969192:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778700672 00000100:00100000:2.0:1787826395.969197:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778700672 00000100:00100000:2.0:1787826395.969223:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3479 00000100:00100000:2.0:1787826395.969230:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778700672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826395.969249:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1787826395.969288:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778700672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.969294:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3479 00000100:00100000:2.0:1787826395.969339:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778700672:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826396.032415:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826396.480050:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778700800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826396.480310:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826396.480548:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778700800 00000100:00100000:3.0:1787826396.480557:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778700800 00000100:00100000:3.0:1787826396.480610:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:3.0:1787826396.480621:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778700800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826396.480649:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570019264 pending 0 free 3828547584 avail 3597025280 00000100:00100000:3.0:1787826396.480693:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778700800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826396.480700:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00080000:3.0:1787826396.480721:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826396.481373:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968201 gen 2 00000100:00100000:3.0:1787826396.481703:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778700800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826396.482948:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dd2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778700928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826396.483017:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826396.483071:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778700928 00000100:00100000:2.0:1787826396.483078:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778700928 00000100:00100000:2.0:1787826396.483130:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:2.0:1787826396.483139:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778700928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826396.483167:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671100352 pending 0 free 3894722560 avail 3663200256 00000100:00100000:2.0:1787826396.483213:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778700928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826396.483220:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00080000:2.0:1787826396.483242:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826396.483263:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968186 gen 2 00000100:00100000:2.0:1787826396.483281:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dd2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778700928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787826397.057788:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787826397.100559:0:59013:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826397.100568:0:59013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826397.100868:0:59013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9724 count 21 00000040:00080000:3.0:1787826397.100876:0:59013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:3.0:1787826397.100949:0:59013:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826397.100952:0:59013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826397.102871:0:59013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9724 count 21 00000040:00080000:3.0:1787826397.102885:0:59013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:0.0:1787826398.084698:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826398.154113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826398.154158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826398.154183:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826398.154203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826398.154220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826398.154242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826398.154260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826398.154277:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826398.154299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826398.154326:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789961856 00000100:00100000:0.0:1787826398.154334:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789961856 00000100:00100000:0.0:1787826398.154481:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789962368 00000100:00100000:0.0:1787826398.154485:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789962368 00000100:00100000:0.0:1787826398.154503:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789961728 00000100:00100000:0.0:1787826398.154506:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789961728 00000100:00100000:0.0:1787826398.154523:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789962240 00000100:00100000:0.0:1787826398.154526:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789962240 00000100:00100000:0.0:1787826398.154545:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3568 00000100:00100000:0.0:1787826398.154554:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789961856:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826398.154999:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668789961856:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 444us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826398.155008:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3568 00000100:00100000:0.0:1787826398.155029:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3569 00000100:00100000:0.0:1787826398.155037:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789962368:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826398.155067:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789962368:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826398.155073:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3569 00000100:00100000:0.0:1787826398.155087:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3570 00000100:00100000:0.0:1787826398.155093:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2402:x1874668789961728:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826398.155117:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2402:x1874668789961728:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826398.155123:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3570 00000100:00100000:0.0:1787826398.155134:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3571 00000100:00100000:0.0:1787826398.155140:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789962240:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826398.155162:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789962240:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826398.155168:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3571 00000100:00100000:1.0:1787826398.156053:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789961344 00000100:00100000:1.0:1787826398.156062:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789961344 00000100:00100000:1.0:1787826398.156108:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 809 00000100:00100000:1.0:1787826398.156116:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3ddc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789961344:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826398.156156:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3ddc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668789961344:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 41us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.156163:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 809 00000100:00100000:1.0:1787826398.156194:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789961600 00000100:00100000:1.0:1787826398.156198:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789961600 00000100:00100000:1.0:1787826398.156227:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789962112 00000100:00100000:1.0:1787826398.156230:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789962112 00000100:00100000:1.0:1787826398.156248:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789961472 00000100:00100000:1.0:1787826398.156250:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789961472 00000100:00100000:1.0:1787826398.156264:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789961984 00000100:00100000:1.0:1787826398.156266:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789961984 00000100:00100000:1.0:1787826398.156283:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5153 00000100:00100000:1.0:1787826398.156289:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789961600:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826398.156317:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789961600:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.156323:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5153 00000100:00100000:1.0:1787826398.156335:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5154 00000100:00100000:1.0:1787826398.156341:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789962112:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826398.156377:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668789962112:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 36us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.156383:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5154 00000100:00100000:1.0:1787826398.156394:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5155 00000100:00100000:1.0:1787826398.156400:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+46:2402:x1874668789961472:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826398.156423:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+46:2402:x1874668789961472:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.156430:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5155 00000100:00100000:1.0:1787826398.156441:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5156 00000100:00100000:1.0:1787826398.156446:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+49:2402:x1874668789961984:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826398.156471:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+49:2402:x1874668789961984:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.156477:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5156 00000100:00080000:2.0:1787826398.157464:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826398.157471:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826398.157473:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826398.157476:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826399.040402:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826399.040424:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778701056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826399.040490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826399.040606:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778701056 00000100:00100000:1.0:1787826399.040623:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778701056 00000100:00100000:1.0:1787826399.040685:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:1.0:1787826399.040694:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778701056:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787826399.040714:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787826399.040726:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570019264 pending 0 free 3828547584 avail 3597025280 00000100:00100000:1.0:1787826399.040794:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778701056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826399.040801:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:0.0:1787826399.040894:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778701056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826399.042404:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778701184:0@lo:400:kworker.0 00000100:00100000:0.0:1787826399.042464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826399.042550:0:38188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778701184 00000100:00100000:1.0:1787826399.042557:0:38188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778701184 00000100:00100000:2.0:1787826399.042647:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778701312:0@lo:400:kworker.0 00000100:00100000:1.0:1787826399.042676:0:38188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1787826399.042683:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826399.042694:0:38188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3ddc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778701184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.042709:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826399.042715:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778701440:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.042759:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.043624:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778701568:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.043657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.043688:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778701440 00000100:00100000:2.0:1787826399.043693:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778701440 00000100:00100000:2.0:1787826399.043727:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778701568 00000100:00100000:2.0:1787826399.043740:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778701568 00000100:00100000:2.0:1787826399.043772:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5157 00000100:00100000:2.0:1787826399.043779:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778701440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.043821:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778701440:12345-0@lo:400:kworker.0 Request processed in 43us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.043828:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5157 00000100:00100000:2.0:1787826399.043845:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5158 00000100:00100000:2.0:1787826399.043871:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778701568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.043907:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778701568:12345-0@lo:400:kworker.0 Request processed in 56us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.043913:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5158 00000100:00100000:2.0:1787826399.043948:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778701440:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.043976:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778701568:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.044702:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778701312 00000100:00100000:2.0:1787826399.044708:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778701312 00000100:00100000:2.0:1787826399.044759:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3480 00000100:00100000:2.0:1787826399.044766:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778701312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.044820:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778701312:12345-0@lo:400:kworker.0 Request processed in 55us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.044827:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3480 00000100:00100000:2.0:1787826399.044890:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778701312:0@lo:400:kworker.0 00000100:00080000:2.0:1787826399.044921:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826399.049166:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778701824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.049249:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826399.049327:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874668778701952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.049514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826399.049553:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778701824 00000100:00100000:3.0:1787826399.049560:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778701824 00000100:00100000:3.0:1787826399.049725:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778701952 00000100:00100000:3.0:1787826399.049729:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778701952 00000100:00100000:3.0:1787826399.049763:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5159 00000100:00100000:3.0:1787826399.049771:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778701824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.049818:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778701824:12345-0@lo:400:kworker.0 Request processed in 47us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826399.049825:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5159 00000100:00100000:3.0:1787826399.049838:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5160 00000100:00100000:3.0:1787826399.049844:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874668778701952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.049889:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874668778701952:12345-0@lo:400:kworker.0 Request processed in 46us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826399.049895:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5160 00000100:00100000:3.0:1787826399.049930:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778701824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.049952:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874668778701952:0@lo:400:kworker.0 00000100:00080000:3.0:1787826399.049962:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826399.049965:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826399.049994:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778702336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.050020:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826399.050061:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778702464:0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.050079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826399.050170:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778702336 00000100:00100000:3.0:1787826399.050174:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778702336 00000100:00100000:3.0:1787826399.050252:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778702464 00000100:00100000:3.0:1787826399.050256:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778702464 00000100:00100000:3.0:1787826399.050276:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3572 00000100:00100000:3.0:1787826399.050282:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778702336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.050317:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778702336:12345-0@lo:400:kworker.0 Request processed in 35us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826399.050324:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3572 00000100:00100000:3.0:1787826399.050335:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3573 00000100:00100000:3.0:1787826399.050410:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778702464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.050439:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778702464:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826399.050445:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3573 00000100:00100000:3.0:1787826399.050470:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778702336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826399.050486:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778702464:0@lo:400:kworker.0 00000100:00080000:3.0:1787826399.050494:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826399.050497:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826399.050721:0:38188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3ddc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778701184:12345-0@lo:400:kworker.0 Request processed in 8030us (8253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826399.050743:0:38188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1787826399.050769:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778702080:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.050802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.050886:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778702592:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.050908:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.050923:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787826399.050928:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778701696:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.050944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.050956:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17f1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778702208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.050975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.051003:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778702208 00000100:00100000:2.0:1787826399.051007:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778702208 00000100:00100000:2.0:1787826399.051033:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3481 00000100:00100000:2.0:1787826399.051038:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778702208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.051069:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778702208:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.051075:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3481 00000100:00100000:2.0:1787826399.051091:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778702592 00000100:00100000:2.0:1787826399.051104:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778702592 00000100:00100000:2.0:1787826399.051124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778701696 00000100:00100000:2.0:1787826399.051126:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778701696 00000100:00100000:2.0:1787826399.051144:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5161 00000100:00100000:2.0:1787826399.051149:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778702592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.051173:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874668778702592:12345-0@lo:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.051178:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5161 00000100:00100000:2.0:1787826399.051202:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5162 00000100:00100000:2.0:1787826399.051208:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778701696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.051230:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874668778701696:12345-0@lo:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.051236:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5162 00000100:00100000:2.0:1787826399.051268:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874668778701696:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.051280:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778702208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826399.051287:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874668778702592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826399.051739:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778701184:0@lo:400:kworker.0 00000100:00080000:3.0:1787826399.051814:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826399.054368:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778702080 00000100:00100000:1.0:1787826399.054380:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778702080 00000100:00100000:1.0:1787826399.054452:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3574 00000100:00100000:1.0:1787826399.054461:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778702080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826399.054549:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778702080:12345-0@lo:400:kworker.0 Request processed in 90us (3746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826399.054556:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3574 00000100:00100000:1.0:1787826399.054603:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17f1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778702080:0@lo:400:kworker.0 00000100:00080000:2.0:1787826399.056788:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826399.104769:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826399.557099:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826399.557122:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778702720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826399.557206:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.557519:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778702720 00000100:00100000:2.0:1787826399.557527:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778702720 00000100:00100000:2.0:1787826399.557594:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:2.0:1787826399.557604:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778702720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826399.557645:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671100352 pending 0 free 3894722560 avail 3663200256 00000100:00100000:2.0:1787826399.557707:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778702720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.557714:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:00100000:0.0:1787826399.557801:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778702720:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1787826400.064231:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826400.064241:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826400.064455:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9724 count 21 00000040:00080000:0.0:1787826400.064464:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:1.0:1787826400.128997:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787826400.384211:0:58480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787826400.384221:0:58480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826400.384910:0:58480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787826400.384922:0:58480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787826401.088312:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778702848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826401.088385:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826401.088506:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778702848 00000100:00100000:0.0:1787826401.088513:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778702848 00000100:00100000:0.0:1787826401.088566:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3482 00000100:00100000:0.0:1787826401.088575:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778702848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826401.088616:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440518144 avail 1294278656 00000100:00100000:0.0:1787826401.088669:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778702848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826401.088676:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3482 00000100:00100000:1.0:1787826401.088898:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778702848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826401.096029:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778702976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826401.096098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826401.096191:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778702976 00000100:00100000:0.0:1787826401.096199:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778702976 00000100:00100000:0.0:1787826401.096253:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3483 00000100:00100000:0.0:1787826401.096261:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778702976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826401.096295:0:45684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826401.096587:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778702976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 325us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826401.096595:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3483 00000100:00100000:3.0:1787826401.096779:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778702976:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826401.159062:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826401.600127:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778703104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826401.600264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826401.600368:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778703104 00000100:00100000:1.0:1787826401.600376:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778703104 00000100:00100000:1.0:1787826401.600426:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:1.0:1787826401.600435:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778703104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826401.600461:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570019264 pending 0 free 3828547584 avail 3597025280 00000100:00100000:1.0:1787826401.602466:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778703104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2026us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826401.602479:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000100:00080000:1.0:1787826401.602508:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826401.602785:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778703104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826401.602807:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826401.602817:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778703232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826401.602874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826401.602972:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778703232 00000100:00100000:1.0:1787826401.602978:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778703232 00000100:00100000:1.0:1787826401.603019:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:1.0:1787826401.603026:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778703232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826401.603114:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671100352 pending 0 free 3894722560 avail 3663200256 00000100:00100000:1.0:1787826401.603221:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778703232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 194us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826401.603228:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00080000:0.0:1787826401.603378:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826401.603401:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778703232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826401.806187:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826401.806299:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789962496 00000100:00100000:1.0:1787826401.806308:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789962496 00000100:00100000:1.0:1787826401.806378:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111878 00000100:00100000:1.0:1787826401.806387:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+46:86609:x1874668789962496:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787826401.806484:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+46:86609:x1874668789962496:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826401.806493:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111878 00000100:00080000:0.0:1787826401.806805:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826401.824893:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826401.825032:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789962624 00000100:00100000:3.0:1787826401.825041:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789962624 00000100:00100000:3.0:1787826401.825112:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111879 00000100:00100000:3.0:1787826401.825123:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:86609:x1874668789962624:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787826401.825238:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:86609:x1874668789962624:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 118us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.825246:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111879 00000100:00080000:0.0:1787826401.825871:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787826402.176298:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826403.207321:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826403.274742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826403.274832:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826403.274889:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826403.274921:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826403.274944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826403.274967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826403.274986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826403.275013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826403.275044:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789963264 00000100:00100000:1.0:1787826403.275056:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789963264 00000100:00100000:1.0:1787826403.275137:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789963776 00000100:00100000:1.0:1787826403.275141:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789963776 00000100:00100000:1.0:1787826403.275166:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789963136 00000100:00100000:1.0:1787826403.275169:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789963136 00000100:00100000:1.0:1787826403.275346:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3575 00000100:00100000:1.0:1787826403.275358:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2401:x1874668789963264:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826403.275446:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2401:x1874668789963264:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 90us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.275455:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3575 00000100:00100000:1.0:1787826403.275474:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3576 00000100:00100000:1.0:1787826403.275480:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe100392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789963776:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826403.275504:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe100392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789963776:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.275510:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3576 00000100:00100000:1.0:1787826403.275521:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3577 00000100:00100000:1.0:1787826403.275528:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789963136:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826403.275565:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789963136:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 36us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.275571:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3577 00000100:00100000:1.0:1787826403.275592:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789963008 00000100:00100000:1.0:1787826403.275595:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789963008 00000100:00100000:1.0:1787826403.275634:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789963520 00000100:00100000:1.0:1787826403.275637:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789963520 00000100:00100000:1.0:1787826403.275655:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789962880 00000100:00100000:1.0:1787826403.275658:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789962880 00000100:00100000:1.0:1787826403.275676:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789963392 00000100:00100000:1.0:1787826403.275679:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789963392 00000100:00100000:2.0:1787826403.275819:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5163 00000100:00100000:2.0:1787826403.275830:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789963008:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826403.275891:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789963008:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 64us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.275898:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5163 00000100:00100000:2.0:1787826403.275914:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5164 00000100:00100000:2.0:1787826403.275920:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789963520:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826403.275944:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789963520:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.275950:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5164 00000100:00100000:2.0:1787826403.275961:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5165 00000100:00100000:2.0:1787826403.275967:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+46:2401:x1874668789962880:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826403.275995:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+46:2401:x1874668789962880:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.276001:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5165 00000100:00100000:1.0:1787826403.276396:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5166 00000100:00100000:1.0:1787826403.276405:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+49:2401:x1874668789963392:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826403.276436:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+49:2401:x1874668789963392:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 33us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.276442:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5166 00000100:00080000:1.0:1787826403.276472:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826403.276476:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826403.276479:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826403.276481:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826403.277662:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789962752 00000100:00100000:0.0:1787826403.277678:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789962752 00000100:00100000:0.0:1787826403.277754:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 811 00000100:00100000:0.0:1787826403.277763:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789962752:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826403.277824:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789962752:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 63us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.277831:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 811 00000100:00100000:1.0:1787826403.278747:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826403.278812:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789963648 00000100:00100000:3.0:1787826403.278820:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789963648 00000100:00100000:3.0:1787826403.278904:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3578 00000100:00100000:3.0:1787826403.278914:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789963648:12345-192.168.203.9@tcp:400:kworker.0 00000100:00080000:1.0:1787826403.278960:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826403.278977:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789963648:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 66us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.278985:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3578 00000001:02000400:3.0:1787826403.556493:0:59212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 103a: Purge pending restore requests == 06:26:42 (1787826402) 00000100:00100000:0.0:1787826404.163495:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778703360:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.163603:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.163665:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778703872:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.163710:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.163731:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778704384:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.163758:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.163778:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778704896:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.163801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.163838:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787826404.163844:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778703488:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.163909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.163925:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778704000:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.163945:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.163964:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17085a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778704512:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.163990:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.164021:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778703616:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.164045:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.164062:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778704128:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.164083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.164099:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe170852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778704640:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.164120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.164141:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826404.164148:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe128383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778703744:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.164171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.164186:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778704256:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.164207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.164222:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778704768:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.164243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826404.164285:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778703360 00000100:00100000:0.0:1787826404.164295:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778703360 00000100:00100000:0.0:1787826404.164361:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1787826404.164372:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778703360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826404.164429:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778703872 00000100:00100000:1.0:1787826404.164436:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778703872 00000100:00100000:0.0:1787826404.164437:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778703360:12345-0@lo:400:kworker.0 Request processed in 66us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.164448:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1787826404.164493:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778704384 00000100:00100000:0.0:1787826404.164498:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778704384 00000100:00100000:0.0:1787826404.164530:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778704000 00000100:00100000:0.0:1787826404.164533:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778704000 00000100:00100000:0.0:1787826404.164556:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778704640 00000100:00100000:0.0:1787826404.164559:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778704640 00000100:00100000:0.0:1787826404.164577:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778704768 00000100:00100000:0.0:1787826404.164580:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778704768 00000100:00100000:0.0:1787826404.164594:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3579 00000100:00100000:0.0:1787826404.164600:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778704384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.164636:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778704384:12345-0@lo:400:kworker.0 Request processed in 36us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.164643:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3579 00000100:00100000:0.0:1787826404.164655:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3580 00000100:00100000:0.0:1787826404.164661:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778704000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826404.164681:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778704896 00000100:00100000:1.0:1787826404.164687:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778704896 00000100:00100000:0.0:1787826404.164693:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778704000:12345-0@lo:400:kworker.0 Request processed in 31us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.164711:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3580 00000100:00100000:0.0:1787826404.164726:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3581 00000100:00100000:1.0:1787826404.164731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5167 00000100:00100000:0.0:1787826404.164736:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778704640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826404.164744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778703872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.164775:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778704640:12345-0@lo:400:kworker.0 Request processed in 41us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.164783:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3581 00000100:00100000:0.0:1787826404.164797:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3582 00000100:00100000:1.0:1787826404.164801:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778703872:12345-0@lo:400:kworker.0 Request processed in 59us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.164808:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778704768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826404.164815:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5167 00000100:00100000:1.0:1787826404.164836:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778703616 00000100:00100000:1.0:1787826404.164841:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778703616 00000100:00100000:0.0:1787826404.164846:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778704768:12345-0@lo:400:kworker.0 Request processed in 40us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.164872:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582 00000100:00100000:0.0:1787826404.164901:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778703488 00000100:00100000:0.0:1787826404.164905:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778703488 00000100:00100000:1.0:1787826404.164911:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778704128 00000100:00100000:1.0:1787826404.164917:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778704128 00000100:00100000:0.0:1787826404.164940:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778704512 00000100:00100000:0.0:1787826404.164944:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778704512 00000100:00100000:0.0:1787826404.164965:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3484 00000100:00100000:0.0:1787826404.164971:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778703488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.165007:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778703488:12345-0@lo:400:kworker.0 Request processed in 36us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.165013:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3484 00000100:00100000:0.0:1787826404.165025:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3485 00000100:00100000:0.0:1787826404.165031:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe02259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778704512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.165060:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe02259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778704512:12345-0@lo:400:kworker.0 Request processed in 29us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.165066:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3485 00000100:00100000:1.0:1787826404.165147:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778703744 00000100:00100000:1.0:1787826404.165152:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778703744 00000100:00100000:1.0:1787826404.165190:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778704256 00000100:00100000:1.0:1787826404.165194:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778704256 00000100:00100000:1.0:1787826404.165215:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5168 00000100:00100000:1.0:1787826404.165223:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778704896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826404.165268:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874668778704896:12345-0@lo:400:kworker.0 Request processed in 45us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.165275:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5168 00000100:00100000:1.0:1787826404.165299:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5169 00000100:00100000:1.0:1787826404.165307:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778703616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826404.165340:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778703616:12345-0@lo:400:kworker.0 Request processed in 35us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.165347:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5169 00000100:00100000:1.0:1787826404.165361:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5170 00000100:00100000:1.0:1787826404.165369:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778704128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.165373:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5171 00000100:00100000:0.0:1787826404.165384:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778703744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826404.165427:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778704128:12345-0@lo:400:kworker.0 Request processed in 59us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.165434:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778703744:12345-0@lo:400:kworker.0 Request processed in 50us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.165438:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5170 00000100:00100000:0.0:1787826404.165447:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5171 00000100:00100000:1.0:1787826404.165455:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5172 00000100:00100000:1.0:1787826404.165465:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778704256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.166836:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe128383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778703744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826404.167246:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778704256:12345-0@lo:400:kworker.0 Request processed in 1779us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.167258:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5172 00000100:00080000:1.0:1787826404.167300:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826404.167306:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826404.167309:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826404.167312:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826404.167419:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778705024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826404.167475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826404.167531:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778705024 00000100:00100000:2.0:1787826404.167538:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778705024 00000100:00100000:2.0:1787826404.167589:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:2.0:1787826404.167598:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778705024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826404.167630:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570019264 pending 0 free 3828547584 avail 3597025280 00000100:00100000:2.0:1787826404.167677:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778705024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826404.167683:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:2.0:1787826404.167742:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778705024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826404.168768:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778703488:0@lo:400:kworker.0 00000100:00100000:2.0:1787826404.168786:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778704000:0@lo:400:kworker.0 00000100:00100000:2.0:1787826404.168799:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17085a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778704512:0@lo:400:kworker.0 00000100:00100000:2.0:1787826404.168811:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778703360:0@lo:400:kworker.0 00000100:00100000:2.0:1787826404.168823:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778703872:0@lo:400:kworker.0 00000100:00100000:2.0:1787826404.168835:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778704384:0@lo:400:kworker.0 00000100:00100000:2.0:1787826404.169007:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874668778704896:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.171502:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778704768:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.171530:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778703616:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.171546:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778704128:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.171560:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe170852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778704640:0@lo:400:kworker.0 00000100:00100000:0.0:1787826404.171614:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778704256:0@lo:400:kworker.0 00010000:00010000:3.0:1787826404.224158:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826404.678044:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10038f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778705152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826404.678409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826404.681229:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778705152 00000100:00100000:2.0:1787826404.681249:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778705152 00000100:00100000:2.0:1787826404.681330:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:2.0:1787826404.681342:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778705152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826404.681387:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671100352 pending 0 free 3894722560 avail 3663200256 00000100:00100000:2.0:1787826404.681499:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778705152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826404.681512:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00100000:0.0:1787826404.681808:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10038f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778705152:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826405.250095:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826405.959821:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826405.960077:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789964032 00000100:00100000:0.0:1787826405.960089:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789964032 00000100:00080000:1.0:1787826405.960161:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826405.960190:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111880 00000100:00100000:0.0:1787826405.960204:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+46:87419:x1874668789964032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826405.960231:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826405.960260:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d377 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce66 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960362:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960381:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960398:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960415:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960424:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960430:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960558:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d38c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960567:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d38c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960574:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d38c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826405.960584:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787826405.960714:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960723:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960729:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960735:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960742:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826405.960747:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960759:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960773:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bbe0a651100) 00010000:00010000:0.0:1787826405.960777:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826405.960783:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960790:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d37e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960808:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960815:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960821:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960826:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826405.960829:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960835:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960843:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bbe16467200) 00010000:00010000:0.0:1787826405.960846:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826405.960849:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.960927:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d385 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.961359:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d377 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce66 expref: 49 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.961377:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d38c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce66 expref: 48 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826405.961385:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826405.961387:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826405.961389:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205a00, rc 0) 00000100:00100000:0.0:1787826405.961479:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+48:87419:x1874668789964032:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1277us (1672us total) trans 8590016797 rc 0/0 00000100:00100000:0.0:1787826405.961488:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111880 00000100:00100000:3.0:1787826405.967563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826405.967869:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826405.967926:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789964416 00000100:00100000:3.0:1787826405.967938:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789964416 00000100:00100000:3.0:1787826405.968028:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17301 00000100:00100000:3.0:1787826405.968039:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2401:x1874668789964416:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826405.968061:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826405.968205:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d38c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce66 expref: 48 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826405.968228:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826405.968234:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826405.968414:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2401:x1874668789964416:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 375us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826405.968423:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17301 00000100:00100000:1.0:1787826405.972931:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789964288 00000100:00100000:1.0:1787826405.972953:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789964288 00000100:00100000:1.0:1787826405.973127:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2763 00000100:00100000:1.0:1787826405.973141:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+47:87419:x1874668789964288:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787826405.973478:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+48:87419:x1874668789964288:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 338us (5928us total) trans 8590016798 rc 0/0 00000100:00100000:1.0:1787826405.973487:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2763 00000100:00100000:1.0:1787826405.979304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826405.980492:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789964544 00000100:00100000:2.0:1787826405.980509:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789964544 00000100:00100000:2.0:1787826405.980617:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111881 00000100:00100000:2.0:1787826405.980629:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+48:87419:x1874668789964544:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787826405.980904:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+48:87419:x1874668789964544:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 275us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826405.980914:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111881 00000100:00100000:2.0:1787826406.003311:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.003910:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789964672 00000100:00100000:0.0:1787826406.003924:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789964672 00000100:00100000:0.0:1787826406.004080:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111882 00000100:00100000:0.0:1787826406.004095:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+23:87419:x1874668789964672:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787826406.004245:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+23:87419:x1874668789964672:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 154us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.004254:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111882 00000100:00080000:1.0:1787826406.006344:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826406.050793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.051426:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789964800 00000100:00100000:2.0:1787826406.051441:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789964800 00000100:00100000:2.0:1787826406.051555:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111883 00000100:00100000:2.0:1787826406.051575:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+49:87424:x1874668789964800:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826406.051603:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826406.051629:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d39a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce6d expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051739:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051756:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051771:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051788:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051797:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051803:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051898:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051906:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051911:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051917:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.051922:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051930:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051942:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:2.0:1787826406.051945:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.051950:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051957:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d3a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051971:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051979:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051984:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051989:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cebe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.051991:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.051997:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.052005:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbaabd53a (ffff9bbe16cc5b00) 00010000:00010000:2.0:1787826406.052007:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.052010:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.052017:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.052055:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d39a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce6d expref: 50 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.052067:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:2.0:1787826406.052069:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:1.0:1787826406.052253:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787826406.052574:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d39a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce6d expref: 50 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.052597:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb000, rc 0) 00000100:00100000:2.0:1787826406.052835:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+49:87424:x1874668789964800:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1261us (2054us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826406.052846:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111883 00000100:00100000:3.0:1787826406.070130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826406.070481:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789965056 00000100:00100000:1.0:1787826406.070494:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789965056 00000100:00100000:1.0:1787826406.070584:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111884 00000100:00100000:1.0:1787826406.070596:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+49:87424:x1874668789965056:12345-192.168.203.9@tcp:36:lfs.0 00010000:00010000:1.0:1787826406.070675:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826406.070724:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349bf7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc23b expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.070749:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:1.0:1787826406.070755:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826406.070839:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.070897:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc250 expref: 47 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.070908:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.070952:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc250 expref: 47 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.070970:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc250 expref: 47 pid: 23845 timeout: 3144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826406.070987:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778705280:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826406.071267:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15babcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826406.074676:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778705280:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826406.074733:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826406.076515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.076630:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789965184 00000100:00100000:0.0:1787826406.076641:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789965184 00010000:00010000:0.0:1787826406.076712:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc250 expref: 48 pid: 23845 timeout: 3144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826406.076766:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3151 00000100:00100000:0.0:1787826406.076777:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2401:x1874668789965184:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826406.076808:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826406.076815:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc250 expref: 48 pid: 23845 timeout: 3144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.076831:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc250 expref: 48 pid: 23845 timeout: 3144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.076901:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3800/0x68019081f349bfb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fc250 expref: 48 pid: 23845 timeout: 3144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.076925:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826406.076932:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.076943:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.076953:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.076979:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826406.077056:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2401:x1874668789965184:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 280us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.077064:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3151 00010000:00010000:2.0:1787826406.077464:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.077474:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.077505:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.077518:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.077528:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080572:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080599:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080617:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826406.080638:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac7ed051 reply state 00000000d4a67e67 transno 8590016799 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080651:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080659:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.080662:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826406.080667:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787826406.080675:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4d:0x0]: returning size 4096 00010000:00010000:2.0:1787826406.080705:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080713:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080719:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080727:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993da00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.080733:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080742:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080756:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:2.0:1787826406.080759:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.080764:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080771:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d3af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826406.080790:0:25759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac7ed051 reply state 00000000d4a67e67 transno 8590016799 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080798:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.080805:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbaabd53a (ffff9bbe16cc5b00) 00010000:00010000:2.0:1787826406.080808:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826406.080810:0:25759:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787826406.080967:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+50:87424:x1874668789965056:12345-192.168.203.9@tcp:36:lfs.0 Request processed in 10368us (10847us total) trans 8590016799 rc 0/0 00000100:00100000:2.0:1787826406.080977:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111884 00000100:00100000:3.0:1787826406.100372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.100541:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789965312 00000100:00100000:0.0:1787826406.100554:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789965312 00000100:00100000:0.0:1787826406.100650:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111885 00000100:00100000:0.0:1787826406.100661:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+50:87425:x1874668789965312:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826406.100705:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.100733:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d3c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce74 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.100819:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d3cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.100835:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d3cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.100849:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d3cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826406.100964:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826406.100968:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826406.100992:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d3cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.101019:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d3c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce74 expref: 52 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.101039:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d3cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce74 expref: 51 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.101049:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826406.101052:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826406.101057:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205c00, rc 0) 00000100:00100000:0.0:1787826406.101136:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+51:87425:x1874668789965312:12345-192.168.203.9@tcp:101:bash.0 Request processed in 476us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.101145:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111885 00000100:00100000:1.0:1787826406.105358:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.105634:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789965440 00000100:00100000:0.0:1787826406.105648:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789965440 00000100:00100000:0.0:1787826406.105740:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111886 00000100:00100000:0.0:1787826406.105752:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+51:87425:x1874668789965440:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826406.105777:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.105803:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d3d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce7b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.105914:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.105932:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.105944:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106340:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106349:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106356:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106469:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349d3e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106478:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349d3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106484:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349d3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826406.106531:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4d:0x0]: returning size 4096 00000004:00200000:0.0:1787826406.106536:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826406.106560:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349d3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106576:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106584:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106590:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106596:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106602:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.106607:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106614:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106628:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826406.106632:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.106637:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106643:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d3d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106659:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106665:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106670:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106674:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.106677:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106969:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106980:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbaabd53a (ffff9bbe16cc5b00) 00010000:00010000:0.0:1787826406.106982:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.106985:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.106990:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d3e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.107025:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d3d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce7b expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.107046:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205400/0x68019081f349d3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce7b expref: 52 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.107053:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.107055:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787826406.107058:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205400, rc 0) 00000100:00100000:0.0:1787826406.107284:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+52:87425:x1874668789965440:12345-192.168.203.9@tcp:101:bash.0 Request processed in 1533us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.107294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111886 00000100:00100000:1.0:1787826406.110830:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.111261:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789965568 00000100:00100000:0.0:1787826406.111274:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789965568 00000100:00100000:0.0:1787826406.111350:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111887 00000100:00100000:0.0:1787826406.111363:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+52:87425:x1874668789965568:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826406.111389:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.111416:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d3ee lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce82 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111502:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111520:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111533:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111549:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111557:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111562:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111630:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111639:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111646:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111652:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.111657:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111665:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111678:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.111692:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.111698:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111704:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d3f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111720:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111727:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111733:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111739:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.111741:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111748:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111755:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xde9470f2 (ffff9bbe16467200) 00010000:00010000:0.0:1787826406.111758:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.111761:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111766:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d3fc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111806:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d3ee lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce82 expref: 53 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111818:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.111820:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.111823:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d3ee lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce82 expref: 53 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.111838:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826406.111934:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+52:87425:x1874668789965568:12345-192.168.203.9@tcp:101:bash.0 Request processed in 572us (1118us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.111942:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111887 00000100:00100000:1.0:1787826406.129620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.129744:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789965696 00000100:00100000:2.0:1787826406.129756:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789965696 00000100:00100000:2.0:1787826406.129834:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111888 00000100:00100000:2.0:1787826406.129845:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+47:87426:x1874668789965696:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826406.129923:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826406.130173:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d403 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce89 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.130267:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.130284:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.130303:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826406.130360:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787826406.130365:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826406.130391:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.130419:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce89 expref: 49 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.130440:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce89 expref: 48 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.130451:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:2.0:1787826406.130454:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826406.130458:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceba00, rc 0) 00000100:00100000:2.0:1787826406.130543:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+48:87426:x1874668789965696:12345-192.168.203.9@tcp:101:rm.0 Request processed in 699us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826406.130551:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111888 00000100:00100000:1.0:1787826406.134454:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.134568:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789965824 00000100:00100000:0.0:1787826406.134583:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789965824 00000100:00100000:0.0:1787826406.134657:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111889 00000100:00100000:0.0:1787826406.134669:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+48:87426:x1874668789965824:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826406.134708:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.134738:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d411 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce90 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.134823:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.134842:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.134908:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.134923:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.134931:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.134939:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135049:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d426 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135059:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d426 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135067:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d426 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826406.135192:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4d:0x0]: returning size 4096 00000004:00200000:0.0:1787826406.135197:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826406.135228:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d426 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135248:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135256:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135263:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135271:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135278:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.135283:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135292:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135309:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826406.135312:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.135318:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135325:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135344:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135351:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135356:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135362:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.135365:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135371:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135378:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbaabd53a (ffff9bbe16cc5b00) 00010000:00010000:0.0:1787826406.135381:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.135384:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135390:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d41f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135425:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce90 expref: 50 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135441:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205800/0x68019081f349d426 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce90 expref: 49 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.135449:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.135451:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787826406.135454:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205800, rc 0) 00000100:00100000:0.0:1787826406.135537:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87426:x1874668789965824:12345-192.168.203.9@tcp:101:rm.0 Request processed in 870us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.135545:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111889 00000100:00100000:1.0:1787826406.140224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.140320:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789965952 00000100:00100000:0.0:1787826406.140333:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789965952 00000100:00100000:0.0:1787826406.140411:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111890 00000100:00100000:0.0:1787826406.140422:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87426:x1874668789965952:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826406.140448:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.140476:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d42d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce97 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140580:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140598:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140614:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140634:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140643:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140650:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140892:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140901:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140909:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140916:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.140921:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140930:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140945:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.140948:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.140953:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140959:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d434 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140977:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140983:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140988:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.140994:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.140996:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.141001:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.141008:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xde9470f2 (ffff9bbe16467200) 00010000:00010000:0.0:1787826406.141010:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.141012:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.141018:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d43b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.141065:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d42d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce97 expref: 50 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.141077:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.141080:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.141085:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d42d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce97 expref: 50 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.141095:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204800, rc 0) 00000100:00100000:0.0:1787826406.141176:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87426:x1874668789965952:12345-192.168.203.9@tcp:101:rm.0 Request processed in 756us (968us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.141198:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111890 00000100:00100000:1.0:1787826406.145412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.145525:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789966080 00000100:00100000:2.0:1787826406.145537:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789966080 00000100:00100000:2.0:1787826406.145624:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111891 00000100:00100000:2.0:1787826406.145636:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87426:x1874668789966080:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826406.145661:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826406.146004:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d442 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fce9e expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.146618:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.146642:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.146657:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.146676:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147031:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147041:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147208:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147217:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147223:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147230:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147237:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.147241:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147250:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147265:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.147269:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.147274:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147280:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d449 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147296:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147302:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147309:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147314:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.147316:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147322:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147329:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xde9470f2 (ffff9bbf14059500) 00010000:00010000:3.0:1787826406.147331:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.147333:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147339:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d450 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147393:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d442 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce9e expref: 50 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147405:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.147407:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.147411:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d442 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce9e expref: 50 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.147421:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb400, rc 0) 00000100:00100000:3.0:1787826406.147519:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87426:x1874668789966080:12345-192.168.203.9@tcp:101:rm.0 Request processed in 1883us (2120us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826406.147528:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111891 00000100:00100000:1.0:1787826406.169204:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.169320:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789966208 00000100:00100000:0.0:1787826406.169333:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789966208 00000100:00100000:0.0:1787826406.169408:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111892 00000100:00100000:0.0:1787826406.169419:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87427:x1874668789966208:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.169446:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.169474:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d457 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcea5 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169608:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169626:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169640:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169657:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169664:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169671:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169740:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169749:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169756:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169764:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.169769:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169778:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169792:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.169795:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.169801:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169807:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d45e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169824:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169830:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169836:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169842:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.169845:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169916:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169926:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xde9470f2 (ffff9bbe16467200) 00010000:00010000:0.0:1787826406.169929:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.169932:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169939:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d465 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169981:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d457 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcea5 expref: 50 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.169993:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.169995:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.169999:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204800/0x68019081f349d457 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcea5 expref: 50 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.170008:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204800, rc 0) 00000100:00100000:0.0:1787826406.170079:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87427:x1874668789966208:12345-192.168.203.9@tcp:101:cp.0 Request processed in 662us (890us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.170088:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111892 00000100:00100000:1.0:1787826406.191192:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.191336:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789966336 00000100:00100000:3.0:1787826406.191350:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789966336 00000100:00100000:3.0:1787826406.191444:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111893 00000100:00100000:3.0:1787826406.191454:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87427:x1874668789966336:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826406.191480:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826406.191506:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d46c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fceac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191619:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191641:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191657:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191677:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191696:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191703:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191754:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191762:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191769:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191777:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191784:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.191789:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191798:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191812:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.191816:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.191821:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191829:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d473 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.191847:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.192243:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.192251:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.192258:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.192261:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.192269:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.192279:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xde9470f2 (ffff9bbf14059500) 00010000:00010000:3.0:1787826406.192282:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.192286:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.192293:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d47a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.192343:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d46c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceac expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.192371:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.192374:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.192379:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d46c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceac expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.192391:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826406.192483:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87427:x1874668789966336:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1030us (1305us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826406.192492:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111893 00000100:00100000:1.0:1787826406.198419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.204572:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789966592 00000100:00100000:2.0:1787826406.204591:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789966592 00000100:00100000:2.0:1787826406.204714:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111894 00000100:00100000:2.0:1787826406.204726:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+49:87427:x1874668789966592:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826406.204755:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826406.204785:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d481 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fceb3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.204947:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.204966:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.204980:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.204997:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205006:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205013:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826406.205452:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd3:0x0], index 0: 0 00010000:00010000:2.0:1787826406.205628:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205645:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205653:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205708:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205716:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205722:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205730:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205736:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.205741:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205748:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205762:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.205765:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.205770:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205778:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d488 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826406.205794:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c6fb3ea reply state 00000000505108ec transno 8590016800 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205806:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205813:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xde9470f2 (ffff9bbe16cc5600) 00010000:00010000:2.0:1787826406.205815:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826406.205818:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826406.205887:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d481 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceb3 expref: 52 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205905:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceb3 expref: 51 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.205913:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:2.0:1787826406.205915:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826406.205918:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb400, rc 0) 00000100:00100000:2.0:1787826406.206014:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+52:87427:x1874668789966592:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1289us (7608us total) trans 8590016800 rc 0/0 00000100:00100000:2.0:1787826406.206024:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111894 00000100:00100000:1.0:1787826406.208116:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826406.208148:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778705408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826406.208233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826406.208314:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778705408 00000100:00100000:1.0:1787826406.208323:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778705408 00000100:00100000:1.0:1787826406.208391:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3486 00000100:00100000:1.0:1787826406.208401:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778705408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826406.208440:0:45684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1787826406.208488:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778705408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826406.208496:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3486 00000100:00100000:1.0:1787826406.208546:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778705408:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787826406.208950:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826406.208957:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826406.209118:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9724 count 21 00000040:00080000:3.0:1787826406.209127:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1787826406.209644:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826406.209660:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778705536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826406.209733:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826406.209772:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778705536 00000100:00100000:0.0:1787826406.209778:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778705536 00000100:00100000:0.0:1787826406.209814:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3487 00000100:00100000:0.0:1787826406.209822:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778705536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826406.209871:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440514048 avail 1294274560 00000100:00100000:0.0:1787826406.209916:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778705536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.209923:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3487 00000100:00100000:0.0:1787826406.209960:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778705536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826406.216047:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.216226:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789966720 00000100:00100000:0.0:1787826406.216240:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789966720 00000100:00100000:1.0:1787826406.216499:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6441 00000100:00100000:1.0:1787826406.216512:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789966720:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826406.216536:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826406.216573:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fceba expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826406.216607:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826406.216631:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=3044s v=(0 0) 00010000:00010000:1.0:1787826406.216636:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826406.216647:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceba expref: 22 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.216677:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceba expref: 22 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.216703:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d600, rc 0) 00000100:00100000:1.0:1787826406.216826:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2401:x1874668789966720:12345-192.168.203.9@tcp:101:cp.0 Request processed in 316us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826406.216835:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6441 00000100:00080000:2.0:1787826406.217144:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826406.226786:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.227068:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789966848 00000100:00100000:0.0:1787826406.227141:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789966848 00000100:00100000:0.0:1787826406.235652:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6442 00000100:00100000:0.0:1787826406.235677:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+22:87427:x1874668789966848:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.235707:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.235727:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcec1 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.235757:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceba expref: 23 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.235766:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826406.235770:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826406.235775:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 4/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 23 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.235810:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceba expref: 23 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.235825:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceba expref: 23 pid: 8433 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826406.235840:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778705664:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826406.236163:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826406.242457:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778705664:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826406.242495:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 3/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 23 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.242517:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204800, rc 0) 00000100:00100000:0.0:1787826406.242593:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:87427:x1874668789966848:12345-192.168.203.9@tcp:101:cp.0 Request processed in 6928us (15820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.242602:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6442 00000100:00100000:1.0:1787826406.247794:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.247902:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789966976 00000100:00100000:2.0:1787826406.247912:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789966976 00010000:00010000:2.0:1787826406.247951:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceba expref: 23 pid: 8433 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826406.248001:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3152 00000100:00100000:2.0:1787826406.248011:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789966976:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826406.248025:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826406.248046:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceba expref: 23 pid: 8433 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.248059:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceba expref: 23 pid: 8433 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.248082:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349d4a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceba expref: 23 pid: 8433 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.248101:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826406.248105:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826406.248113:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 22 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.248123:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 22 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.248158:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 22 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826406.248171:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08303840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778705792:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826406.248251:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf1241b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826406.251928:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08303840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778705792:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826406.251957:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826406.252024:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2402:x1874668789966976:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4013us (4237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826406.252036:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3152 00000100:00100000:3.0:1787826406.254964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.255086:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789967232 00000100:00100000:0.0:1787826406.255098:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789967232 00000100:00100000:0.0:1787826406.255165:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2764 00000100:00100000:0.0:1787826406.255177:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+52:87427:x1874668789967232:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826406.255589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87427:x1874668789967232:12345-192.168.203.9@tcp:35:cp.0 Request processed in 412us (636us total) trans 8590016801 rc 0/0 00000100:00100000:0.0:1787826406.255599:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2764 00010000:00010000:2.0:1787826406.272055:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826406.303818:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.303995:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789967360 00000100:00100000:0.0:1787826406.304009:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789967360 00000100:00100000:0.0:1787826406.304090:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111895 00000100:00100000:0.0:1787826406.304102:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+52:87430:x1874668789967360:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826406.304129:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.304158:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d4b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcec8 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304246:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304265:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304278:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304294:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304301:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304308:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304355:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304362:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304373:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304380:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.304385:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304393:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304406:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.304410:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.304415:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304421:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304436:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304442:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304447:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304452:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.304454:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304463:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304470:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x7481f5ae (ffff9bbe16467200) 00010000:00010000:0.0:1787826406.304472:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.304475:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304480:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304518:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d4b2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec8 expref: 53 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304530:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.304532:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.304536:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d4b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec8 expref: 53 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.304546:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205200, rc 0) 00000100:00100000:0.0:1787826406.304713:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+52:87430:x1874668789967360:12345-192.168.203.9@tcp:101:bash.0 Request processed in 612us (908us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.304722:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111895 00000100:00100000:1.0:1787826406.317712:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.317840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789967488 00000100:00100000:0.0:1787826406.317898:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789967488 00000100:00100000:0.0:1787826406.317980:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111896 00000100:00100000:0.0:1787826406.317992:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87431:x1874668789967488:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826406.318026:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.318054:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d4c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcecf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318145:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318165:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318179:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318197:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318204:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318210:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318262:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318270:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318276:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318284:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318291:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.318297:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318305:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318319:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.318323:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.318329:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318335:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d4ce lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318352:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318358:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318377:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318382:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.318384:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318390:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318401:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x7481f5ae (ffff9bbe16467200) 00010000:00010000:0.0:1787826406.318404:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.318406:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318412:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d4d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318455:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d4c7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcecf expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318467:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.318469:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.318473:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d4c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcecf expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.318482:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205200, rc 0) 00000100:00100000:0.0:1787826406.318555:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87431:x1874668789967488:12345-192.168.203.9@tcp:101:rm.0 Request processed in 565us (860us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.318563:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111896 00000100:00100000:3.0:1787826406.325108:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.325470:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789967616 00000100:00100000:0.0:1787826406.325483:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789967616 00000100:00100000:0.0:1787826406.325569:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111897 00000100:00100000:0.0:1787826406.325581:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87431:x1874668789967616:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826406.325609:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.325638:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d4dc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fced6 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.325831:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.325849:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326027:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326049:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326057:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326065:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326117:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326125:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326134:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326140:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.326146:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326159:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326173:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.326176:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.326183:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326189:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d4e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326207:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326213:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326219:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326225:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.326227:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326234:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326241:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x7481f5ae (ffff9bbe16467c00) 00010000:00010000:0.0:1787826406.326243:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.326247:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326253:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d4ea lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326296:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d4dc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fced6 expref: 54 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326308:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.326310:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.326314:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d4dc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fced6 expref: 54 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.326326:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204400, rc 0) 00000100:00100000:0.0:1787826406.326572:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87431:x1874668789967616:12345-192.168.203.9@tcp:101:rm.0 Request processed in 991us (1476us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.326582:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111897 00000100:00100000:1.0:1787826406.352196:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.352336:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789967744 00000100:00100000:2.0:1787826406.352349:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789967744 00000100:00100000:2.0:1787826406.352441:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111898 00000100:00100000:2.0:1787826406.352452:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87432:x1874668789967744:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826406.352480:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826406.352517:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d4f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcedd expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.352614:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.352633:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.352646:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.352662:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.352669:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.352675:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353009:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353017:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353024:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353030:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.353034:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353042:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353057:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.353060:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.353065:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353071:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d4f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353086:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353091:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353097:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353102:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.353105:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353110:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353117:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x7481f5ae (ffff9bbe16cc5c00) 00010000:00010000:2.0:1787826406.353120:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.353122:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353128:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d4ff lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353169:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d4f1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcedd expref: 54 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353180:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.353182:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.353186:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d4f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcedd expref: 54 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.353196:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb800, rc 0) 00000100:00100000:2.0:1787826406.353285:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87432:x1874668789967744:12345-192.168.203.9@tcp:101:cp.0 Request processed in 835us (1103us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826406.353294:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111898 00000100:00100000:1.0:1787826406.366183:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.368290:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789967872 00000100:00100000:2.0:1787826406.368384:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789967872 00000100:00100000:2.0:1787826406.368541:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111899 00000100:00100000:2.0:1787826406.368555:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87432:x1874668789967872:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826406.368594:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826406.368621:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d506 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcee4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368720:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368737:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368750:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368766:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368774:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368781:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368829:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368836:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368842:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368869:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368877:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.368881:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368890:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368903:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.368906:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.368910:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368917:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d50d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368932:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368938:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368945:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368950:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.368953:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368963:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368970:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x7481f5ae (ffff9bbe16cc5c00) 00010000:00010000:2.0:1787826406.368972:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.368975:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.368981:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d514 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.369016:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d506 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcee4 expref: 54 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.369026:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.369028:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.369031:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d506 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcee4 expref: 54 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.369040:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb800, rc 0) 00000100:00100000:2.0:1787826406.369208:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87432:x1874668789967872:12345-192.168.203.9@tcp:101:cp.0 Request processed in 656us (3651us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826406.369216:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111899 00000100:00100000:1.0:1787826406.373421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.373895:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789968128 00000100:00100000:0.0:1787826406.373909:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789968128 00000100:00100000:0.0:1787826406.374000:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111900 00000100:00100000:0.0:1787826406.374013:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+53:87432:x1874668789968128:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.374043:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.374187:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d51b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fceeb expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.374472:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.374492:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.374507:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.374526:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.374533:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.374541:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826406.376043:0:23845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xd4:0x0], index 1: 0 00010000:00010000:0.0:1787826406.376336:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376354:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376364:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376409:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376415:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376423:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376429:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.376434:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376443:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376457:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.376460:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.376465:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376471:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d522 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826406.376487:0:23845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d47e061b reply state 0000000064cd07e0 transno 8590016802 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376500:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376506:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x7481f5ae (ffff9bbe16467c00) 00010000:00010000:0.0:1787826406.376508:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826406.376513:0:23845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826406.376556:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d51b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceeb expref: 56 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376654:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceeb expref: 55 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.376663:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:0.0:1787826406.376666:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826406.376669:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205200, rc 0) 00000100:00100000:0.0:1787826406.376958:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+56:87432:x1874668789968128:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2946us (3550us total) trans 8590016802 rc 0/0 00000100:00100000:0.0:1787826406.376968:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111900 00000100:00100000:0.0:1787826406.382086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826406.382248:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789968256 00000100:00100000:1.0:1787826406.382262:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789968256 00000100:00100000:1.0:1787826406.382354:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6443 00000100:00100000:1.0:1787826406.382366:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2399:x1874668789968256:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826406.382389:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826406.382416:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcef2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826406.382447:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826406.382472:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=3044s v=(0 0) 00010000:00010000:1.0:1787826406.382477:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826406.382488:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef2 expref: 19 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.382508:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef2 expref: 19 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.382523:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993cc00, rc 0) 00000100:00080000:3.0:1787826406.382695:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826406.382825:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2399:x1874668789968256:12345-192.168.203.9@tcp:101:cp.0 Request processed in 460us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826406.382834:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6443 00000100:00100000:0.0:1787826406.387163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.387269:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789968384 00000100:00100000:3.0:1787826406.387282:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789968384 00000100:00100000:3.0:1787826406.387403:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6444 00000100:00100000:3.0:1787826406.387414:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+19:87432:x1874668789968384:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826406.387439:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826406.387463:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcef9 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.387505:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef2 expref: 20 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.387522:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826406.387527:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826406.387534:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 20 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.387656:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef2 expref: 20 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.387673:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef2 expref: 20 pid: 8432 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826406.387703:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778705920:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826406.387925:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826406.393961:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778705920:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826406.394013:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 20 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.394042:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826406.394239:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+20:87432:x1874668789968384:12345-192.168.203.9@tcp:101:cp.0 Request processed in 6825us (7088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.394252:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6444 00000100:00100000:0.0:1787826406.395204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.395389:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789968512 00000100:00100000:3.0:1787826406.395400:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789968512 00010000:00010000:3.0:1787826406.395449:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef2 expref: 20 pid: 8432 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826406.395500:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3153 00000100:00100000:3.0:1787826406.395512:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2402:x1874668789968512:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826406.395533:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826406.395565:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef2 expref: 20 pid: 8432 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.395593:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef2 expref: 20 pid: 8432 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.395625:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b271efe/0x68019081f349d53e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef2 expref: 20 pid: 8432 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.395649:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826406.395654:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826406.395665:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 19 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.395678:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 19 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.396007:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 19 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826406.396027:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778706048:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826406.396252:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826406.401992:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778706048:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826406.402033:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826406.402119:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2402:x1874668789968512:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 6609us (6921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.402133:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3153 00000100:00100000:1.0:1787826406.404057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.404169:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789968768 00000100:00100000:3.0:1787826406.404180:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789968768 00000100:00100000:3.0:1787826406.404254:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2765 00000100:00100000:3.0:1787826406.404267:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067ad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+56:87432:x1874668789968768:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:3.0:1787826406.404708:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067ad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87432:x1874668789968768:12345-192.168.203.9@tcp:35:cp.0 Request processed in 443us (660us total) trans 8590016803 rc 0/0 00000100:00100000:3.0:1787826406.404718:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2765 00000100:00100000:0.0:1787826406.442041:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.442195:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789968896 00000100:00100000:3.0:1787826406.442208:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789968896 00000100:00100000:3.0:1787826406.442279:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111901 00000100:00100000:3.0:1787826406.442295:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+52:87435:x1874668789968896:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1787826406.442323:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826406.442348:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d54c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf00 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442431:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442449:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442467:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442482:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442489:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442496:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442552:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442569:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442576:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442584:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442590:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.442594:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442602:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442615:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.442618:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.442623:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442631:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d553 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442647:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442653:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442659:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442664:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.442667:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442673:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442688:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc8f218d (ffff9bbf14059500) 00010000:00010000:3.0:1787826406.442690:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.442807:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442815:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d55a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442919:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d54c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf00 expref: 53 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442933:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.442935:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.442938:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d54c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf00 expref: 53 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.442948:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826406.443038:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+52:87435:x1874668789968896:12345-192.168.203.9@tcp:101:bash.0 Request processed in 744us (1011us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826406.443046:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111901 00000100:00100000:2.0:1787826406.464177:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.464496:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789969024 00000100:00100000:0.0:1787826406.464509:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789969024 00000100:00100000:0.0:1787826406.464603:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111902 00000100:00100000:0.0:1787826406.464615:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87436:x1874668789969024:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826406.464644:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.464675:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d561 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf07 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464783:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464802:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464816:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464835:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464843:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464905:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464960:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464968:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464975:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464983:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.464990:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.464995:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465004:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465018:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.465021:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.465027:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465034:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d568 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465051:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465059:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465065:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465081:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.465084:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465091:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465098:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc8f218d (ffff9bbe16467d00) 00010000:00010000:0.0:1787826406.465101:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.465104:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465110:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d56f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465152:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d561 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf07 expref: 58 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465164:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.465166:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.465171:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d561 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf07 expref: 58 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.465186:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826406.465275:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87436:x1874668789969024:12345-192.168.203.9@tcp:101:rm.0 Request processed in 661us (1115us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.465283:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111902 00000100:00100000:2.0:1787826406.473607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.473935:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789969152 00000100:00100000:0.0:1787826406.473948:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789969152 00000100:00100000:0.0:1787826406.474032:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111903 00000100:00100000:0.0:1787826406.474044:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87436:x1874668789969152:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826406.474177:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.474207:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d576 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf0e expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474299:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474634:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474650:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474670:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474687:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474695:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474750:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474758:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474765:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474771:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.474777:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474786:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474800:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.474803:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.474809:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474817:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d57d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474834:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474840:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.474846:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.475553:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.475570:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.475580:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.475592:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc8f218d (ffff9bbe16467d00) 00010000:00010000:0.0:1787826406.475595:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.475599:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.475607:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d584 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.475667:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d576 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf0e expref: 58 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.475688:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.475691:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.475706:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d576 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf0e expref: 58 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.475718:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826406.475814:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87436:x1874668789969152:12345-192.168.203.9@tcp:101:rm.0 Request processed in 1772us (2222us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.475824:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111903 00000100:00100000:3.0:1787826406.505474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826406.505713:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789969280 00000100:00100000:1.0:1787826406.505727:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789969280 00000100:00100000:1.0:1787826406.505808:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111904 00000100:00100000:1.0:1787826406.505821:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87437:x1874668789969280:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826406.505898:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826406.505927:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d58b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf15 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506015:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506034:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506048:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506079:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506089:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506095:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506154:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506162:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506168:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506175:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826406.506180:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506187:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506200:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826406.506203:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.506209:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506216:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d592 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506233:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506241:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506247:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506251:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993cc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826406.506254:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506260:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506266:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc8f218d (ffff9bbe1342f300) 00010000:00010000:1.0:1787826406.506268:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.506271:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506288:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d599 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506329:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d58b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf15 expref: 58 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506340:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826406.506343:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.506346:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d58b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf15 expref: 58 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.506361:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993da00, rc 0) 00000100:00100000:1.0:1787826406.506441:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87437:x1874668789969280:12345-192.168.203.9@tcp:101:cp.0 Request processed in 622us (981us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826406.506449:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111904 00000100:00100000:2.0:1787826406.511664:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.511951:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789969408 00000100:00100000:0.0:1787826406.511965:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789969408 00000100:00100000:0.0:1787826406.512044:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111905 00000100:00100000:0.0:1787826406.512056:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87437:x1874668789969408:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.512093:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.512121:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d5a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf1c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512216:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512233:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512247:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512263:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512271:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512278:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512456:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512465:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512472:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512479:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512485:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.512490:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512498:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512511:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.512515:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.512519:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512526:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512542:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512547:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512554:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512559:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.512563:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512573:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512581:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc8f218d (ffff9bbe16467d00) 00010000:00010000:0.0:1787826406.512583:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.512587:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512593:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349d5ae lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512635:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d5a0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf1c expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512647:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.512649:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.512653:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d5a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf1c expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.512664:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826406.513179:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87437:x1874668789969408:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1122us (1526us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.513189:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111905 00000100:00100000:2.0:1787826406.517257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.517402:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789969664 00000100:00100000:3.0:1787826406.517413:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789969664 00000100:00100000:3.0:1787826406.517503:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111906 00000100:00100000:3.0:1787826406.517513:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+57:87437:x1874668789969664:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826406.517537:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826406.517563:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d5b5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf23 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.517720:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.517739:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.517753:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.517775:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.517783:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.517789:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826406.518265:0:12105:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd4:0x0], index 0: 0 00010000:00010000:3.0:1787826406.518539:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.518822:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.518833:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.518909:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.518918:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.518925:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.518933:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.519316:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.519323:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.519332:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.519348:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.519351:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.519356:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.519364:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d5bc lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826406.519382:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4fd05c4 reply state 000000008c855d7a transno 8590016804 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.519396:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.519403:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc8f218d (ffff9bbf14059500) 00010000:00010000:3.0:1787826406.519406:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826406.519409:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826406.519456:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d5b5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf23 expref: 60 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.519474:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf23 expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.519482:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:3.0:1787826406.519485:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826406.519488:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606600, rc 0) 00000100:00100000:3.0:1787826406.520431:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+60:87437:x1874668789969664:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2909us (3178us total) trans 8590016804 rc 0/0 00000100:00100000:3.0:1787826406.520444:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111906 00000100:00100000:2.0:1787826406.524295:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.524511:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789969792 00000100:00100000:0.0:1787826406.524524:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789969792 00000100:00100000:0.0:1787826406.524602:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6445 00000100:00100000:0.0:1787826406.524614:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2399:x1874668789969792:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.525001:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.525033:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf2a expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826406.525069:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826406.525194:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=3044s v=(0 0) 00010000:00010000:0.0:1787826406.525200:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826406.525214:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf2a expref: 23 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.525235:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf2a expref: 23 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.525252:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826406.525444:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668789969792:12345-192.168.203.9@tcp:101:cp.0 Request processed in 831us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.525454:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6445 00000040:00080000:1.0:1787826406.528161:0:58480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787826406.528173:0:58480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826406.530464:0:58480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787826406.530493:0:58480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787826406.534595:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.534781:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789969920 00000100:00100000:0.0:1787826406.534796:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789969920 00000100:00100000:0.0:1787826406.534913:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6446 00000100:00100000:0.0:1787826406.534926:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08300780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+23:87437:x1874668789969920:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.534950:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.534976:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf31 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.535018:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf2a expref: 24 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.535030:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826406.535035:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826406.535041:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 4/0,0 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 24 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.535088:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf2a expref: 24 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.535106:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf2a expref: 24 pid: 19335 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826406.535124:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778706176:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826406.535244:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826406.542466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.542614:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789970048 00000100:00100000:3.0:1787826406.542626:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789970048 00010000:00010000:3.0:1787826406.542694:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf2a expref: 25 pid: 19335 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826406.542756:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3154 00000100:00100000:3.0:1787826406.542767:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08301a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789970048:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826406.542788:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826406.542817:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf2a expref: 25 pid: 19335 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.542835:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf2a expref: 25 pid: 19335 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.542909:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826406.542914:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826406.542924:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.542936:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.542982:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826406.542999:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03ed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778706304:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826406.543109:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe09c76600 going to sleep for 11 seconds 00010000:00010000:0.0:1787826406.545831:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349d5d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf2a expref: 25 pid: 19335 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826406.545913:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778706176:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826406.545954:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 24 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.545973:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205a00, rc 0) 00000100:00100000:0.0:1787826406.546067:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08300780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+24:87437:x1874668789969920:12345-192.168.203.9@tcp:101:cp.0 Request processed in 11143us (11486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.546091:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6446 00000100:00100000:3.0:1787826406.547212:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03ed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1874668778706304:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826406.547244:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826406.547293:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08301a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789970048:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4527us (4841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.547305:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3154 00000100:00100000:2.0:1787826406.555907:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.556018:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789970304 00000100:00100000:0.0:1787826406.556031:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789970304 00000100:00100000:0.0:1787826406.556109:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2766 00000100:00100000:0.0:1787826406.556121:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+60:87437:x1874668789970304:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826406.556545:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87437:x1874668789970304:12345-192.168.203.9@tcp:35:cp.0 Request processed in 425us (690us total) trans 8590016805 rc 0/0 00000100:00100000:0.0:1787826406.556554:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2766 00000100:00100000:2.0:1787826406.613239:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.613364:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789970432 00000100:00100000:0.0:1787826406.613377:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789970432 00000100:00100000:0.0:1787826406.613451:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111907 00000100:00100000:0.0:1787826406.613462:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+52:87440:x1874668789970432:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826406.613488:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.613517:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d5e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf38 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613640:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613658:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613672:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613701:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613714:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613722:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613773:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613782:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613790:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613798:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.613804:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613812:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613827:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.613831:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.613836:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613841:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d5ed lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613904:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613911:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613917:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613921:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.613924:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613930:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613937:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xa9df8504 (ffff9bbe16467600) 00010000:00010000:0.0:1787826406.613939:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.613942:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613947:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d5f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.613991:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d5e6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf38 expref: 53 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.614003:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.614005:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.614009:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d5e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf38 expref: 53 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.614025:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826406.614112:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+52:87440:x1874668789970432:12345-192.168.203.9@tcp:101:bash.0 Request processed in 651us (887us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.614120:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111907 00000100:00100000:2.0:1787826406.650693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.650792:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789970560 00000100:00100000:3.0:1787826406.650805:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789970560 00000100:00100000:3.0:1787826406.651030:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111908 00000100:00100000:3.0:1787826406.651042:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87441:x1874668789970560:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:3.0:1787826406.651095:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826406.651124:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d5fb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651225:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651244:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651258:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651275:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651288:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651295:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651347:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651355:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651363:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651372:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651379:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.651385:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651394:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651408:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.651412:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.651417:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651425:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d602 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651443:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651451:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651457:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651463:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.651466:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651473:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651479:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xa9df8504 (ffff9bbf14059600) 00010000:00010000:3.0:1787826406.651482:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.651485:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651492:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d609 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651533:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d5fb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf3f expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651545:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.651548:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.651553:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d5fb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf3f expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.651563:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826406.651647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87441:x1874668789970560:12345-192.168.203.9@tcp:101:rm.0 Request processed in 607us (979us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826406.651656:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111908 00000100:00100000:3.0:1787826406.663046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826406.663234:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789970688 00000100:00100000:1.0:1787826406.663247:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789970688 00000100:00100000:1.0:1787826406.663329:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111909 00000100:00100000:1.0:1787826406.663342:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87441:x1874668789970688:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826406.663369:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826406.663400:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d610 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf46 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663497:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663516:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663532:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663548:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663561:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663568:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663622:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663630:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663638:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663644:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993cc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826406.663650:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663658:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663673:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826406.663686:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.663693:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663700:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d617 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663717:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663724:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663729:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663735:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826406.663738:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663743:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663750:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xa9df8504 (ffff9bbe1342f300) 00010000:00010000:1.0:1787826406.663753:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.663756:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663762:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d61e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663803:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d610 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf46 expref: 62 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663813:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826406.663815:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.663819:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d610 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf46 expref: 62 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.663835:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993da00, rc 0) 00000100:00100000:1.0:1787826406.664221:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87441:x1874668789970688:12345-192.168.203.9@tcp:101:rm.0 Request processed in 880us (1189us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826406.664231:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111909 00000100:00100000:2.0:1787826406.697265:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.700490:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789970816 00000100:00100000:0.0:1787826406.700512:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789970816 00000100:00100000:0.0:1787826406.700752:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111910 00000100:00100000:0.0:1787826406.700766:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87442:x1874668789970816:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.700795:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.700825:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d625 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.700935:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.700953:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.700967:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.700982:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.700988:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.700994:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701045:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701052:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701059:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701065:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701070:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.701074:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701083:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701095:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.701098:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.701103:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701110:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349d62c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701139:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701146:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701151:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701155:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.701157:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701162:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701168:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xa9df8504 (ffff9bbe16467600) 00010000:00010000:0.0:1787826406.701170:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.701173:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701178:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d633 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701216:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d625 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf4d expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701226:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.701228:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.701231:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d625 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf4d expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.701241:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826406.702532:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87442:x1874668789970816:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1755us (5268us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.702552:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111910 00000100:00100000:3.0:1787826406.710197:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.710377:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789970944 00000100:00100000:0.0:1787826406.710390:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789970944 00000100:00100000:0.0:1787826406.710470:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111911 00000100:00100000:0.0:1787826406.710483:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87442:x1874668789970944:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.710510:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.710538:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d63a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710623:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710643:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710657:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710673:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710692:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710708:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710772:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710786:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710793:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710800:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710807:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.710812:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710821:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710834:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.710837:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.710842:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710849:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d641 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710891:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710897:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710902:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710908:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.710911:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710917:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710925:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xa9df8504 (ffff9bbe16467600) 00010000:00010000:0.0:1787826406.710928:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.710930:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710935:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d648 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710976:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d63a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf54 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.710987:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.710989:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.710993:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d63a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf54 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.711003:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202200, rc 0) 00000100:00100000:0.0:1787826406.711083:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87442:x1874668789970944:12345-192.168.203.9@tcp:101:cp.0 Request processed in 603us (900us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.711091:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111911 00000100:00100000:0.0:1787826406.716539:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.718174:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789971200 00000100:00100000:2.0:1787826406.718195:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789971200 00000100:00100000:2.0:1787826406.718308:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111912 00000100:00100000:2.0:1787826406.718322:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+61:87442:x1874668789971200:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826406.718350:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826406.718385:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d64f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf5b expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.718522:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.718541:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.718555:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.718572:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.718579:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.718585:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826406.720663:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826406.720713:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778706432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826406.720822:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826406.720939:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778706432 00000100:00100000:1.0:1787826406.720948:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778706432 00000100:00100000:1.0:1787826406.721025:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00100000:1.0:1787826406.721035:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778706432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826406.721072:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570019264 pending 0 free 3828547584 avail 3597025280 00000100:00100000:1.0:1787826406.721125:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778706432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826406.721133:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 00000100:00100000:1.0:1787826406.721192:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778706432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826406.721546:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826406.721559:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778706560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826406.721608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826406.721642:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778706560 00000100:00100000:3.0:1787826406.721646:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778706560 00000100:00100000:3.0:1787826406.721706:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00100000:3.0:1787826406.721714:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3e172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778706560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826406.721748:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671100352 pending 0 free 3894722560 avail 3663200256 00000100:00100000:3.0:1787826406.721787:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3e172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778706560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.721793:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00000100:00100000:3.0:1787826406.722130:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778706560:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787826406.722154:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826406.722159:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787826406.725012:0:45682:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xd5:0x0], index 1: 0 00010000:00010000:2.0:1787826406.726459:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726486:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726501:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726562:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726570:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726577:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726584:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cebc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.726589:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726597:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726611:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.726614:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.726619:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726630:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d656 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826406.726649:0:45682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd9889cb reply state 00000000dec32418 transno 8590016806 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726661:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.726667:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xa9df8504 (ffff9bbe16cc5c00) 00010000:00010000:2.0:1787826406.726669:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826406.726673:0:45682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826406.727057:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d64f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf5b expref: 64 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.727076:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf5b expref: 63 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.727085:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:2.0:1787826406.727087:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826406.727090:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb600, rc 0) 00000100:00100000:2.0:1787826406.727196:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+64:87442:x1874668789971200:12345-192.168.203.9@tcp:101:cp.0 Request processed in 8876us (10671us total) trans 8590016806 rc 0/0 00000100:00100000:2.0:1787826406.727207:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111912 00000100:00100000:1.0:1787826406.744202:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826406.744322:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.744802:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789971456 00000100:00100000:3.0:1787826406.744816:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789971456 00000100:00100000:3.0:1787826406.745013:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3488 00000100:00100000:3.0:1787826406.745024:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+64:2400:x1874668789971456:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826406.746513:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826406.746539:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d672 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf69 expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826406.746892:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789971328 00000100:00100000:2.0:1787826406.746908:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789971328 00010000:00010000:3.0:1787826406.747097:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747116:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747128:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747152:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747160:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747166:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747203:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747210:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747217:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747223:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16607e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.747227:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747234:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747246:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.747249:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.747253:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747271:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349d679 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747286:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747291:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747296:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747300:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.747303:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747307:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747315:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbf14059600) 00010000:00010000:3.0:1787826406.747317:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.747321:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747326:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349d680 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747360:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d672 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf69 expref: 65 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747370:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.747373:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826406.747377:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d672 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf69 expref: 65 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.747387:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc -2) 00000100:00100000:3.0:1787826406.747480:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+64:2400:x1874668789971456:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 2456us (3156us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826406.747489:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3488 00000100:00100000:0.0:1787826406.757592:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6447 00000100:00100000:0.0:1787826406.757608:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+19:2402:x1874668789971328:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.757628:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.757649:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcf62 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826406.757674:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826406.757705:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=3044s v=(0 0) 00010000:00010000:0.0:1787826406.757709:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826406.757718:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf62 expref: 20 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.757737:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf62 expref: 20 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.757751:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202200, rc 0) 00000100:00100000:0.0:1787826406.758062:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2402:x1874668789971328:12345-192.168.203.9@tcp:101:cp.0 Request processed in 456us (13872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.758079:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6447 00000100:00100000:0.0:1787826406.764240:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.764311:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789971584 00000100:00100000:3.0:1787826406.764320:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789971584 00000100:00100000:3.0:1787826406.764383:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6448 00000100:00100000:3.0:1787826406.764393:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+20:87442:x1874668789971584:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826406.764409:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826406.764427:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcfa1 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.764460:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf62 expref: 21 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.764475:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826406.764479:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826406.764485:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 21 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.764517:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf62 expref: 21 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.764531:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf62 expref: 21 pid: 8430 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826406.764545:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778706688:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826406.764647:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe09c76600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826406.769945:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c03c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778706688:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826406.769986:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 21 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.770009:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3800, rc 0) 00000100:00100000:3.0:1787826406.770754:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+21:87442:x1874668789971584:12345-192.168.203.9@tcp:101:cp.0 Request processed in 5677us (5838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.770768:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6448 00000100:00100000:3.0:1787826406.777414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826406.777525:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789971712 00000100:00100000:1.0:1787826406.777534:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789971712 00010000:00010000:0.0:1787826406.781868:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf62 expref: 21 pid: 8430 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826406.782439:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3155 00000100:00100000:0.0:1787826406.782458:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2402:x1874668789971712:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826406.782479:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826406.782502:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf62 expref: 21 pid: 8430 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.782517:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf62 expref: 21 pid: 8430 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.782551:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007c3a772/0x68019081f349d687 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf62 expref: 21 pid: 8430 timeout: 3144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.783248:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826406.783262:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826406.783274:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 20 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.783285:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 20 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.783327:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 20 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826406.783396:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e68d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6501:1874668778706816:192.168.203.9@tcp:105: 00000100:00100000:0.0:1787826406.783532:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826406.792779:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.792892:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789971968 00000100:00100000:2.0:1787826406.792901:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789971968 00000100:00100000:2.0:1787826406.792953:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2767 00000100:00100000:2.0:1787826406.792963:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+64:87442:x1874668789971968:12345-192.168.203.9@tcp:35:cp.0 00000001:00080000:2.0:1787826406.793211:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016807 00000100:00100000:2.0:1787826406.793693:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87442:x1874668789971968:12345-192.168.203.9@tcp:35:cp.0 Request processed in 730us (926us total) trans 8590016808 rc 0/0 00000100:00100000:2.0:1787826406.793701:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2767 00000020:00080000:2.0:1787826406.793707:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787826406.795726:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e68d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6501:1874668778706816:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826406.795753:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826406.795802:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2402:x1874668789971712:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 13354us (18398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826406.795820:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3155 00000100:00100000:0.0:1787826406.834797:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.834895:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789972096 00000100:00100000:2.0:1787826406.834903:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789972096 00000100:00100000:2.0:1787826406.834970:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3489 00000100:00100000:2.0:1787826406.834981:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2399:x1874668789972096:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826406.835035:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826406.835055:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d695 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcfa8 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835122:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835318:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835333:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835350:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835357:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835368:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835411:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835418:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835425:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835432:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cebc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.835436:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835444:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835456:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.835458:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.835462:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835468:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d69c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835481:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835488:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835494:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835499:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceaa00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.835502:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835508:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835514:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbe16cc5300) 00010000:00010000:2.0:1787826406.835517:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.835520:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835525:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d6a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835557:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d695 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa8 expref: 67 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835567:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.835569:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826406.835572:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d695 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa8 expref: 67 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.835581:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb800, rc -2) 00000100:00100000:2.0:1787826406.835689:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2399:x1874668789972096:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 709us (903us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826406.835701:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3489 00000100:00100000:3.0:1787826406.876745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.876889:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789972224 00000100:00100000:0.0:1787826406.876899:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789972224 00000100:00100000:0.0:1787826406.876972:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111913 00000100:00100000:0.0:1787826406.876982:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+52:87449:x1874668789972224:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826406.877003:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.877025:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d6aa lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcfe0 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877090:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877104:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877116:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877131:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877293:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877301:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877341:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877348:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877358:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877363:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.877367:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877375:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877386:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.877388:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.877392:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877398:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877411:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877416:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877421:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877426:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.877429:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877438:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877444:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbe16467500) 00010000:00010000:0.0:1787826406.877446:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.877449:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877454:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877485:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d6aa lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfe0 expref: 53 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877496:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.877498:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.877502:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d6aa lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfe0 expref: 53 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.877510:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203200, rc 0) 00000100:00100000:0.0:1787826406.877619:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+52:87449:x1874668789972224:12345-192.168.203.9@tcp:101:bash.0 Request processed in 639us (885us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.877628:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111913 00000100:00100000:0.0:1787826406.916056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.916184:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789972352 00000100:00100000:3.0:1787826406.916194:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789972352 00000100:00100000:3.0:1787826406.916257:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111914 00000100:00100000:3.0:1787826406.916268:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87450:x1874668789972352:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:3.0:1787826406.916535:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826406.916557:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d6bf lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcfe7 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916627:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916642:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916655:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916668:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916674:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916691:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916729:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916735:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916741:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916747:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916752:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.916756:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916763:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916774:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.916777:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.916781:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916787:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d6c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916801:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916806:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916811:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916815:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.916818:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916826:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916833:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbf14059600) 00010000:00010000:3.0:1787826406.916835:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.916837:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.916842:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d6cd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826406.917172:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826406.917367:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d6bf lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfe7 expref: 67 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.917379:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.917382:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.917386:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d6bf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfe7 expref: 67 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.917395:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2c00, rc 0) 00000100:00100000:3.0:1787826406.917451:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87450:x1874668789972352:12345-192.168.203.9@tcp:101:rm.0 Request processed in 1184us (1404us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826406.917459:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111914 00000100:00100000:1.0:1787826406.918774:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789972480 00000100:00100000:1.0:1787826406.918784:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789972480 00000100:00100000:1.0:1787826406.918971:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3490 00000100:00100000:1.0:1787826406.918982:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2400:x1874668789972480:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826406.919012:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826406.919031:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d6d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcfee expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919079:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919094:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919104:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919119:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919125:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919131:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919175:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919182:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919193:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919198:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993cc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826406.919300:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919309:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919320:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826406.919323:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.919327:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919332:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349d6db lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919355:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919362:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919367:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919373:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826406.919376:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919386:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919393:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc24f1d8e (ffff9bbe1342f300) 00010000:00010000:1.0:1787826406.919395:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.919397:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919403:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d6e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919430:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d6d4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfee expref: 67 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919440:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826406.919442:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826406.919446:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d6d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfee expref: 67 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.919454:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc -2) 00000100:00100000:1.0:1787826406.919511:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+66:2400:x1874668789972480:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 530us (2340us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826406.919518:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3490 00000100:00100000:3.0:1787826406.923342:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.923436:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789972608 00000100:00100000:0.0:1787826406.923444:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789972608 00000100:00100000:0.0:1787826406.923500:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111915 00000100:00100000:0.0:1787826406.923509:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87450:x1874668789972608:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:0.0:1787826406.923527:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.923547:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcff5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923619:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923633:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923643:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923656:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923662:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923667:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923716:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923723:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923728:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923737:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923742:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.923746:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923753:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923763:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.923766:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.923770:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923776:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d6f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923789:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923795:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923800:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923804:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.923807:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923816:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923823:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbe16467500) 00010000:00010000:0.0:1787826406.923825:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.923827:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.923832:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d6f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.924263:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6e9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcff5 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.924275:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.924278:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.924282:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d6e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcff5 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.924292:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202200, rc 0) 00000100:00100000:0.0:1787826406.924355:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87450:x1874668789972608:12345-192.168.203.9@tcp:101:rm.0 Request processed in 847us (1023us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.924363:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111915 00000100:00100000:0.0:1787826406.954067:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826406.954364:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789972736 00000100:00100000:2.0:1787826406.954379:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789972736 00000100:00100000:2.0:1787826406.954469:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111916 00000100:00100000:2.0:1787826406.954480:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87451:x1874668789972736:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826406.954503:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826406.954525:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d6fe lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fcffc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954591:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954605:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954617:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954631:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954638:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954645:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954692:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954704:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954710:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954717:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954723:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceaa00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.954727:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954735:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954746:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.954749:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.954754:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954760:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d705 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954775:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954781:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954787:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954792:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cebc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826406.954795:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954953:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.954964:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbe16cc5300) 00010000:00010000:2.0:1787826406.954967:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.955143:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.955152:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d70c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.955191:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d6fe lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcffc expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.955336:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826406.955339:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826406.955343:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d6fe lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcffc expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826406.955352:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceb800, rc 0) 00000100:00100000:2.0:1787826406.955479:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87451:x1874668789972736:12345-192.168.203.9@tcp:101:cp.0 Request processed in 999us (1424us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826406.955487:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111916 00000100:00100000:3.0:1787826406.961511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.961721:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789972864 00000100:00100000:0.0:1787826406.961731:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789972864 00000100:00100000:0.0:1787826406.961792:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111917 00000100:00100000:0.0:1787826406.961803:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c03d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87451:x1874668789972864:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.961824:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.961843:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d713 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd003 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.961956:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.962827:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.962845:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.962896:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.962906:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.962913:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.962965:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963631:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963639:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963646:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963653:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.963657:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963666:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963689:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.963692:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.963697:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963702:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d71a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963719:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963725:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963731:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963736:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826406.963738:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963743:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963754:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbe16467500) 00010000:00010000:0.0:1787826406.963756:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.963759:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963764:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d721 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963811:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d713 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd003 expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963821:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826406.963823:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826406.963826:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d713 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd003 expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.963835:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202200, rc 0) 00000100:00100000:0.0:1787826406.966547:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c03d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87451:x1874668789972864:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2168us (2468us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826406.966579:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111917 00000100:00100000:1.0:1787826406.973355:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826406.973528:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789973120 00000100:00100000:3.0:1787826406.973537:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789973120 00000100:00100000:3.0:1787826406.973653:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111918 00000100:00100000:3.0:1787826406.973663:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+66:87451:x1874668789973120:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826406.973693:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826406.973715:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d728 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd00a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.973818:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.973832:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.973842:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.976285:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.976309:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.976320:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826406.977688:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd5:0x0], index 0: 0 00010000:00010000:3.0:1787826406.977888:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.977904:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.977914:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.977964:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979072:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979156:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979163:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979169:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826406.979173:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979181:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979198:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826406.979266:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826406.979272:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979279:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d72f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826406.979299:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3c6c766 reply state 000000001adf4d2e transno 8590016809 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979312:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979320:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbf14059600) 00010000:00010000:3.0:1787826406.979323:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826406.979326:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826406.979372:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d728 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd00a expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979387:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd00a expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826406.979394:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:3.0:1787826406.979396:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826406.979398:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2800, rc 0) 00000100:00100000:3.0:1787826406.980325:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+69:87451:x1874668789973120:12345-192.168.203.9@tcp:101:cp.0 Request processed in 6658us (6975us total) trans 8590016809 rc 0/0 00000100:00100000:3.0:1787826406.980336:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111918 00000100:00100000:3.0:1787826406.988767:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826406.988989:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789973248 00000100:00100000:0.0:1787826406.988998:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789973248 00000100:00100000:0.0:1787826406.989057:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6449 00000100:00100000:0.0:1787826406.989067:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668789973248:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826406.989315:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826406.989337:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd011 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826406.989370:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826406.989390:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=3045s v=(0 0) 00010000:00010000:0.0:1787826406.989395:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826406.989403:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd011 expref: 24 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.989482:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd011 expref: 24 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826406.989497:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202e00, rc 0) 00000100:00100000:0.0:1787826406.989604:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789973248:12345-192.168.203.9@tcp:101:cp.0 Request processed in 537us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826406.989612:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6449 00000100:00100000:0.0:1787826406.996307:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826406.996480:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789973376 00000100:00100000:1.0:1787826406.996490:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789973376 00000100:00100000:1.0:1787826406.996551:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6450 00000100:00100000:1.0:1787826406.996562:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+24:87451:x1874668789973376:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826406.996580:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826406.996598:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd018 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.996630:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd011 expref: 25 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.996638:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826406.996642:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826406.996647:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.996692:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd011 expref: 25 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.996706:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd011 expref: 25 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826406.996729:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778706944:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826406.996822:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15bab300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826407.004429:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.004585:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778706944:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826407.004631:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.004661:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993cc00, rc 0) 00000100:00100000:0.0:1787826407.004755:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:87451:x1874668789973376:12345-192.168.203.9@tcp:101:cp.0 Request processed in 8194us (8457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.004767:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6450 00000100:00100000:2.0:1787826407.005033:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789973504 00000100:00100000:2.0:1787826407.005043:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789973504 00010000:00010000:2.0:1787826407.005099:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd011 expref: 25 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826407.005137:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3156 00000100:00100000:2.0:1787826407.005147:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789973504:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826407.005164:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826407.005191:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd011 expref: 25 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.005204:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd011 expref: 25 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.005235:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b54af437/0x68019081f349d74b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd011 expref: 25 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.005252:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826407.005257:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826407.005266:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 24 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.005278:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 24 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.005316:0:45686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 24 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826407.005338:0:45686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:45686:1874668778707072:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826407.005417:0:45686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf1241be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826407.008366:0:45686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09797c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:45686:1874668778707072:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826407.008400:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826407.008468:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789973504:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3321us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826407.008482:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3156 00000100:00100000:1.0:1787826407.011514:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826407.015212:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789973760 00000100:00100000:3.0:1787826407.015233:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789973760 00000100:00100000:1.0:1787826407.019541:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2768 00000100:00100000:1.0:1787826407.019667:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+69:87451:x1874668789973760:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:1.0:1787826407.020253:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87451:x1874668789973760:12345-192.168.203.9@tcp:35:cp.0 Request processed in 692us (8746us total) trans 8590016810 rc 0/0 00000100:00100000:1.0:1787826407.020264:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2768 00000100:00080000:3.0:1787826407.020949:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826407.084493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.084757:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789973888 00000100:00100000:1.0:1787826407.084771:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789973888 00000100:00100000:1.0:1787826407.084900:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111919 00000100:00100000:1.0:1787826407.084913:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+52:87454:x1874668789973888:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1787826407.084944:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.084973:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d759 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd01f expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085066:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085086:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085101:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085118:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085126:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085133:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085186:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085200:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085207:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085214:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.085219:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085228:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085243:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.085246:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.085252:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085259:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d760 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085278:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085285:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085292:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085298:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.085303:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085309:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085317:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x761ac3a8 (ffff9bbe1342f300) 00010000:00010000:1.0:1787826407.085320:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.085323:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085329:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d767 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085370:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d759 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd01f expref: 53 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085381:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.085384:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.085388:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d759 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd01f expref: 53 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.085400:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c800, rc 0) 00000100:00100000:1.0:1787826407.085595:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+52:87454:x1874668789973888:12345-192.168.203.9@tcp:101:bash.0 Request processed in 684us (1115us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826407.085604:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111919 00000100:00100000:2.0:1787826407.129214:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826407.129384:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789974016 00000100:00100000:3.0:1787826407.129398:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789974016 00000100:00100000:3.0:1787826407.129480:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3491 00000100:00100000:3.0:1787826407.129492:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+70:2400:x1874668789974016:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826407.129749:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826407.129779:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d76e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd026 expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.129901:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.129920:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.129933:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.129952:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.129959:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.129966:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130018:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130024:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130032:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130038:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826407.130043:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130057:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130184:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826407.130188:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826407.130194:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130201:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d775 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130220:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130226:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130231:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130236:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826407.130238:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130244:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130252:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc24f1d8e (ffff9bbf14059000) 00010000:00010000:3.0:1787826407.130255:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826407.130258:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130265:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d77c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc24f1d8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130304:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d76e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd026 expref: 71 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130315:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826407.130318:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826407.130321:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d76e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd026 expref: 71 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.130331:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc -2) 00000100:00100000:3.0:1787826407.130488:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+70:2400:x1874668789974016:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 997us (1288us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826407.130507:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3491 00000100:00100000:2.0:1787826407.142882:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826407.144226:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789974144 00000100:00100000:3.0:1787826407.144244:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789974144 00000100:00100000:3.0:1787826407.144368:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111920 00000100:00100000:3.0:1787826407.144380:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87455:x1874668789974144:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:3.0:1787826407.144406:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826407.144433:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d783 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd02d expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144531:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144548:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144570:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144587:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144595:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144600:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144655:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144662:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144669:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144686:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826407.144692:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144701:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144714:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826407.144718:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826407.144723:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144730:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d78a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144749:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144755:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144761:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144765:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826407.144768:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144773:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144780:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x761ac3a8 (ffff9bbf14059000) 00010000:00010000:3.0:1787826407.144782:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826407.144785:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144790:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d791 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144830:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d783 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd02d expref: 71 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144847:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826407.144915:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826407.144921:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2600/0x68019081f349d783 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd02d expref: 71 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.144931:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc 0) 00000100:00100000:3.0:1787826407.145009:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87455:x1874668789974144:12345-192.168.203.9@tcp:101:rm.0 Request processed in 632us (2167us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826407.145017:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111920 00000100:00100000:0.0:1787826407.161956:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.162292:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789974272 00000100:00100000:1.0:1787826407.162307:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789974272 00000100:00100000:1.0:1787826407.162392:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111921 00000100:00100000:1.0:1787826407.162404:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87455:x1874668789974272:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1787826407.162435:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.162464:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d798 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd034 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162723:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162743:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162758:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162775:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162782:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162789:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162839:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162847:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162896:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162905:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162913:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.162919:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162927:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162942:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.162946:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.162952:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162960:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d79f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162977:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162984:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162991:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.162997:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.163000:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.163007:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.163019:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x761ac3a8 (ffff9bbe1342f300) 00010000:00010000:1.0:1787826407.163022:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.163025:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.163032:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d7a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.163067:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d798 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd034 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.163078:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.163080:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.163084:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d798 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd034 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.163094:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d600, rc 0) 00000100:00100000:1.0:1787826407.163302:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87455:x1874668789974272:12345-192.168.203.9@tcp:101:rm.0 Request processed in 898us (1359us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826407.163312:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111921 00000100:00100000:1.0:1787826407.213771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.213937:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789974400 00000100:00100000:2.0:1787826407.213949:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789974400 00000100:00100000:2.0:1787826407.214024:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111922 00000100:00100000:2.0:1787826407.214034:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87456:x1874668789974400:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826407.214060:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826407.214099:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d7ad lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd03b expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214192:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214210:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214223:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214243:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214249:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214255:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214303:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214311:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214317:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214338:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cebc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.214342:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214351:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214363:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.214367:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.214372:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214378:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebc00/0x68019081f349d7b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214395:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214401:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214406:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214411:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.214413:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214418:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214424:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x761ac3a8 (ffff9bbe16cc5300) 00010000:00010000:2.0:1787826407.214426:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.214428:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214433:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb800/0x68019081f349d7bb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214469:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d7ad lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd03b expref: 71 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214479:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.214482:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.214486:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceaa00/0x68019081f349d7ad lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd03b expref: 71 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.214507:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe09ceaa00, rc 0) 00000100:00100000:2.0:1787826407.214592:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87456:x1874668789974400:12345-192.168.203.9@tcp:101:cp.0 Request processed in 558us (836us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826407.214600:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111922 00000100:00100000:2.0:1787826407.221555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.221719:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789974528 00000100:00100000:0.0:1787826407.221735:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789974528 00000100:00100000:0.0:1787826407.221818:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111923 00000100:00100000:0.0:1787826407.221830:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87456:x1874668789974528:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826407.221898:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826407.221929:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d7c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd042 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222022:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222041:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222055:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222073:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222081:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222087:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222136:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222144:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222152:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222159:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826407.222163:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222171:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222184:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826407.222187:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826407.222194:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222201:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d7c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222217:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222224:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222229:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222234:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826407.222237:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222243:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222255:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x761ac3a8 (ffff9bbe16467800) 00010000:00010000:0.0:1787826407.222258:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826407.222260:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222266:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202e00/0x68019081f349d7d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222319:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d7c2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd042 expref: 71 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222441:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826407.222444:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826407.222449:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d7c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd042 expref: 71 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.222460:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202c00, rc 0) 00000100:00100000:0.0:1787826407.222552:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87456:x1874668789974528:12345-192.168.203.9@tcp:101:cp.0 Request processed in 724us (1012us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826407.222561:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111923 00000100:00100000:3.0:1787826407.228241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.228592:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789974784 00000100:00100000:2.0:1787826407.228606:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789974784 00000100:00100000:2.0:1787826407.228696:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111924 00000100:00100000:2.0:1787826407.228709:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+70:87456:x1874668789974784:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826407.228738:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826407.228770:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349d7d7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd049 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.228987:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.229006:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.229020:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.229038:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.229045:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.229056:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826407.230056:0:7736:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xd6:0x0], index 1: 0 00010000:00010000:2.0:1787826407.230277:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.230294:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.230305:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231496:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231659:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231667:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231684:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231691:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.231696:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231706:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231731:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.231735:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.231742:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231750:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d7de lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826407.231773:0:7736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ae75a68 reply state 00000000a35f835e transno 8590016811 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231786:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.231794:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x761ac3a8 (ffff9bbe16cc5200) 00010000:00010000:2.0:1787826407.231796:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826407.231800:0:7736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826407.233265:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349d7d7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd049 expref: 73 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.233297:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd049 expref: 72 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.233307:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826407.233310:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826407.233314:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:2.0:1787826407.233610:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+73:87456:x1874668789974784:12345-192.168.203.9@tcp:101:cp.0 Request processed in 4901us (5382us total) trans 8590016811 rc 0/0 00000100:00100000:2.0:1787826407.233620:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111924 00000100:00100000:2.0:1787826407.248283:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.248470:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789974912 00000100:00100000:0.0:1787826407.248484:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789974912 00000100:00100000:0.0:1787826407.248580:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6451 00000100:00100000:0.0:1787826407.248593:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+20:2399:x1874668789974912:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826407.248619:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826407.248649:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd050 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826407.248701:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826407.248729:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=3045s v=(0 0) 00010000:00010000:0.0:1787826407.248735:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826407.248748:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd050 expref: 21 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.248774:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd050 expref: 21 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.248791:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202c00, rc 0) 00000100:00100000:0.0:1787826407.248926:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2399:x1874668789974912:12345-192.168.203.9@tcp:101:cp.0 Request processed in 336us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.248935:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6451 00000100:00100000:3.0:1787826407.257086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.257392:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789975040 00000100:00100000:0.0:1787826407.257405:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789975040 00000100:00100000:0.0:1787826407.257482:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6452 00000100:00100000:0.0:1787826407.257494:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a31cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+21:87456:x1874668789975040:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826407.257526:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826407.257551:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd057 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.257788:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd050 expref: 22 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.257805:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826407.257811:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826407.257818:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 22 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.257963:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd050 expref: 22 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.257980:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd050 expref: 22 pid: 8430 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826407.257997:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778707200:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826407.258295:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826407.267624:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.267799:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789975168 00000100:00100000:1.0:1787826407.267811:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789975168 00010000:00010000:1.0:1787826407.267909:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd050 expref: 23 pid: 8430 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826407.267958:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3157 00000100:00100000:1.0:1787826407.267972:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789975168:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826407.267991:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826407.268020:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd050 expref: 23 pid: 8430 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.268038:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd050 expref: 23 pid: 8430 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.268082:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826407.268088:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826407.268099:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 23 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.268113:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 23 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.268161:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 23 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826407.268179:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778707328:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826407.268287:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15babcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787826407.269491:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a84f1f09/0x68019081f349d7fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd050 expref: 23 pid: 8430 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826407.269530:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778707200:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826407.269572:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 22 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.269597:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202e00, rc 0) 00000100:00100000:0.0:1787826407.269666:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a31cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+22:87456:x1874668789975040:12345-192.168.203.9@tcp:101:cp.0 Request processed in 12173us (12615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.269691:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6452 00000100:00100000:1.0:1787826407.275704:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1874668778707328:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826407.275745:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826407.275842:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789975168:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 7870us (8231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.275893:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3157 00000100:00100000:1.0:1787826407.285348:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.285805:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789975424 00000100:00100000:2.0:1787826407.285819:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789975424 00000100:00100000:2.0:1787826407.285944:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2769 00000100:00100000:2.0:1787826407.285957:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+73:87456:x1874668789975424:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:2.0:1787826407.286413:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87456:x1874668789975424:12345-192.168.203.9@tcp:35:cp.0 Request processed in 457us (1079us total) trans 8590016812 rc 0/0 00000100:00100000:2.0:1787826407.286423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2769 00010000:00010000:0.0:1787826407.296209:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826407.357364:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.357501:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789975552 00000100:00100000:0.0:1787826407.357514:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789975552 00000100:00100000:0.0:1787826407.357597:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111925 00000100:00100000:0.0:1787826407.357608:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+52:87459:x1874668789975552:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826407.357637:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826407.357666:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d808 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd05e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357777:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357796:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357809:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357826:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357832:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357838:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357939:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357951:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357957:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357964:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357971:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826407.357975:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357983:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.357997:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826407.358000:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826407.358006:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358013:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d80f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358030:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358036:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358041:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358046:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826407.358049:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358054:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358061:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xf457de12 (ffff9bbe16467000) 00010000:00010000:0.0:1787826407.358063:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826407.358066:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358071:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d816 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358113:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d808 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd05e expref: 53 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358124:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826407.358127:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826407.358130:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d808 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd05e expref: 53 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.358140:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202c00, rc 0) 00000100:00100000:0.0:1787826407.358214:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+52:87459:x1874668789975552:12345-192.168.203.9@tcp:101:bash.0 Request processed in 608us (865us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826407.358222:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111925 00000100:00100000:3.0:1787826407.372747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.373275:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789975680 00000100:00100000:2.0:1787826407.373289:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789975680 00000100:00100000:2.0:1787826407.373437:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111926 00000100:00100000:2.0:1787826407.373460:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87460:x1874668789975680:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826407.373492:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826407.373521:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d81d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd065 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373611:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373629:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373642:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373658:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373669:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373687:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373741:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373749:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373756:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373763:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373769:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.373774:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373782:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373795:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.373798:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.373803:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373810:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d824 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373826:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373832:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373837:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373841:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.373843:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373847:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373925:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xf457de12 (ffff9bbe16cc5300) 00010000:00010000:2.0:1787826407.373927:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.373931:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373937:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d82b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373975:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d81d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd065 expref: 75 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.373986:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.373988:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.373993:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d81d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd065 expref: 75 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.374003:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826407.374098:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87460:x1874668789975680:12345-192.168.203.9@tcp:101:rm.0 Request processed in 642us (1365us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826407.374107:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111926 00000100:00100000:0.0:1787826407.384546:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.386181:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789975808 00000100:00100000:2.0:1787826407.386203:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789975808 00000100:00100000:2.0:1787826407.386303:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111927 00000100:00100000:2.0:1787826407.386317:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87460:x1874668789975808:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826407.386347:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826407.386385:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349d832 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd06c expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386482:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386502:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386526:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386545:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386552:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386558:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386611:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386619:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386626:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386632:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.386636:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386644:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386659:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.386662:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.386667:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386685:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d839 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386702:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386708:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386714:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386720:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.386723:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386729:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386736:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xf457de12 (ffff9bbe16cc5500) 00010000:00010000:2.0:1787826407.386738:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.386741:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386746:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d840 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386784:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349d832 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd06c expref: 75 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386795:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.386797:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.386801:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349d832 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd06c expref: 75 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.386810:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:2.0:1787826407.386953:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87460:x1874668789975808:12345-192.168.203.9@tcp:101:rm.0 Request processed in 638us (2423us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826407.386962:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111927 00000100:00100000:3.0:1787826407.411028:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.411344:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789975936 00000100:00100000:1.0:1787826407.411427:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789975936 00000100:00100000:1.0:1787826407.411761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111928 00000100:00100000:1.0:1787826407.411774:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87461:x1874668789975936:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826407.411799:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.411830:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d847 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd073 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.411997:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412014:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412027:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412043:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412050:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412057:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412120:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412129:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412136:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412144:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412150:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993da00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.412155:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412163:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412177:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.412180:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.412185:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412191:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d84e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412209:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412216:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412222:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412227:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.412230:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412235:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412242:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xf457de12 (ffff9bbe1342f300) 00010000:00010000:1.0:1787826407.412244:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.412246:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412252:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d855 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412293:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d847 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd073 expref: 75 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412304:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.412307:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.412310:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d847 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd073 expref: 75 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.412320:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d800, rc 0) 00000100:00100000:1.0:1787826407.412414:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87461:x1874668789975936:12345-192.168.203.9@tcp:101:cp.0 Request processed in 642us (1400us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826407.412422:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111928 00000100:00100000:3.0:1787826407.417330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.417628:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789976064 00000100:00100000:2.0:1787826407.417641:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789976064 00000100:00100000:2.0:1787826407.417728:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111929 00000100:00100000:2.0:1787826407.417739:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87461:x1874668789976064:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826407.417766:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826407.417793:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d85c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd07a expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.417921:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.417939:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.417954:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.417971:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.417978:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.417984:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418034:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418043:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418050:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418058:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.418075:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418086:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418100:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.418102:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.418108:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418113:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d863 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418128:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418134:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418140:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418144:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.418146:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418153:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418164:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xf457de12 (ffff9bbe16cc5500) 00010000:00010000:2.0:1787826407.418167:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.418170:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418176:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d86a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418215:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d85c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd07a expref: 75 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418227:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.418229:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.418232:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d85c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd07a expref: 75 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.418242:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826407.418319:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fcc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87461:x1874668789976064:12345-192.168.203.9@tcp:101:cp.0 Request processed in 581us (1004us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826407.418328:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111929 00000100:00100000:2.0:1787826407.423059:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.423438:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789976320 00000100:00100000:0.0:1787826407.423454:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789976320 00000100:00100000:0.0:1787826407.423531:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111930 00000100:00100000:0.0:1787826407.423542:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+74:87461:x1874668789976320:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826407.423576:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826407.423605:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d871 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd081 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.423797:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.423817:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.423831:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.423848:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.423898:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.423906:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826407.424340:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd6:0x0], index 0: 0 00010000:00010000:0.0:1787826407.424514:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424523:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424532:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424571:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424578:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424585:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424592:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424598:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826407.424603:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424611:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424624:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826407.424627:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826407.424632:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424639:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202600/0x68019081f349d878 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826407.424653:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054219a8c reply state 00000000fd8cccec transno 8590016813 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424666:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424683:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xf457de12 (ffff9bbe16467000) 00010000:00010000:0.0:1787826407.424686:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826407.424689:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826407.424722:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d871 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd081 expref: 77 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424737:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd081 expref: 76 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.424745:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:0.0:1787826407.424747:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826407.424750:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202c00, rc 0) 00000100:00100000:0.0:1787826407.424841:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+77:87461:x1874668789976320:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1301us (1797us total) trans 8590016813 rc 0/0 00000100:00100000:0.0:1787826407.424892:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111930 00000100:00100000:0.0:1787826407.434361:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.434475:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789976448 00000100:00100000:1.0:1787826407.434489:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789976448 00000100:00100000:1.0:1787826407.434572:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6453 00000100:00100000:1.0:1787826407.434584:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789976448:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826407.434610:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.434641:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd088 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826407.434690:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826407.434719:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=3045s v=(0 0) 00010000:00010000:1.0:1787826407.434725:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826407.434738:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd088 expref: 25 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.434762:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd088 expref: 25 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.434781:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826407.434922:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789976448:12345-192.168.203.9@tcp:101:cp.0 Request processed in 339us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.434930:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6453 00000100:00100000:1.0:1787826407.439653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.439823:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789976576 00000100:00100000:0.0:1787826407.439835:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789976576 00000100:00100000:0.0:1787826407.439936:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6454 00000100:00100000:0.0:1787826407.439947:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:87461:x1874668789976576:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826407.439974:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826407.440000:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd08f expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.440049:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd088 expref: 26 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.440060:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826407.440137:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826407.440146:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 4/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 26 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.440195:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd088 expref: 26 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.440212:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd088 expref: 26 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826407.440231:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159cad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778707456:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826407.440372:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826407.445173:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.445401:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159cad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778707456:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826407.445450:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 3/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 26 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.445487:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202600, rc 0) 00000100:00100000:1.0:1787826407.445570:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+26:87461:x1874668789976576:12345-192.168.203.9@tcp:101:cp.0 Request processed in 5623us (5932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.445581:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6454 00000100:00100000:2.0:1787826407.455325:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789976704 00000100:00100000:2.0:1787826407.455351:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789976704 00010000:00010000:2.0:1787826407.455440:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd088 expref: 26 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826407.455509:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3158 00000100:00100000:2.0:1787826407.455521:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2402:x1874668789976704:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826407.455541:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826407.455572:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd088 expref: 26 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.455590:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd088 expref: 26 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.455625:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d894 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd088 expref: 26 pid: 19335 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.455652:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826407.455657:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826407.455668:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.455693:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.455749:0:15760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826407.455769:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778707584:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826407.458046:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf1241bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826407.466087:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15760:1874668778707584:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826407.466138:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826407.466228:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789976704:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 10707us (21069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826407.466241:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3158 00000100:00100000:0.0:1787826407.473010:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.473133:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789976960 00000100:00100000:1.0:1787826407.473145:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789976960 00000100:00100000:1.0:1787826407.473234:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2770 00000100:00100000:1.0:1787826407.473246:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+77:87461:x1874668789976960:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:1.0:1787826407.473665:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87461:x1874668789976960:12345-192.168.203.9@tcp:35:cp.0 Request processed in 420us (671us total) trans 8590016814 rc 0/0 00000100:00100000:1.0:1787826407.473686:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2770 00000100:00100000:3.0:1787826407.546749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.546893:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789977088 00000100:00100000:1.0:1787826407.546907:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789977088 00000100:00100000:1.0:1787826407.546998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111931 00000100:00100000:1.0:1787826407.547010:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+52:87464:x1874668789977088:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1787826407.547038:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.547140:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d8a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547241:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547264:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547279:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547298:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547305:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547311:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547367:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547375:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547382:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547390:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547397:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.547402:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547410:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547424:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.547427:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.547433:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547439:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547460:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547466:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547473:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547478:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.547481:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547486:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547493:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x2e415c5a (ffff9bbe1342fc00) 00010000:00010000:1.0:1787826407.547496:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.547498:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547504:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547544:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d8a2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd096 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547555:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.547557:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.547562:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d8a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd096 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.547570:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993da00, rc 0) 00000100:00100000:1.0:1787826407.547657:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41276940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+52:87464:x1874668789977088:12345-192.168.203.9@tcp:101:bash.0 Request processed in 650us (924us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826407.547665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111931 00000100:00100000:0.0:1787826407.567299:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.567935:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789977216 00000100:00100000:2.0:1787826407.568363:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789977216 00000100:00100000:2.0:1787826407.568521:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111932 00000100:00100000:2.0:1787826407.568535:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87465:x1874668789977216:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826407.568638:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826407.568680:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d8b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd09d expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.568787:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.568806:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.568821:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.568839:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.568847:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569521:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569649:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569658:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569666:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569682:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.569688:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569846:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569884:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.569887:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.569893:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569900:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8be lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569918:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569925:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569930:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.569936:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.569939:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.570237:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.570246:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x2e415c5a (ffff9bbe16cc5500) 00010000:00010000:2.0:1787826407.570249:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.570252:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.570258:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.570314:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d8b7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd09d expref: 79 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.570391:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.570395:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.570400:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d8b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd09d expref: 79 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.570410:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826407.570709:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87465:x1874668789977216:12345-192.168.203.9@tcp:101:rm.0 Request processed in 2175us (3425us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826407.570721:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111932 00000100:00100000:0.0:1787826407.578767:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.579627:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789977344 00000100:00100000:2.0:1787826407.579643:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789977344 00000100:00100000:2.0:1787826407.579794:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111933 00000100:00100000:2.0:1787826407.579807:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87465:x1874668789977344:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826407.579838:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826407.579887:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d8cc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0a4 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.579978:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.579995:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580008:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580025:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580033:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580038:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580105:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580113:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580119:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580126:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.580130:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580139:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580152:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.580155:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.580160:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580167:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d8d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580183:0:45683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580190:0:45683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580196:0:45683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580201:0:45683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.580204:0:45683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580209:0:45683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580220:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x2e415c5a (ffff9bbe16cc5500) 00010000:00010000:2.0:1787826407.580223:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.580226:0:45683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580232:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8da lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580268:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d8cc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0a4 expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580280:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.580282:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.580285:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d8cc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0a4 expref: 79 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.580294:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826407.580389:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87465:x1874668789977344:12345-192.168.203.9@tcp:101:rm.0 Request processed in 585us (1642us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826407.580397:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111933 00000100:00100000:3.0:1787826407.622966:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.623195:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789977472 00000100:00100000:1.0:1787826407.623208:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789977472 00000100:00100000:1.0:1787826407.623286:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111934 00000100:00100000:1.0:1787826407.623297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87466:x1874668789977472:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826407.623391:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.623423:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d8e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.623513:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.623530:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.623544:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.623824:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.623834:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.623842:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.623930:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.623939:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624398:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624405:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624411:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.624416:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624424:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624440:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.624616:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.624625:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624633:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d8e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624654:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624661:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624668:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624685:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.624688:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624694:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624702:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x2e415c5a (ffff9bbe1342fc00) 00010000:00010000:1.0:1787826407.624705:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.624708:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624714:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d8ef lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624762:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d8e1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ab expref: 79 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624773:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.624775:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.624779:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d8e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ab expref: 79 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.624788:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993da00, rc 0) 00000100:00100000:1.0:1787826407.624926:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87466:x1874668789977472:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1629us (1974us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826407.626525:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111934 00000100:00100000:0.0:1787826407.637052:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.637163:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789977600 00000100:00100000:2.0:1787826407.637177:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789977600 00000100:00100000:2.0:1787826407.637261:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111935 00000100:00100000:2.0:1787826407.637274:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87466:x1874668789977600:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:2.0:1787826407.637317:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826407.637355:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d8f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637448:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637465:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637478:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637494:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637500:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637506:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637558:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637567:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637574:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637581:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637588:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.637594:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637603:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637617:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.637620:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.637625:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637631:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349d8fd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637648:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637655:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637661:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637666:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.637668:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637682:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637690:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x2e415c5a (ffff9bbe16cc5500) 00010000:00010000:2.0:1787826407.637693:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.637696:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637702:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349d904 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637740:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d8f6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b2 expref: 79 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637752:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.637754:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.637758:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349d8f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b2 expref: 79 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.637768:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826407.639022:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87466:x1874668789977600:12345-192.168.203.9@tcp:101:cp.0 Request processed in 1740us (1975us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826407.639036:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111935 00000100:00100000:0.0:1787826407.648959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.649084:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789977856 00000100:00100000:1.0:1787826407.649097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789977856 00000100:00100000:1.0:1787826407.649178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111936 00000100:00100000:1.0:1787826407.649191:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+78:87466:x1874668789977856:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:1.0:1787826407.649218:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.649245:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d90b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0b9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.649691:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.649713:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.649727:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.649745:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.649753:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.649760:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826407.650419:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xd7:0x0], index 1: 0 00010000:00010000:1.0:1787826407.650581:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.650599:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.650610:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.650646:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.650654:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.650661:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.650668:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.651366:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826407.651370:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.651379:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.651392:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.651395:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826407.651400:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.651406:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d912 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826407.651423:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1178de6 reply state 00000000eb2349ed transno 8590016815 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.651432:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.651439:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x2e415c5a (ffff9bbe1342fc00) 00010000:00010000:1.0:1787826407.651441:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826407.651444:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826407.651481:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d90b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b9 expref: 81 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.651495:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b9 expref: 80 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.651502:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:1.0:1787826407.651505:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826407.651507:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d800, rc 0) 00000100:00100000:1.0:1787826407.651571:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+81:87466:x1874668789977856:12345-192.168.203.9@tcp:101:cp.0 Request processed in 2382us (2625us total) trans 8590016815 rc 0/0 00000100:00100000:1.0:1787826407.651579:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111936 00000100:00100000:1.0:1787826407.655390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.655893:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789977984 00000100:00100000:0.0:1787826407.656140:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789977984 00000100:00100000:0.0:1787826407.656204:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6455 00000100:00100000:0.0:1787826407.656215:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668789977984:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:0.0:1787826407.656231:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826407.656251:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0c0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826407.656276:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826407.656293:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=3045s v=(0 0) 00010000:00010000:0.0:1787826407.656297:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826407.656307:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c0 expref: 22 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.656324:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c0 expref: 22 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.656337:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203e00, rc 0) 00000100:00100000:0.0:1787826407.656401:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2401:x1874668789977984:12345-192.168.203.9@tcp:101:cp.0 Request processed in 189us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.656408:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6455 00000100:00100000:0.0:1787826407.669569:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826407.669819:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789978112 00000100:00100000:3.0:1787826407.669830:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789978112 00000100:00100000:3.0:1787826407.669931:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6456 00000100:00100000:3.0:1787826407.669940:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+22:87466:x1874668789978112:12345-192.168.203.9@tcp:101:cp.0 00010000:00010000:3.0:1787826407.669959:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826407.669977:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0c7 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.670011:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c0 expref: 23 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.670021:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826407.670025:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826407.670029:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 23 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.670064:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c0 expref: 23 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.670078:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c0 expref: 23 pid: 25038 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826407.670092:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf412761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778707712:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826407.670192:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe09c76cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826407.688088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.688203:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789978240 00000100:00100000:1.0:1787826407.688217:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789978240 00010000:00010000:1.0:1787826407.688265:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c0 expref: 24 pid: 25038 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826407.688313:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3159 00000100:00100000:1.0:1787826407.688323:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789978240:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826407.688338:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826407.688359:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c0 expref: 24 pid: 25038 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.688373:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c0 expref: 24 pid: 25038 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.688397:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826407.688402:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826407.688410:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 24 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.688420:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 24 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.688455:0:9521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 24 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826407.688469:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba4780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778707840:192.168.203.9@tcp:105: 00000100:00100000:1.0:1787826407.688562:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ee2840 going to sleep for 11 seconds 00010000:00010000:0.0:1787826407.688959:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc2ce88d/0x68019081f349d92e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c0 expref: 24 pid: 25038 timeout: 3145 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826407.688976:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf412761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778707712:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826407.689009:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 23 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.689025:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a2600, rc 0) 00000100:00100000:0.0:1787826407.689056:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+23:87466:x1874668789978112:12345-192.168.203.9@tcp:101:cp.0 Request processed in 19117us (19497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.689063:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6456 00000100:00100000:1.0:1787826407.704927:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba4780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9521:1874668778707840:192.168.203.9@tcp:105: 00010000:00010000:1.0:1787826407.704953:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826407.705015:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2402:x1874668789978240:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 16692us (16950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.705030:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3159 00000100:00100000:3.0:1787826407.710745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.713293:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789978496 00000100:00100000:0.0:1787826407.713306:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789978496 00000100:00100000:0.0:1787826407.713377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2771 00000100:00100000:0.0:1787826407.713387:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+81:87466:x1874668789978496:12345-192.168.203.9@tcp:35:cp.0 00000100:00100000:0.0:1787826407.713663:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:87466:x1874668789978496:12345-192.168.203.9@tcp:35:cp.0 Request processed in 277us (2929us total) trans 8590016816 rc 0/0 00000100:00100000:0.0:1787826407.713683:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2771 00000100:00100000:3.0:1787826407.778818:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.778958:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789978752 00000100:00100000:0.0:1787826407.778973:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789978752 00000100:00100000:0.0:1787826407.779050:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111937 00000100:00100000:0.0:1787826407.779060:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+52:87230:x1874668789978752:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1787826407.779078:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826407.779098:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d93c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0ce expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826407.779192:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4d:0x0]: returning size 4096 00010000:00010000:0.0:1787826407.779288:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d93c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ce expref: 54 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.779301:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826407.779304:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826407.779309:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d93c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ce expref: 54 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.779322:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203e00, rc 0) 00000100:00100000:0.0:1787826407.779384:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+53:87230:x1874668789978752:12345-192.168.203.9@tcp:101:bash.0 Request processed in 325us (580us total) trans 8590016817 rc 301/301 00000100:00100000:0.0:1787826407.779392:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111937 00000100:00100000:3.0:1787826407.808817:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.811891:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789978880 00000100:00100000:1.0:1787826407.811920:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789978880 00000100:00100000:1.0:1787826407.811996:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111938 00000100:00100000:1.0:1787826407.812007:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+53:87230:x1874668789978880:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1787826407.812030:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.812050:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d94a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0d5 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.812114:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d951 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.812128:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.812139:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826407.812181:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4d:0x0]: returning size 4096 00000004:00200000:1.0:1787826407.812184:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826407.812204:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.812226:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d94a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0d5 expref: 55 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.812245:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993da00/0x68019081f349d951 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0d5 expref: 54 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.812257:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826407.812260:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826407.812263:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993da00, rc 0) 00000100:00100000:1.0:1787826407.812332:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf412761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+54:87230:x1874668789978880:12345-192.168.203.9@tcp:101:bash.0 Request processed in 327us (3529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.812339:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111938 00000100:00100000:3.0:1787826407.816542:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.816618:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789979008 00000100:00100000:2.0:1787826407.816631:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789979008 00000100:00100000:0.0:1787826407.816740:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2772 00000100:00100000:0.0:1787826407.816764:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+54:87230:x1874668789979008:12345-192.168.203.9@tcp:37:bash.0 00000100:00100000:0.0:1787826407.830898:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+54:87230:x1874668789979008:12345-192.168.203.9@tcp:37:bash.0 Request processed in 14127us (14352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.830916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2772 00000100:00100000:2.0:1787826407.836060:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.836238:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789979264 00000100:00100000:1.0:1787826407.836251:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789979264 00000100:00100000:1.0:1787826407.836328:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2773 00000100:00100000:1.0:1787826407.836342:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+54:87230:x1874668789979264:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:1.0:1787826407.836792:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+55:87230:x1874668789979264:12345-192.168.203.9@tcp:35:bash.0 Request processed in 451us (758us total) trans 8590016818 rc 0/0 00000100:00100000:1.0:1787826407.836804:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2773 00000100:00100000:1.0:1787826407.867979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826407.868223:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789979392 00000100:00100000:3.0:1787826407.868235:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789979392 00000100:00100000:3.0:1787826407.868319:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111939 00000100:00100000:3.0:1787826407.868330:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+55:87469:x1874668789979392:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826407.868364:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826407.868391:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d958 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0dc expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.868487:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.868508:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.868534:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.868546:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.868777:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.868787:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.868936:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.868946:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.868954:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826407.869006:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x148:0x0]: returning size 1516 00000004:00200000:3.0:1787826407.869011:0:7736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826407.869037:0:7736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869055:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869066:0:7736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869073:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869081:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869088:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869094:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826407.869099:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869109:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869125:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826407.869127:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826407.869133:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869139:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d95f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869156:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869162:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869167:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869171:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826407.869175:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869180:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869187:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xde9470f2 (ffff9bbe16cc5600) 00010000:00010000:3.0:1787826407.869190:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826407.869192:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869198:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d966 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869710:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d958 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0dc expref: 57 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869732:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0dc expref: 56 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.869740:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:3.0:1787826407.869743:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826407.869747:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3400, rc 0) 00000100:00100000:3.0:1787826407.870013:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+56:87469:x1874668789979392:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1682us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826407.870023:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111939 00000100:00100000:3.0:1787826407.888646:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826407.891637:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789979520 00000100:00100000:2.0:1787826407.891658:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789979520 00000100:00100000:2.0:1787826407.891889:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6457 00000100:00100000:2.0:1787826407.891902:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789979520:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826407.891925:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826407.891947:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b81040/0x68019081f349d974 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0e3 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826407.892028:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe128392c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778707968:192.168.203.9@tcp:106: 00000100:00100000:2.0:1787826407.893402:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf1241bb40 going to sleep for 11 seconds 00000100:00080000:3.0:1787826407.898174:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787826407.898708:0:8433:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826407.898716:0:8433:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb mtime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.898719:0:8433:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb atime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.898721:0:8433:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb ctime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.898723:0:8433:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826407.898756:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe128392c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778707968:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826407.898807:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092b81040/0x68019081f349d974 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0e3 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.898843:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b81040/0x68019081f349d974 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0e3 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.898884:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:1.0:1787826407.898965:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2402:x1874668789979520:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 7066us (10333us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826407.898976:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6457 00000100:00100000:1.0:1787826407.915297:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826407.915622:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789979648 00000100:00100000:3.0:1787826407.915634:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789979648 00000100:00100000:3.0:1787826407.915725:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111940 00000100:00100000:3.0:1787826407.915738:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+56:87469:x1874668789979648:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826407.915932:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826407.915962:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d97b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0ea expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.916060:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.916318:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.916336:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916449:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916461:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916470:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916573:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916583:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916591:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826407.916647:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x149:0x0]: returning size 1516 00000004:00200000:2.0:1787826407.916652:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826407.916689:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916715:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916736:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916748:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916757:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916764:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.916768:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916777:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916793:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826407.916796:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.916802:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916809:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d982 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916826:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916833:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916839:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916952:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826407.916957:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916963:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916972:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x7481f5ae (ffff9bbe16467c00) 00010000:00010000:2.0:1787826407.916975:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826407.916978:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.916984:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349d989 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.917024:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d97b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ea expref: 58 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.917054:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ea expref: 57 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.917062:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:2.0:1787826407.917064:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826407.917067:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3c00, rc 0) 00000100:00100000:2.0:1787826407.917168:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+57:87469:x1874668789979648:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1432us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826407.917177:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111940 00000100:00100000:3.0:1787826407.925700:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.925920:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789979776 00000100:00100000:1.0:1787826407.925934:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789979776 00000100:00100000:1.0:1787826407.926028:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6458 00000100:00100000:1.0:1787826407.926217:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789979776:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826407.926244:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.926270:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d997 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0f1 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826407.926352:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778708096:192.168.203.9@tcp:106: 00000100:00080000:3.0:1787826407.926497:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826407.926559:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ee2f00 going to sleep for 11 seconds 00002000:00010000:1.0:1787826407.938975:0:45681:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xd4:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826407.938990:0:45681:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xd4:0x0] updating lvb mtime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.938993:0:45681:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xd4:0x0] updating lvb atime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.938996:0:45681:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xd4:0x0] updating lvb ctime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.938998:0:45681:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xd4:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826407.939030:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778708096:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826407.939096:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d997 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f1 expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.939140:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d997 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f1 expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.939157:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826407.939244:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a1170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789979776:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 13206us (13558us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826407.939255:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6458 00000100:00100000:2.0:1787826407.945012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826407.945172:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789979904 00000100:00100000:3.0:1787826407.945186:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789979904 00000100:00100000:3.0:1787826407.945267:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111941 00000100:00100000:3.0:1787826407.945280:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+57:87469:x1874668789979904:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826407.945311:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826407.945339:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d99e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0f8 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945431:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945449:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945462:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945475:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945482:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945489:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945601:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945610:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945617:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826407.945680:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14a:0x0]: returning size 1516 00000004:00200000:3.0:1787826407.945687:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826407.945716:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945732:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945743:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945751:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945758:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945764:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945772:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826407.945777:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945786:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945800:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:3.0:1787826407.945802:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826407.945807:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945814:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349d9a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945835:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945842:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945848:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945924:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826407.945927:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945934:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945942:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc8f218d (ffff9bbf14059500) 00010000:00010000:3.0:1787826407.945944:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826407.945948:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945954:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349d9ac lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.945987:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2c00/0x68019081f349d99e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f8 expref: 59 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.946001:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f8 expref: 58 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826407.946014:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:3.0:1787826407.946016:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826407.946018:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607800, rc 0) 00000100:00100000:3.0:1787826407.946353:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+58:87469:x1874668789979904:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1072us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826407.946362:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111941 00000100:00100000:3.0:1787826407.952409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826407.952528:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789980032 00000100:00100000:1.0:1787826407.952540:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789980032 00000100:00100000:1.0:1787826407.952620:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6459 00000100:00100000:1.0:1787826407.952632:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789980032:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826407.952659:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.952691:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d9ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd0ff expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826407.952778:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778708224:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826407.952929:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ee2f00 going to sleep for 11 seconds 00002000:00010000:1.0:1787826407.957940:0:8432:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826407.957953:0:8432:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb mtime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.957955:0:8432:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb atime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.957958:0:8432:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb ctime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.957961:0:8432:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826407.957992:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778708224:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826407.958259:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d9ba lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ff expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.958293:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349d9ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ff expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.958311:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826407.960183:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789980032:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 5761us (5997us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826407.960201:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6459 00000100:00100000:2.0:1787826407.968554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.968695:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789980160 00000100:00100000:0.0:1787826407.968709:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789980160 00000100:00100000:0.0:1787826407.968790:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111942 00000100:00100000:0.0:1787826407.968803:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+58:87469:x1874668789980160:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826407.968830:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826407.968984:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d9c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd106 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969146:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969166:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969181:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969196:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969204:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969210:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969302:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969311:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969319:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826407.969372:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14b:0x0]: returning size 1516 00000004:00200000:0.0:1787826407.969378:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826407.969404:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969417:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969427:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969435:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969446:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969452:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969459:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17202200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826407.969464:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969472:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969486:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826407.969490:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826407.969496:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969502:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349d9c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969519:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969525:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969531:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969536:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826407.969540:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969546:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969553:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xa9df8504 (ffff9bbe16cc5c00) 00010000:00010000:0.0:1787826407.969556:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826407.969559:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969565:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349d9cf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969595:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349d9c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd106 expref: 60 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969611:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd106 expref: 59 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826407.969618:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:0.0:1787826407.969620:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826407.969623:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204000, rc 0) 00000100:00100000:0.0:1787826407.969723:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+59:87469:x1874668789980160:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 921us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.969732:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111942 00000100:00100000:3.0:1787826407.979257:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826407.983192:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789980288 00000100:00100000:0.0:1787826407.983213:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789980288 00000100:00100000:1.0:1787826407.983427:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6460 00000100:00100000:1.0:1787826407.983441:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3d6f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789980288:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826407.983467:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826407.983492:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d9dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd10d expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826407.983590:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778708352:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826407.983730:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ee2f00 going to sleep for 11 seconds 00002000:00010000:1.0:1787826407.994718:0:8605:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xd5:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826407.994734:0:8605:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xd5:0x0] updating lvb mtime: 0 -> 1787826407 00002000:00010000:1.0:1787826407.994736:0:8605:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xd5:0x0] updating lvb atime: 0 -> 1787826406 00002000:00010000:1.0:1787826407.994738:0:8605:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xd5:0x0] updating lvb ctime: 0 -> 1787826407 00002000:00010000:1.0:1787826407.994741:0:8605:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xd5:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826407.994778:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778708352:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826407.994832:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d9dd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd10d expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.994893:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015699e59/0x68019081f349d9dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd10d expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826407.994912:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826407.995987:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3d6f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789980288:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 12532us (16730us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826407.996001:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6460 00000100:00100000:2.0:1787826408.007332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.011787:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789980416 00000100:00100000:1.0:1787826408.011808:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789980416 00000100:00080000:3.0:1787826408.012094:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826408.012262:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111943 00000100:00100000:1.0:1787826408.012276:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+59:87469:x1874668789980416:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826408.012306:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.012338:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d9e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd114 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012431:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012449:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012462:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012476:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012488:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012495:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012601:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012610:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012616:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826408.012677:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14c:0x0]: returning size 1516 00000004:00200000:1.0:1787826408.012684:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826408.012710:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012726:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012735:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012742:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012749:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012760:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826408.012764:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012773:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012787:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826408.012790:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826408.012796:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012803:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349d9eb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012821:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.012826:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.014953:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.014967:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ee00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826408.014973:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.014984:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.015011:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbf14059600) 00010000:00010000:1.0:1787826408.015015:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826408.015020:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.015027:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349d9f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.015265:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349d9e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd114 expref: 61 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.015285:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd114 expref: 60 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.015293:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:1.0:1787826408.015296:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826408.015298:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f800, rc 0) 00000100:00100000:1.0:1787826408.015406:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+60:87469:x1874668789980416:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 3131us (8170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.015416:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111943 00000100:00100000:3.0:1787826408.018360:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.018607:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789980544 00000100:00100000:0.0:1787826408.018620:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789980544 00000100:00100000:0.0:1787826408.018710:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6461 00000100:00100000:0.0:1787826408.018723:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789980544:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826408.018747:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826408.018772:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349da00 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd11b expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.018897:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778708480:192.168.203.9@tcp:106: 00000100:00100000:0.0:1787826408.019003:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e540 going to sleep for 11 seconds 00002000:00010000:0.0:1787826408.022695:0:8433:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xd5:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1787826408.022708:0:8433:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xd5:0x0] updating lvb mtime: 0 -> 1787826407 00002000:00010000:0.0:1787826408.022711:0:8433:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xd5:0x0] updating lvb atime: 0 -> 1787826407 00002000:00010000:0.0:1787826408.022714:0:8433:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xd5:0x0] updating lvb ctime: 0 -> 1787826407 00002000:00010000:0.0:1787826408.022716:0:8433:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xd5:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1787826408.022750:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778708480:192.168.203.9@tcp:106: 00010000:00010000:0.0:1787826408.022800:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349da00 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd11b expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.022830:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349da00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd11b expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.023200:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826408.023329:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668789980544:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 4608us (4984us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826408.023341:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6461 00000100:00100000:2.0:1787826408.042032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.042384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789980672 00000100:00100000:1.0:1787826408.042396:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789980672 00000100:00100000:1.0:1787826408.042530:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111944 00000100:00100000:1.0:1787826408.042542:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+60:87469:x1874668789980672:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826408.042582:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.042623:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349da07 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.042741:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.042760:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.042774:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.042787:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.042795:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.042801:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.042940:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.042950:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.042957:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826408.043011:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14d:0x0]: returning size 1516 00000004:00200000:1.0:1787826408.043016:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826408.043055:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043201:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043212:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043219:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043225:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043231:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043237:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826408.043242:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043249:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043262:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826408.043265:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826408.043271:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043277:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349da0e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043294:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043300:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043305:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043309:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9e800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826408.043312:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043317:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043324:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x761ac3a8 (ffff9bbe16cc5200) 00010000:00010000:1.0:1787826408.043326:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826408.043329:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043334:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349da15 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043364:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ee00/0x68019081f349da07 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd122 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043379:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd122 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.043385:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:1.0:1787826408.043388:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826408.043391:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9ea00, rc 0) 00000100:00100000:1.0:1787826408.043595:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe128392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+61:87469:x1874668789980672:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1047us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.043605:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111944 00000100:00100000:3.0:1787826408.049365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.049556:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789980800 00000100:00100000:1.0:1787826408.049566:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789980800 00000100:00100000:1.0:1787826408.049631:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6462 00000100:00100000:1.0:1787826408.049640:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789980800:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826408.049658:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.049687:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349da23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd129 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.049748:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778708608:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826408.049839:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ee2f00 going to sleep for 11 seconds 00002000:00010000:1.0:1787826408.065008:0:45681:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xd6:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826408.065018:0:45681:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xd6:0x0] updating lvb mtime: 0 -> 1787826407 00002000:00010000:1.0:1787826408.065020:0:45681:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xd6:0x0] updating lvb atime: 0 -> 1787826407 00002000:00010000:1.0:1787826408.065023:0:45681:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xd6:0x0] updating lvb ctime: 0 -> 1787826407 00002000:00010000:1.0:1787826408.065024:0:45681:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xd6:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826408.065048:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778708608:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826408.065083:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349da23 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd129 expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.065108:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349da23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd129 expref: 10 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.065126:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9ec00, rc 0) 00000100:00100000:1.0:1787826408.065197:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668789980800:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 15558us (15842us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826408.065206:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6462 00000100:00100000:2.0:1787826408.076682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.076832:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789980928 00000100:00100000:0.0:1787826408.076841:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789980928 00000100:00100000:0.0:1787826408.076936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111945 00000100:00100000:0.0:1787826408.076946:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+61:87469:x1874668789980928:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826408.076968:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826408.076991:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349da2a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd130 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077055:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077069:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077079:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077092:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077099:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077105:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077178:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077187:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077193:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826408.077237:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14e:0x0]: returning size 1516 00000004:00200000:0.0:1787826408.077242:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826408.077263:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077275:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077285:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077291:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077298:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077304:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077311:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826408.077315:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077322:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077333:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826408.077336:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826408.077342:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077353:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349da31 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077368:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077374:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077381:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077386:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826408.077389:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077395:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077403:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xf457de12 (ffff9bbe16467000) 00010000:00010000:0.0:1787826408.077405:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826408.077408:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077414:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349da38 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077440:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349da2a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd130 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077459:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd130 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.077465:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:0.0:1787826408.077468:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826408.077470:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202200, rc 0) 00000100:00100000:0.0:1787826408.077552:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+62:87469:x1874668789980928:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 607us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.077560:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111945 00000100:00100000:3.0:1787826408.087954:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.090160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.092887:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789981056 00000100:00100000:2.0:1787826408.092908:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789981056 00000100:00100000:2.0:1787826408.093097:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3492 00000100:00100000:2.0:1787826408.093111:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+62:2400:x1874668789981056:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826408.093189:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826408.093219:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349da46 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd137 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093301:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093321:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093334:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093348:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093355:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093362:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093512:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093521:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093529:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826408.093566:0:8442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14f:0x0]: returning size 1516 00000004:00200000:2.0:1787826408.093572:0:8442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826408.093608:0:8442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093623:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093631:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093637:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093644:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093651:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826408.093655:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093664:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093689:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826408.093693:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826408.093699:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093709:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349da4d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093726:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093733:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093739:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093743:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826408.093745:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093751:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093757:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x2e415c5a (ffff9bbe1342fc00) 00010000:00010000:2.0:1787826408.093760:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826408.093763:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093769:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349da54 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093799:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349da46 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd137 expref: 64 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093820:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd137 expref: 63 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093828:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:2.0:1787826408.093831:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826408.093833:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00010000:00010000:2.0:1787826408.093841:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826408.093902:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349da62 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd13e expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093933:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093941:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093948:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093963:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093970:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093977:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.093996:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094003:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094009:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094015:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826408.094019:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094026:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094034:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826408.094036:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826408.094040:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094045:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349da69 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094055:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094060:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094066:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094072:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826408.094076:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094082:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094089:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x9f9da1de (ffff9bbe16cc5500) 00010000:00010000:2.0:1787826408.094092:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826408.094095:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094101:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349da70 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094126:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349da62 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd13e expref: 64 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094137:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826408.094140:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826408.094144:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349da62 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd13e expref: 64 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.094153:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2e00, rc -2) 00000100:00100000:2.0:1787826408.094259:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+63:2400:x1874668789981056:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 1150us (6322us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826408.094269:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3492 00000100:00100000:1.0:1787826408.094819:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789981184 00000100:00100000:1.0:1787826408.094829:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789981184 00000100:00100000:1.0:1787826408.095077:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6463 00000100:00100000:1.0:1787826408.095090:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789981184:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826408.095121:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.095142:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a61f175/0x68019081f349da77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd16f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.095316:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778708736:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826408.095419:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ee2f00 going to sleep for 11 seconds 00002000:00010000:1.0:1787826408.107431:0:8432:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xd6:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787826408.107447:0:8432:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xd6:0x0] updating lvb mtime: 0 -> 1787826407 00002000:00010000:1.0:1787826408.107450:0:8432:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xd6:0x0] updating lvb atime: 0 -> 1787826407 00002000:00010000:1.0:1787826408.107453:0:8432:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xd6:0x0] updating lvb ctime: 0 -> 1787826407 00002000:00010000:1.0:1787826408.107455:0:8432:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xd6:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1787826408.107487:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778708736:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826408.107550:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a61f175/0x68019081f349da77 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd16f expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.107583:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a61f175/0x68019081f349da77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd16f expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.107601:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9ec00, rc 0) 00000100:00100000:1.0:1787826408.107693:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668789981184:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 12606us (17553us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826408.107704:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6463 00000100:00100000:3.0:1787826408.108058:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.108918:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789981312 00000100:00100000:1.0:1787826408.108930:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789981312 00000100:00100000:1.0:1787826408.109002:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6464 00000100:00100000:1.0:1787826408.109012:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789981312:12345-192.168.203.9@tcp:101:ll_agl.0 00010000:00010000:1.0:1787826408.109033:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.109059:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c08b49/0x68019081f349da7e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd176 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.109108:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070c08b49/0x68019081f349da7e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd176 expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.109128:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c08b49/0x68019081f349da7e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd176 expref: 10 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.109141:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e000, rc 0) 00000100:00100000:1.0:1787826408.109203:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789981312:12345-192.168.203.9@tcp:101:ll_agl.0 Request processed in 192us (1146us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826408.109211:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6464 00000100:00100000:3.0:1787826408.115207:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.116601:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789981568 00000100:00100000:1.0:1787826408.116621:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789981568 00000100:00100000:1.0:1787826408.116708:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3493 00000100:00100000:1.0:1787826408.116720:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+63:2399:x1874668789981568:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826408.116801:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.116829:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349da85 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd184 expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.116925:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.116943:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.116957:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.116974:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.116982:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.116989:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.117040:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.117048:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.117056:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.117067:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f400 already unused, calling callback (ffffffffc181e4f0) 00000100:00100000:0.0:1787826408.117939:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.118008:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789981440 00000100:00100000:2.0:1787826408.118017:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789981440 00000100:00100000:2.0:1787826408.118084:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6465 00000100:00100000:2.0:1787826408.118095:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789981440:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826408.118113:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826408.118134:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349da9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd17d expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.118214:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0d7a1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778708864:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826408.118256:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118269:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118289:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826408.118293:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826408.118299:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118306:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349da8c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.118324:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf1241bf00 going to sleep for 11 seconds 00010000:00010000:1.0:1787826408.118327:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118336:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118343:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118350:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826408.118353:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118360:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118374:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x5236d178 (ffff9bbe1342ff00) 00010000:00010000:1.0:1787826408.118377:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826408.118381:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118387:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349da93 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x5236d178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118431:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349da85 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd184 expref: 64 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.118444:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826408.118446:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826408.118450:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349da85 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd184 expref: 64 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.121472:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f200, rc -2) 00000100:00100000:1.0:1787826408.121961:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+63:2399:x1874668789981568:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 5236us (6762us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826408.121974:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3493 00002000:00010000:2.0:1787826408.138923:0:8433:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0xd7:0x0] updating lvb size: 0 -> 1516 00002000:00010000:2.0:1787826408.138935:0:8433:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0xd7:0x0] updating lvb mtime: 0 -> 1787826407 00002000:00010000:2.0:1787826408.138938:0:8433:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xd7:0x0] updating lvb atime: 0 -> 1787826407 00002000:00010000:2.0:1787826408.138940:0:8433:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0xd7:0x0] updating lvb ctime: 0 -> 1787826407 00002000:00010000:2.0:1787826408.138942:0:8433:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0xd7:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1787826408.138973:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0d7a1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1874668778708864:192.168.203.9@tcp:106: 00010000:00010000:2.0:1787826408.139023:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349da9a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd17d expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.139055:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64e5ab9/0x68019081f349da9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd17d expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.139085:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826408.139185:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668789981440:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 21091us (21253us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826408.139195:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6465 00000100:00100000:3.0:1787826408.151061:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.154952:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789981696 00000100:00100000:1.0:1787826408.154973:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789981696 00000100:00100000:1.0:1787826408.155128:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6466 00000100:00100000:1.0:1787826408.155141:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789981696:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826408.155165:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.155190:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349daa1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd1c3 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.155290:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778708992:192.168.203.9@tcp:106: 00000100:00100000:1.0:1787826408.155418:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ee2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826408.161681:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:45681:1874668778708992:192.168.203.9@tcp:106: 00010000:00010000:1.0:1787826408.161745:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349daa1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1c3 expref: 7 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.161781:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a6a706e/0x68019081f349daa1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1c3 expref: 7 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.161799:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f200, rc 0) 00000100:00100000:1.0:1787826408.161965:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668789981696:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 6825us (10918us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826408.161977:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6466 00000100:00100000:3.0:1787826408.174148:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.174512:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789981952 00000100:00100000:2.0:1787826408.174527:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789981952 00000100:00100000:2.0:1787826408.174620:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111946 00000100:00100000:2.0:1787826408.174631:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+63:87469:x1874668789981952:12345-192.168.203.9@tcp:58:lfs.0 00000040:00080000:2.0:1787826408.175178:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9724, 136 off1314120 00000040:00080000:2.0:1787826408.175772:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9725, 136 off1314256 00000040:00080000:2.0:1787826408.175836:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9726, 136 off1314392 00000040:00080000:2.0:1787826408.175915:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9727, 136 off1314528 00000040:00080000:2.0:1787826408.175951:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9728, 136 off1314664 00000040:00080000:2.0:1787826408.175994:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9729, 136 off1314800 00000040:00080000:2.0:1787826408.176039:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9730, 136 off1314936 00000040:00080000:2.0:1787826408.176356:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9731, 136 off1315072 00000100:00100000:2.0:1787826408.176491:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+63:87469:x1874668789981952:12345-192.168.203.9@tcp:58:lfs.0 Request processed in 1855us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.176504:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111946 00000040:00080000:3.0:1787826408.256107:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826408.256120:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826408.256302:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9727 count 29 00000040:00080000:3.0:1787826408.256315:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787826408.256742:0:58431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe073be580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778709120:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787826408.257023:0:58431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17885000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826408.273190:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.273234:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.273364:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789982080 00000100:00100000:0.0:1787826408.273377:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789982080 00000100:00100000:0.0:1787826408.273455:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789982208 00000100:00100000:0.0:1787826408.273458:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789982208 00000100:00100000:0.0:1787826408.273483:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111947 00000100:00100000:0.0:1787826408.273493:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+84:87484:x1874668789982080:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826408.273549:0:25756:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x149:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826408.273714:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+84:87484:x1874668789982080:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 222us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.273722:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111947 00000100:00100000:0.0:1787826408.273744:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111948 00000100:00100000:0.0:1787826408.273749:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+83:87483:x1874668789982208:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826408.273764:0:25756:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x148:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826408.273805:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+83:87483:x1874668789982208:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 55us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.273813:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111948 00000100:00100000:1.0:1787826408.278947:0:58431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe073be580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778709120:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826408.281588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.282054:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789982336 00000100:00100000:3.0:1787826408.282068:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789982336 00000100:00100000:3.0:1787826408.282150:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111949 00000100:00100000:3.0:1787826408.282162:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:87485:x1874668789982336:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826408.282205:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14a:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826408.282636:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+82:87485:x1874668789982336:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 473us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.282645:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111949 00000100:00100000:3.0:1787826408.291649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.291914:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789982592 00000100:00100000:0.0:1787826408.291927:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789982592 00000100:00100000:0.0:1787826408.292006:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111950 00000100:00100000:0.0:1787826408.292018:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+82:87484:x1874668789982592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.292057:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826408.294368:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349daa8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd1ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.294573:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349daaf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.294591:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349daaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.294606:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349daaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826408.294622:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x149:0x0]: returning size 1516 00010000:00010000:0.0:1787826408.294796:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349daa8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ca expref: 85 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.294821:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349daaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ca expref: 84 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.294832:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:0.0:1787826408.294835:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826408.294840:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826408.294981:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe073be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+84:87484:x1874668789982592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2963us (3347us total) trans 8590016819 rc 0/0 00000100:00100000:0.0:1787826408.294992:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111950 00000100:00100000:0.0:1787826408.300614:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.300753:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789983104 00000100:00100000:1.0:1787826408.300766:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789983104 00000100:00100000:1.0:1787826408.300917:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111951 00000100:00100000:1.0:1787826408.300929:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+84:87483:x1874668789983104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.300964:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.300992:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349dabd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd1d8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.301173:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349dac4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.301198:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349dac4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.301212:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349dac4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826408.301224:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x148:0x0]: returning size 1516 00010000:00010000:1.0:1787826408.301373:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f400/0x68019081f349dabd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1d8 expref: 87 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.301401:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349dac4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1d8 expref: 86 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.301410:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:1.0:1787826408.301413:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826408.301417:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e000, rc 0) 00000100:00100000:1.0:1787826408.301515:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+86:87483:x1874668789983104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 588us (924us total) trans 8590016820 rc 0/0 00000100:00100000:1.0:1787826408.301523:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111951 00000100:00100000:1.0:1787826408.309845:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.309988:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789982848 00000100:00100000:0.0:1787826408.310001:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789982848 00000100:00100000:0.0:1787826408.310072:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111952 00000100:00100000:0.0:1787826408.310084:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+86:87485:x1874668789982848:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.310123:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826408.310149:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dad2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd1d1 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.310299:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349dad9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.310316:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349dad9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.310331:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349dad9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826408.310345:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14a:0x0]: returning size 1516 00010000:00010000:0.0:1787826408.310487:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dad2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1d1 expref: 89 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.310510:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349dad9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1d1 expref: 88 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.310520:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:0.0:1787826408.310524:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826408.310529:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203e00, rc 0) 00000100:00100000:0.0:1787826408.310618:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+88:87485:x1874668789982848:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 536us (787us total) trans 8590016821 rc 0/0 00000100:00100000:0.0:1787826408.310625:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111952 00000100:00100000:3.0:1787826408.311262:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.311655:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789983232 00000100:00100000:1.0:1787826408.311663:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789983232 00000100:00100000:1.0:1787826408.311739:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6467 00000100:00100000:1.0:1787826408.311750:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+22:2400:x1874668789983232:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.311798:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.311820:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 22 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.311830:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xd4:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787826408.311835:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826408.311840:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.311923:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 22 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.311940:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 22 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.311957:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe09ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778709248:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826408.312046:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ee2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826408.314775:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.314825:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.316977:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789983488 00000100:00100000:1.0:1787826408.316994:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789983488 00000100:00100000:2.0:1787826408.319197:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.319480:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789983360 00000100:00100000:1.0:1787826408.319490:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789983360 00000100:00100000:1.0:1787826408.319580:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789983616 00000100:00100000:1.0:1787826408.319583:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789983616 00000100:00100000:1.0:1787826408.319614:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17302 00000100:00100000:1.0:1787826408.319626:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+89:2402:x1874668789983360:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826408.319648:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826408.319690:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349daaf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ca expref: 89 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.319711:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:1.0:1787826408.319716:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826408.319781:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+88:2402:x1874668789983360:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 157us (4955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.319789:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17302 00000100:00100000:1.0:1787826408.319811:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17303 00000100:00100000:1.0:1787826408.319818:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+87:2401:x1874668789983616:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826408.319827:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826408.319840:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349dac4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1d8 expref: 87 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.319891:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:1.0:1787826408.319895:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826408.319915:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+86:2401:x1874668789983616:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 97us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.319922:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17303 00000100:00100000:1.0:1787826408.319991:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6468 00000100:00100000:1.0:1787826408.319999:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789983488:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.320044:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.320073:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.320084:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787826408.320089:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826408.320110:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 4/1,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.320151:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 25 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.320167:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 25 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.320185:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c030b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778709376:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826408.320251:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787826408.322746:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826408.331658:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826408.332755:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.332792:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.332831:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.333042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.333117:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789983872 00000100:00100000:1.0:1787826408.333128:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789983872 00000100:00100000:1.0:1787826408.333204:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17304 00000100:00100000:1.0:1787826408.333216:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+86:2400:x1874668789983872:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826408.333244:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826408.333395:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349dad9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1d1 expref: 86 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.333420:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:1.0:1787826408.333426:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826408.333494:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe099b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+85:2400:x1874668789983872:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 280us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.333504:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17304 00000100:00100000:1.0:1787826408.333547:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789984000 00000100:00100000:1.0:1787826408.333551:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789984000 00000100:00100000:1.0:1787826408.333582:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6469 00000100:00100000:1.0:1787826408.333589:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789984000:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.333635:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.333656:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 26 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.333676:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd4:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787826408.333682:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826408.333687:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.333731:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 26 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.333750:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 26 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.333769:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778709504:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826408.333848:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826408.333922:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c030b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778709376:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826408.333946:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.333987:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe09ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778709248:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826408.334002:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.334957:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789983744 00000100:00100000:1.0:1787826408.334969:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789983744 00002000:00100000:1.0:1787826408.335029:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xd4:0x0] (0->1515) req@ffff9bbe0dc8e580 x1874668789983744/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.335040:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8e580 with x1874668789983744 ext(0->1515) 00010000:00010000:1.0:1787826408.335049:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 23 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.335064:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 23 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826408.335079:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0dc8e580 00000100:00100000:1.0:1787826408.335107:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789984128 00000100:00100000:1.0:1787826408.335111:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789984128 00002000:00100000:1.0:1787826408.335126:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xd3:0x0] (0->1515) req@ffff9bbf05cb9e00 x1874668789984128/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.335133:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf05cb9e00 with x1874668789984128 ext(0->1515) 00010000:00010000:1.0:1787826408.335139:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 27 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.335148:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 27 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826408.335154:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbf05cb9e00 00000100:00100000:1.0:1787826408.335171:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:1.0:1787826408.335180:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789983744:12345-192.168.203.9@tcp:4:cp.0 00000100:00080000:3.0:1787826408.335331:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826408.336438:0:25758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 62 00000100:00100000:1.0:1787826408.336456:0:25758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2401:x1874668789984128:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:3.0:1787826408.341611:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dc8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2401:x1874668789983744:12345-192.168.203.9@tcp:4:cp.0 Request processed in 6414us (8848us total) trans 4294968197 rc 0/0 00000100:00100000:3.0:1787826408.341630:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 61 00002000:00100000:3.0:1787826408.341645:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xd4:0x0] (0->1515) req@ffff9bbe0dc8e580 x1874668789983744/t4294968197(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/448 e 0 to 0 dl 1787826419 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.341656:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0dc8e580 with x1874668789983744 ext(0->1515) 00010000:00010000:3.0:1787826408.341681:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 25 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.341698:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 25 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.341707:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0dc8e580 00000100:00100000:2.0:1787826408.344125:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.347502:0:25758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789984128:12345-192.168.203.9@tcp:4:cp.0 Request processed in 11041us (14659us total) trans 4294968212 rc 0/0 00000100:00100000:3.0:1787826408.347520:0:25758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 62 00002000:00100000:3.0:1787826408.347533:0:25758:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xd3:0x0] (0->1515) req@ffff9bbf05cb9e00 x1874668789984128/t4294968212(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/448 e 0 to 0 dl 1787826419 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.347544:0:25758:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf05cb9e00 with x1874668789984128 ext(0->1515) 00010000:00010000:3.0:1787826408.347555:0:25758:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.347569:0:25758:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.347577:0:25758:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbf05cb9e00 00000100:00100000:1.0:1787826408.354295:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789984256 00000100:00100000:1.0:1787826408.354316:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789984256 00002000:00100000:1.0:1787826408.354476:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xd4:0x0] (0->1515) req@ffff9bbf3fc78780 x1874668789984256/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.354490:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fc78780 with x1874668789984256 ext(0->1515) 00010000:00010000:1.0:1787826408.354502:0:45399:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.354523:0:45399:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826408.354532:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbf3fc78780 00000100:00100000:1.0:1787826408.354580:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:1.0:1787826408.354657:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668789984256:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:1.0:1787826408.356265:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0f7b92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778709504:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826408.356303:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.356881:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.356956:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789984384 00000100:00100000:2.0:1787826408.356994:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.357037:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789984384 00000100:00100000:1.0:1787826408.357446:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789984512 00000100:00100000:1.0:1787826408.357453:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789984512 00010000:00010000:1.0:1787826408.357491:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.357531:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3160 00000100:00100000:1.0:1787826408.357542:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2399:x1874668789984512:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826408.357559:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826408.357580:0:15760:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:1.0:1787826408.357587:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.357601:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.357632:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd5d670f/0x68019081f349d4ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcec1 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.357650:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826408.357655:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826408.357662:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.357686:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.357717:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826408.357788:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2399:x1874668789984512:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 246us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.357798:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3160 00010000:00010000:1.0:1787826408.357832:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.357994:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.358020:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.358030:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.358039:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.358048:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9f400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826408.358053:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.358065:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.358078:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.358087:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000683c14d/0x68019081f349daee lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.358153:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2399:x1874668789983488:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 38154us (43391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.358163:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6468 00000100:00100000:2.0:1787826408.358248:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668789984256:12345-192.168.203.9@tcp:4:cp.0 Request processed in 3657us (14133us total) trans 4294968213 rc 0/0 00000100:00100000:2.0:1787826408.358261:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 63 00002000:00100000:2.0:1787826408.358274:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xd4:0x0] (0->1515) req@ffff9bbf3fc78780 x1874668789984256/t4294968213(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/448 e 0 to 0 dl 1787826419 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826408.358284:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fc78780 with x1874668789984256 ext(0->1515) 00010000:00010000:2.0:1787826408.358294:0:45399:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.358308:0:45399:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826408.358318:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbf3fc78780 00010000:00010000:3.0:1787826408.359707:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 25 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.359770:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3161 00000100:00100000:3.0:1787826408.359788:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2399:x1874668789984384:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826408.359804:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787826408.359820:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xd4:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1787826408.359826:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 25 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.359840:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 25 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.359884:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e05be6bf/0x68019081f349d545 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcef9 expref: 25 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.359901:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826408.359906:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826408.359911:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.359922:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.359966:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826408.360027:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2399:x1874668789984384:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 249us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.360035:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3161 00000100:00100000:3.0:1787826408.360487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.360512:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789984768 00000100:00100000:3.0:1787826408.360518:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789984768 00000100:00100000:3.0:1787826408.360549:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111953 00000100:00100000:3.0:1787826408.360557:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87483:x1874668789984768:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.360628:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87483:x1874668789984768:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 72us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.360635:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111953 00010000:00010000:2.0:1787826408.361227:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.361248:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.361285:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.361295:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.361304:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.361312:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9ec00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826408.361317:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.361327:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.361348:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.361363:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a61f175/0x68019081f349dae7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.361492:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2400:x1874668789983232:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 49740us (50228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.361503:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6467 00000100:00100000:3.0:1787826408.361658:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.361693:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789984896 00000100:00100000:3.0:1787826408.361697:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789984896 00010000:00010000:3.0:1787826408.361720:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.361745:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3162 00000100:00100000:3.0:1787826408.361752:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789984896:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826408.361762:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787826408.361775:0:45686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1787826408.361780:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.361792:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.361809:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2024453/0x68019081f349d5df lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf31 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.361823:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826408.361826:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826408.361832:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.361841:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.361882:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826408.361909:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8df840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789984896:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 158us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.361916:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3162 00010000:00010000:3.0:1787826408.361940:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.361948:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.362196:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.362206:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.362214:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.362221:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fe00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826408.362225:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.362234:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.362245:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.362257:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d383d748/0x68019081f349daf5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.362299:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe12804b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2400:x1874668789984000:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 28711us (29257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.362307:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6469 00000100:00100000:1.0:1787826408.369303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.369349:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.369378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.369426:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789985024 00000100:00100000:3.0:1787826408.369426:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789985280 00000100:00100000:1.0:1787826408.369436:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789985024 00000100:00100000:3.0:1787826408.369440:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789985280 00000100:00100000:1.0:1787826408.369496:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6470 00000100:00100000:3.0:1787826408.369502:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789985536 00000100:00100000:3.0:1787826408.369508:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789985536 00000100:00100000:1.0:1787826408.369514:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2401:x1874668789985024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.369533:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.369559:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd1df expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.369573:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111954 00000100:00100000:3.0:1787826408.369588:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+86:87484:x1874668789985280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00002000:00010000:1.0:1787826408.369591:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd3:0x0] initial LVB size: 1516, mtime: 0x6a9010e6, atime: 0x0, ctime: 0x6a9010e6, blocks: 0x8 00010000:00010000:1.0:1787826408.369613:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=3046s v=(0 0) 00010000:00010000:1.0:1787826408.369618:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826408.369628:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1df expref: 28 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.369647:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1df expref: 28 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.369660:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9ee00, rc 0) 00000100:00100000:3.0:1787826408.369735:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+86:87484:x1874668789985280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 151us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.369745:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111954 00000100:00100000:3.0:1787826408.369767:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111955 00000100:00100000:3.0:1787826408.369776:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87485:x1874668789985536:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826408.374875:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe09ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789985024:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 5334us (5460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.374888:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6470 00000100:00100000:3.0:1787826408.374976:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87485:x1874668789985536:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 5190us (5615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.374990:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111955 00000100:00100000:2.0:1787826408.379018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.379103:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789985664 00000100:00100000:1.0:1787826408.379116:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789985664 00000100:00100000:1.0:1787826408.379183:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6471 00000100:00100000:1.0:1787826408.379193:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789985664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.379209:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.379228:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd1e6 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826408.379259:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd4:0x0] initial LVB size: 1516, mtime: 0x6a9010e6, atime: 0x0, ctime: 0x6a9010e6, blocks: 0x8 00010000:00010000:1.0:1787826408.379280:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=3046s v=(0 0) 00010000:00010000:1.0:1787826408.379285:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826408.379294:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1e6 expref: 24 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.379312:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1e6 expref: 24 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.379325:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9f400, rc 0) 00000100:00100000:1.0:1787826408.379390:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2401:x1874668789985664:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 198us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.379397:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6471 00000100:00100000:1.0:1787826408.380239:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.380345:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.380375:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789986048 00000100:00100000:1.0:1787826408.380381:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789986048 00000100:00100000:1.0:1787826408.380420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111956 00000100:00100000:1.0:1787826408.380428:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe097970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87483:x1874668789986048:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826408.380504:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe097970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87483:x1874668789986048:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 77us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.380512:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111956 00000100:00100000:3.0:1787826408.380599:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789985792 00000100:00100000:3.0:1787826408.380611:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789985792 00000100:00100000:3.0:1787826408.380733:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6472 00000100:00100000:3.0:1787826408.380744:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2400:x1874668789985792:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.381425:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826408.381462:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd1ed expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.381495:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd4:0x0] initial LVB size: 1516, mtime: 0x6a9010e6, atime: 0x0, ctime: 0x6a9010e6, blocks: 0x8 00010000:00010000:3.0:1787826408.381517:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=3046s v=(0 0) 00010000:00010000:3.0:1787826408.381636:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.381651:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ed expref: 29 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.381683:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ed expref: 29 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.381698:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16606c00, rc 0) 00000100:00100000:3.0:1787826408.381763:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2400:x1874668789985792:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1020us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.381771:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6472 00000100:00100000:2.0:1787826408.381884:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.382007:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789986304 00000100:00100000:2.0:1787826408.382013:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789986304 00000100:00100000:2.0:1787826408.382052:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111957 00000100:00100000:2.0:1787826408.382059:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87484:x1874668789986304:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787826408.383219:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87484:x1874668789986304:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 1150us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.383234:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111957 00000100:00100000:0.0:1787826408.397401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.397595:0:45404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789986432 00000100:00100000:1.0:1787826408.397609:0:45404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789986432 00002000:00100000:1.0:1787826408.397688:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xd3:0x0] (0->4095) req@ffff9bbe159c9a40 x1874668789986432/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.397703:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe159c9a40 with x1874668789986432 ext(0->4095) 00002000:00010000:1.0:1787826408.397710:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe159c9a40 00000100:00100000:1.0:1787826408.397756:0:45404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1608 00000100:00100000:1.0:1787826408.397767:0:45404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789986432:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787826408.398497:0:45404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789986432:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 725us (1104us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787826408.398507:0:45404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1608 00002000:00100000:1.0:1787826408.398526:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xd3:0x0] (0->4095) req@ffff9bbe159c9a40 x1874668789986432/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/4536 e 0 to 0 dl 1787826419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.398538:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe159c9a40 with x1874668789986432 ext(0->4095) 00002000:00010000:1.0:1787826408.398552:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe159c9a40 00000100:00100000:0.0:1787826408.399835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.399928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.399953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.399975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.400003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.400038:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789986816 00000100:00100000:0.0:1787826408.400047:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789986816 00000100:00100000:0.0:1787826408.400123:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789986688 00000100:00100000:0.0:1787826408.400127:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789986688 00000100:00100000:0.0:1787826408.400148:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789987072 00000100:00100000:0.0:1787826408.400151:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789987072 00000100:00100000:0.0:1787826408.400176:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5173 00000100:00100000:0.0:1787826408.400187:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789986816:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826408.400264:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668789986816:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.400272:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5173 00000100:00100000:0.0:1787826408.400293:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5174 00000100:00100000:0.0:1787826408.400299:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789986688:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826408.400325:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668789986688:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.400331:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5174 00000100:00100000:0.0:1787826408.400345:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111958 00000100:00100000:0.0:1787826408.400351:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87485:x1874668789987072:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826408.400423:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87485:x1874668789987072:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 72us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.400429:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111958 00000100:00080000:0.0:1787826408.400471:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826408.400824:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789986560 00000100:00100000:1.0:1787826408.400830:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789986560 00000100:00100000:1.0:1787826408.400900:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 813 00000100:00100000:1.0:1787826408.400909:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789986560:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826408.400940:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668789986560:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 33us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.400947:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 813 00000100:00100000:3.0:1787826408.406306:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789987200 00000100:00100000:3.0:1787826408.406326:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789987200 00002000:00100000:3.0:1787826408.406402:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xd4:0x0] (0->4095) req@ffff9bbe0e68d2c0 x1874668789987200/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.406416:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e68d2c0 with x1874668789987200 ext(0->4095) 00002000:00010000:3.0:1787826408.406423:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0e68d2c0 00000100:00100000:3.0:1787826408.406743:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1609 00000100:00100000:3.0:1787826408.406756:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e68d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789987200:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.407017:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e68d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789987200:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 262us (7010us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826408.407027:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1609 00002000:00100000:3.0:1787826408.407036:0:14373:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xd4:0x0] (0->4095) req@ffff9bbe0e68d2c0 x1874668789987200/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/4536 e 0 to 0 dl 1787826419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.407046:0:14373:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0e68d2c0 with x1874668789987200 ext(0->4095) 00002000:00010000:3.0:1787826408.407051:0:14373:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe0e68d2c0 00000100:00100000:1.0:1787826408.412791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.412849:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.413047:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789987456 00000100:00100000:0.0:1787826408.413060:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789987456 00000100:00100000:0.0:1787826408.413137:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111959 00000100:00100000:0.0:1787826408.413148:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+85:87483:x1874668789987456:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.413174:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826408.413201:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349db11 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd1f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.413251:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.413267:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.413281:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.413424:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203e00/0x68019081f349db11 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1f4 expref: 87 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.413447:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1f4 expref: 86 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.413463:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:0.0:1787826408.413466:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826408.413471:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205a00, rc 0) 00000100:00100000:0.0:1787826408.413566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+86:87483:x1874668789987456:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 419us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.413574:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111959 00000100:00100000:3.0:1787826408.414377:0:45401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789987328 00000100:00100000:3.0:1787826408.414388:0:45401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789987328 00002000:00100000:3.0:1787826408.414443:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xd4:0x0] (0->4095) req@ffff9bbe0b9f61c0 x1874668789987328/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.414456:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0b9f61c0 with x1874668789987328 ext(0->4095) 00002000:00010000:3.0:1787826408.414462:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0b9f61c0 00000100:00100000:3.0:1787826408.414495:0:45401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1610 00000100:00100000:3.0:1787826408.414504:0:45401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789987328:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.415301:0:45401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789987328:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 793us (2520us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826408.415312:0:45401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1610 00002000:00100000:3.0:1787826408.415321:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xd4:0x0] (0->4095) req@ffff9bbe0b9f61c0 x1874668789987328/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/4536 e 0 to 0 dl 1787826419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.415330:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0b9f61c0 with x1874668789987328 ext(0->4095) 00002000:00010000:3.0:1787826408.415335:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0b9f61c0 00000100:00100000:0.0:1787826408.415510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.416103:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789987584 00000100:00100000:3.0:1787826408.416113:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789987584 00000100:00100000:3.0:1787826408.416175:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111960 00000100:00100000:3.0:1787826408.416185:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+86:87484:x1874668789987584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.416206:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826408.416234:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349db1f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd1fb expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.416283:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.416300:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.416316:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.416463:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606200/0x68019081f349db1f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1fb expref: 88 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.416484:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1fb expref: 87 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.416493:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:3.0:1787826408.416497:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826408.416501:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe16607e00, rc 0) 00000100:00100000:3.0:1787826408.417313:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+87:87484:x1874668789987584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1124us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.417326:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111960 00000100:00100000:0.0:1787826408.420414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.420507:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789987712 00000100:00100000:1.0:1787826408.420530:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789987712 00000100:00100000:1.0:1787826408.420618:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111961 00000100:00100000:1.0:1787826408.420631:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+87:87483:x1874668789987712:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826408.420683:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x148:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826408.420904:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+87:87483:x1874668789987712:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 273us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.420912:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111961 00000100:00100000:0.0:1787826408.423349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.423402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.423464:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789987840 00000100:00100000:3.0:1787826408.423477:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789987840 00000100:00100000:3.0:1787826408.423558:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789987968 00000100:00100000:3.0:1787826408.423562:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789987968 00000100:00100000:3.0:1787826408.423586:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111962 00000100:00100000:3.0:1787826408.423596:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+88:87484:x1874668789987840:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826408.423637:0:25759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x149:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826408.423804:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+88:87484:x1874668789987840:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 209us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.423813:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111962 00000100:00100000:3.0:1787826408.423834:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111963 00000100:00100000:3.0:1787826408.423841:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+87:87485:x1874668789987968:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.423882:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826408.423910:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349db2d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd202 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.423949:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.423967:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.423981:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.424113:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3c00/0x68019081f349db2d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd202 expref: 89 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.424133:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd202 expref: 88 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.424143:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:3.0:1787826408.424146:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826408.424150:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf094a3e00, rc 0) 00000100:00100000:3.0:1787826408.424175:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+88:87485:x1874668789987968:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 335us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.424182:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111963 00000100:00100000:3.0:1787826408.431574:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.433401:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.433458:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.433507:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789988224 00000100:00100000:3.0:1787826408.433519:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789988224 00000100:00100000:3.0:1787826408.433584:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789988352 00000100:00100000:3.0:1787826408.433587:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789988352 00000100:00100000:3.0:1787826408.433613:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6473 00000100:00100000:3.0:1787826408.433623:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668789988224:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.433696:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.433718:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.433723:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.433730:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.433748:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.433787:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.433795:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.433803:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.433811:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a2c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826408.433816:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.433825:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.433842:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.433873:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034676542/0x68019081f349db3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.434040:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789988096 00000100:00100000:0.0:1787826408.434046:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789988096 00000100:00100000:0.0:1787826408.434100:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111964 00000100:00100000:0.0:1787826408.434108:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+88:87485:x1874668789988096:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826408.434134:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14a:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787826408.434279:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+88:87485:x1874668789988096:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 171us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.434288:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111964 00000100:00100000:3.0:1787826408.434742:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668789988224:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 1117us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.434752:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6473 00000100:00100000:3.0:1787826408.434771:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6474 00000100:00100000:3.0:1787826408.434780:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2400:x1874668789988352:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.434814:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.434827:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.434831:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.434836:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.434847:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.434910:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.434918:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.434926:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.434932:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826408.434935:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.434949:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.434964:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.434972:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070283fea/0x68019081f349db42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.435008:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2400:x1874668789988352:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 230us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.435016:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6474 00000100:00100000:3.0:1787826408.437231:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.437389:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789988480 00000100:00100000:0.0:1787826408.437401:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789988480 00000100:00100000:0.0:1787826408.437466:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6475 00000100:00100000:0.0:1787826408.437476:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2399:x1874668789988480:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.437541:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.437575:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826408.437581:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826408.437589:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.437603:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.437637:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.437646:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.437655:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.437672:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826408.437677:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.437688:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.437705:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.437714:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349db49 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.437807:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0d7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2399:x1874668789988480:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 333us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.437816:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6475 00000100:00100000:0.0:1787826408.439038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.443603:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789988736 00000100:00100000:3.0:1787826408.443619:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789988736 00000100:00100000:2.0:1787826408.444146:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.444188:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.444293:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789988992 00000100:00100000:3.0:1787826408.444297:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789988992 00000100:00100000:3.0:1787826408.444369:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789989248 00000100:00100000:3.0:1787826408.444373:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789989248 00000100:00100000:3.0:1787826408.444396:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111965 00000100:00100000:3.0:1787826408.444407:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf4054e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+90:87485:x1874668789988992:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.444511:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.444955:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd202 expref: 90 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.444971:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.445018:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd202 expref: 90 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.445037:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd202 expref: 90 pid: 25759 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.445066:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe099b4780 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778709632:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826408.445188:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ae1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826408.445223:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111966 00000100:00100000:3.0:1787826408.445233:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+90:87484:x1874668789989248:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.445285:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.445298:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1fb expref: 90 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.445305:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.445325:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1fb expref: 90 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.445333:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1fb expref: 90 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.445343:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe088492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778709760:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826408.445368:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ae1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826408.445961:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111967 00000100:00100000:2.0:1787826408.445972:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+90:87483:x1874668789988736:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787826408.446021:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.446036:0:45682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1f4 expref: 90 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.446049:0:45682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 4/0,1 mode: --/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.446086:0:45682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1f4 expref: 90 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.446096:0:45682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1f4 expref: 90 pid: 6516 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.446107:0:45682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778709888:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826408.446151:0:45682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf1241bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826408.449944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.450033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.450060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.450118:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789989504 00000100:00100000:3.0:1787826408.450130:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789989504 00010000:00010000:3.0:1787826408.450189:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1fb expref: 91 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.450226:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789989376 00000100:00100000:3.0:1787826408.450229:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789989376 00010000:00010000:3.0:1787826408.450243:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd202 expref: 92 pid: 25759 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.450259:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789989632 00000100:00100000:3.0:1787826408.450262:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789989632 00010000:00010000:3.0:1787826408.450273:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1f4 expref: 93 pid: 6516 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.450293:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3163 00000100:00100000:3.0:1787826408.450303:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+93:2402:x1874668789989504:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826408.450321:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826408.450329:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1fb expref: 93 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450348:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1fb expref: 93 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450377:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:3.0:1787826408.450383:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450394:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450404:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450426:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826408.450491:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+93:2402:x1874668789989504:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 188us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.450499:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3163 00000100:00100000:3.0:1787826408.450531:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3164 00000100:00100000:3.0:1787826408.450539:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+92:2399:x1874668789989376:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826408.450547:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826408.450553:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd202 expref: 92 pid: 25759 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450563:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd202 expref: 92 pid: 25759 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450574:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:3.0:1787826408.450580:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450588:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450595:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450607:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826408.450626:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+92:2399:x1874668789989376:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 88us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.450633:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3164 00000100:00100000:3.0:1787826408.450645:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3165 00000100:00100000:3.0:1787826408.450651:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+91:2399:x1874668789989632:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826408.450658:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826408.450663:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1f4 expref: 91 pid: 6516 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450683:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1f4 expref: 91 pid: 6516 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450697:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:3.0:1787826408.450702:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450709:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450715:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.450727:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826408.450744:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+91:2399:x1874668789989632:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 93us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.450751:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3165 00010000:00010000:2.0:1787826408.451233:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3e00/0x68019081f349db34 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd202 expref: 90 pid: 25759 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.451254:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe099b4780 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:25756:1874668778709632:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826408.451280:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451292:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451299:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451555:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451564:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451572:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451578:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826408.451583:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451593:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451607:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:2.0:1787826408.451610:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826408.451614:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451622:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349db50 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.451843:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf4054e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+90:87485:x1874668789988992:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 7435us (7700us total) trans 8590016822 rc 0/0 00000100:00100000:2.0:1787826408.451876:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111965 00010000:00010000:2.0:1787826408.451926:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205a00/0x68019081f349db18 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1f4 expref: 89 pid: 6516 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.451939:0:45682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:45682:1874668778709888:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826408.451952:0:45682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451960:0:45682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.451965:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.452038:0:45682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.452044:0:45682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.452050:0:45682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.452055:0:45682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826408.452058:0:45682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.452064:0:45682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.452073:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:2.0:1787826408.452076:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826408.452080:0:45682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.452086:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349db5e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x148:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.452149:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+89:87483:x1874668789988736:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 6178us (13118us total) trans 8590016823 rc 0/0 00000100:00100000:2.0:1787826408.452156:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111967 00010000:00010000:1.0:1787826408.454051:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607e00/0x68019081f349db26 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1fb expref: 88 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.454081:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe088492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778709760:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826408.454110:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.454121:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.454128:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.454324:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.454333:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.454341:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.454349:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826408.454354:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.454365:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.454388:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:1.0:1787826408.454392:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826408.454397:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.454405:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349db57 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x149:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.454543:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+88:87484:x1874668789989248:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 9310us (10352us total) trans 8590016824 rc 0/0 00000100:00100000:1.0:1787826408.454566:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111966 00000040:00080000:1.0:1787826408.454710:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826408.454716:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826408.454919:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9730 count 29 00000040:00080000:1.0:1787826408.454926:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787826408.455170:0:58431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778710016:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826408.455237:0:58431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826408.462646:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.462696:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.462726:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.462756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.462784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.462821:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789989888 00000100:00100000:3.0:1787826408.462831:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789989888 00000100:00100000:3.0:1787826408.462917:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789990144 00000100:00100000:3.0:1787826408.462921:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789990144 00000100:00100000:3.0:1787826408.462933:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789990656 00000100:00100000:3.0:1787826408.462936:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789990656 00000100:00100000:3.0:1787826408.462951:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2774 00000100:00100000:3.0:1787826408.462961:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+91:87483:x1874668789989888:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.463362:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+92:87483:x1874668789989888:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 400us (731us total) trans 8590016825 rc 0/0 00000100:00100000:3.0:1787826408.463371:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2774 00000100:00100000:3.0:1787826408.463395:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2775 00000100:00100000:3.0:1787826408.463403:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+91:87485:x1874668789990144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.463512:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+92:87485:x1874668789990144:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 109us (814us total) trans 8590016826 rc 0/0 00000100:00100000:3.0:1787826408.463519:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2775 00000100:00100000:3.0:1787826408.463533:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2776 00000100:00100000:3.0:1787826408.463540:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+91:87484:x1874668789990656:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.463643:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+92:87484:x1874668789990656:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 104us (858us total) trans 8590016827 rc 0/0 00000100:00100000:3.0:1787826408.463651:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2776 00000100:00100000:1.0:1787826408.464320:0:58431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778710016:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826408.464620:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789990272 00000100:00100000:1.0:1787826408.464640:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789990272 00000100:00100000:1.0:1787826408.464714:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789990400 00000100:00100000:1.0:1787826408.464719:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789990400 00000100:00100000:1.0:1787826408.464744:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111968 00000100:00100000:1.0:1787826408.464751:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+92:87486:x1874668789990272:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826408.464786:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14b:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826408.464923:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+92:87486:x1874668789990272:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 170us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.464932:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111968 00000100:00100000:1.0:1787826408.464954:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111969 00000100:00100000:1.0:1787826408.464964:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+91:87487:x1874668789990400:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826408.464982:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14c:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826408.465039:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+91:87487:x1874668789990400:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 77us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.465048:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111969 00000100:00100000:2.0:1787826408.471768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.473255:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789990784 00000100:00100000:1.0:1787826408.473270:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789990784 00000100:00100000:1.0:1787826408.473356:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111970 00000100:00100000:1.0:1787826408.473368:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+91:87488:x1874668789990784:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826408.473409:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14d:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826408.473695:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+91:87488:x1874668789990784:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 328us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.473705:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111970 00000100:00100000:2.0:1787826408.481221:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.484247:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789991040 00000100:00100000:1.0:1787826408.484264:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789991040 00000100:00100000:1.0:1787826408.484350:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111971 00000100:00100000:1.0:1787826408.484360:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+91:87486:x1874668789991040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.484393:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.484421:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349db65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd209 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.484976:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349db6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.484997:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349db6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.485012:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349db6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826408.485026:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14b:0x0]: returning size 1516 00010000:00010000:1.0:1787826408.485186:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f200/0x68019081f349db65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd209 expref: 94 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.485204:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349db6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd209 expref: 93 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.485215:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:1.0:1787826408.485218:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826408.485223:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e000, rc 0) 00000100:00100000:1.0:1787826408.485315:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+93:87486:x1874668789991040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 956us (4108us total) trans 8590016828 rc 0/0 00000100:00100000:1.0:1787826408.485323:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111971 00000100:00100000:3.0:1787826408.487958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.488005:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.488269:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789991296 00000100:00100000:1.0:1787826408.488281:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789991296 00000100:00100000:1.0:1787826408.488341:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789991552 00000100:00100000:1.0:1787826408.488344:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789991552 00000100:00100000:1.0:1787826408.488370:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111972 00000100:00100000:1.0:1787826408.488381:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87487:x1874668789991296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.488409:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.488435:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349db7a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd210 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.488832:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349db81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.488870:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349db81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.488886:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349db81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826408.488898:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14c:0x0]: returning size 1516 00010000:00010000:1.0:1787826408.489032:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9fe00/0x68019081f349db7a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd210 expref: 97 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.489054:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349db81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd210 expref: 96 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.489075:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:1.0:1787826408.489079:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826408.489083:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e800, rc 0) 00000100:00100000:1.0:1787826408.489746:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+96:87487:x1874668789991296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1362us (1797us total) trans 8590016829 rc 0/0 00000100:00100000:1.0:1787826408.489757:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111972 00000100:00100000:1.0:1787826408.489790:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111973 00000100:00100000:1.0:1787826408.489802:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+95:87488:x1874668789991552:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.489817:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.489831:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349db8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd217 expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.489927:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349db96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.489939:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349db96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.489949:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349db96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826408.489958:0:45682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14d:0x0]: returning size 1516 00010000:00010000:1.0:1787826408.490036:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349db8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd217 expref: 98 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.490052:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349db96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd217 expref: 97 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.490072:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:1.0:1787826408.490075:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826408.490078:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993de00, rc 0) 00000100:00100000:1.0:1787826408.492265:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87488:x1874668789991552:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2451us (4244us total) trans 8590016830 rc 0/0 00000100:00100000:1.0:1787826408.492280:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111973 00000100:00100000:2.0:1787826408.496710:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.496756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.496793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.496822:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.496887:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789991680 00000100:00100000:2.0:1787826408.496899:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789991680 00000100:00100000:2.0:1787826408.496963:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789991808 00000100:00100000:2.0:1787826408.496967:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789991808 00000100:00100000:2.0:1787826408.496996:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6476 00000100:00100000:2.0:1787826408.497006:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+24:2402:x1874668789991680:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787826408.497075:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.497103:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 24 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.497113:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xd5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787826408.497118:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826408.497124:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.497168:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 24 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.497185:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 24 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.497215:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778710144:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826408.497332:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf1241b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826408.497349:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6477 00000100:00100000:2.0:1787826408.497356:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789991936 00000100:00100000:2.0:1787826408.497361:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789991936 00000100:00100000:0.0:1787826408.497363:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789991808:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.497393:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.497399:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789992064 00000100:00100000:2.0:1787826408.497404:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789992064 00010000:00010000:0.0:1787826408.497412:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 29 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.497422:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826408.497425:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826408.497429:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 4/1,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.497432:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17305 00000100:00100000:2.0:1787826408.497443:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+98:2402:x1874668789991936:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826408.497457:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826408.497486:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349db81 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd210 expref: 98 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.497504:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:2.0:1787826408.497510:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826408.497526:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 29 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.497539:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 29 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.497544:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+97:2402:x1874668789991936:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 100us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.497561:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17305 00000100:00100000:0.0:1787826408.497564:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778710272:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826408.497588:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17306 00000100:00100000:0.0:1787826408.497592:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826408.497598:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+96:2400:x1874668789992064:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826408.497607:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826408.497620:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e000/0x68019081f349db6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd209 expref: 96 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.497632:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:2.0:1787826408.497636:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826408.497658:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+95:2400:x1874668789992064:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 62us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.497675:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17306 00000100:00100000:3.0:1787826408.499612:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.499837:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789992320 00000100:00100000:2.0:1787826408.499848:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789992320 00000100:00100000:2.0:1787826408.499933:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17307 00000100:00100000:2.0:1787826408.499944:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+95:2400:x1874668789992320:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826408.499962:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826408.499992:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349db96 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd217 expref: 95 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.500012:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826408.500017:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826408.500082:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+94:2400:x1874668789992320:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 140us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.500090:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17307 00000100:00100000:3.0:1787826408.501257:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.501914:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1874668778710144:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826408.501951:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.504118:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.504202:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789992576 00000100:00100000:3.0:1787826408.504213:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789992576 00002000:00100000:3.0:1787826408.504282:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xd5:0x0] (0->1515) req@ffff9bbe0884a940 x1874668789992576/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.504297:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0884a940 with x1874668789992576 ext(0->1515) 00010000:00010000:3.0:1787826408.504309:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 30 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.504327:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 30 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.504336:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe0884a940 00000100:00100000:3.0:1787826408.504368:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:3.0:1787826408.504380:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789992576:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:0.0:1787826408.506242:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789992192 00000100:00100000:0.0:1787826408.506257:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789992192 00000100:00100000:0.0:1787826408.506324:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6478 00000100:00100000:0.0:1787826408.506334:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+25:2402:x1874668789992192:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.506385:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.506410:0:45681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 25 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.506420:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xd6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826408.506425:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826408.506431:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.506475:0:45681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 25 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.506490:0:45681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 25 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.506508:0:45681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778710400:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826408.506637:0:45681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826408.506700:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8605:1874668778710272:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826408.506727:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.511644:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2401:x1874668789992576:12345-192.168.203.9@tcp:4:cp.0 Request processed in 7254us (7527us total) trans 4294968214 rc 0/0 00000100:00100000:2.0:1787826408.511662:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 64 00002000:00100000:2.0:1787826408.511690:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xd5:0x0] (0->1515) req@ffff9bbe0884a940 x1874668789992576/t4294968214(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/448 e 0 to 0 dl 1787826419 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826408.511707:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0884a940 with x1874668789992576 ext(0->1515) 00010000:00010000:2.0:1787826408.511721:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.511738:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826408.511746:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbe0884a940 00000100:00100000:3.0:1787826408.517353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.518831:0:45397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789992448 00000100:00100000:1.0:1787826408.518887:0:45397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789992448 00002000:00100000:1.0:1787826408.518965:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xd5:0x0] (0->1515) req@ffff9bbe0884ad00 x1874668789992448/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.518980:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0884ad00 with x1874668789992448 ext(0->1515) 00010000:00010000:1.0:1787826408.518993:0:45397:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 26 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.519026:0:45397:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 26 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826408.519036:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0884ad00 00000100:00100000:1.0:1787826408.519082:0:45397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:1.0:1787826408.519094:0:45397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2401:x1874668789992448:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:3.0:1787826408.520561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.521604:0:45397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789992448:12345-192.168.203.9@tcp:4:cp.0 Request processed in 2504us (4257us total) trans 4294968198 rc 0/0 00000100:00100000:3.0:1787826408.521619:0:45397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 65 00002000:00100000:3.0:1787826408.521636:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xd5:0x0] (0->1515) req@ffff9bbe0884ad00 x1874668789992448/t4294968198(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/448 e 0 to 0 dl 1787826419 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.521647:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0884ad00 with x1874668789992448 ext(0->1515) 00010000:00010000:3.0:1787826408.521661:0:45397:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 28 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.521690:0:45397:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 28 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.521708:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe0884ad00 00000100:00100000:3.0:1787826408.521740:0:45397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789992704 00000100:00100000:3.0:1787826408.521748:0:45397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789992704 00002000:00100000:3.0:1787826408.521789:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xd6:0x0] (0->1515) req@ffff9bbe08848f00 x1874668789992704/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.521798:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe08848f00 with x1874668789992704 ext(0->1515) 00010000:00010000:3.0:1787826408.521805:0:45397:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 28 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.521817:0:45397:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 28 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.521825:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe08848f00 00000100:00100000:3.0:1787826408.521890:0:45397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00100000:3.0:1787826408.521901:0:45397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789992704:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:1.0:1787826408.522877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.523593:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789992832 00000100:00100000:3.0:1787826408.523602:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789992832 00010000:00010000:3.0:1787826408.523644:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.523706:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3166 00000100:00100000:3.0:1787826408.523718:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2400:x1874668789992832:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826408.523734:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787826408.523758:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd5:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1787826408.523765:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.523782:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.523814:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349d752 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd018 expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.523833:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826408.523838:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826408.523846:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.523877:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.523916:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826408.523973:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2400:x1874668789992832:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 258us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.523982:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3166 00000100:00100000:0.0:1787826408.524194:0:45681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:45681:1874668778710400:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826408.524224:0:45681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.524255:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.524266:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.524291:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.524301:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.524310:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.524318:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826408.524323:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.524332:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.524344:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.524352:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bdb8eaa/0x68019081f349dbab lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.524420:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789991808:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 27062us (27663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.524430:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6477 00000100:00100000:1.0:1787826408.527866:0:45397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789992704:12345-192.168.203.9@tcp:4:cp.0 Request processed in 5939us (7286us total) trans 4294968199 rc 0/0 00000100:00100000:1.0:1787826408.527885:0:45397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 66 00002000:00100000:1.0:1787826408.527903:0:45397:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xd6:0x0] (0->1515) req@ffff9bbe08848f00 x1874668789992704/t4294968199(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/448 e 0 to 0 dl 1787826419 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.527915:0:45397:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe08848f00 with x1874668789992704 ext(0->1515) 00010000:00010000:1.0:1787826408.527927:0:45397:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 30 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.527944:0:45397:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 30 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826408.527952:0:45397:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe08848f00 00000100:00100000:3.0:1787826408.527958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.528571:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789992960 00000100:00100000:2.0:1787826408.528584:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789992960 00010000:00010000:2.0:1787826408.528629:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 30 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.528682:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3167 00000100:00100000:2.0:1787826408.529159:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2400:x1874668789992960:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826408.529186:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787826408.529214:0:9521:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xd5:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:2.0:1787826408.529223:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 30 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529240:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 30 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529271:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051ed6063/0x68019081f349d68e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcfa1 expref: 30 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529296:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826408.529302:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826408.529310:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529322:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529358:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826408.529612:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2400:x1874668789992960:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 918us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.529621:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3167 00010000:00010000:2.0:1787826408.529657:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529676:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529710:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529720:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529728:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529737:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826408.529742:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529751:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529763:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.529770:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074e5e250/0x68019081f349dba4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.529825:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2402:x1874668789991680:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 32821us (33134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.529835:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6476 00000100:00100000:3.0:1787826408.542413:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.543758:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789993344 00000100:00100000:0.0:1787826408.543773:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789993344 00000100:00100000:0.0:1787826408.543871:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111974 00000100:00100000:0.0:1787826408.543884:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87486:x1874668789993344:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826408.544153:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87486:x1874668789993344:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 269us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.544162:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111974 00000100:00100000:3.0:1787826408.560061:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.560131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.560155:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789993600 00000100:00100000:1.0:1787826408.560170:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789993600 00000100:00100000:1.0:1787826408.560255:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111975 00000100:00100000:1.0:1787826408.560268:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87487:x1874668789993600:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826408.560416:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87487:x1874668789993600:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 151us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.560425:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111975 00000100:00100000:2.0:1787826408.560561:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789993088 00000100:00100000:2.0:1787826408.560566:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789993088 00010000:00010000:2.0:1787826408.560597:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 28 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.560641:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3168 00000100:00100000:2.0:1787826408.560650:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789993088:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826408.560676:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787826408.560718:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xd6:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:2.0:1787826408.560727:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 28 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.560744:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 28 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.560772:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349d801 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd057 expref: 28 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.560794:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826408.560800:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826408.560807:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.560820:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.560887:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826408.560912:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2401:x1874668789993088:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 264us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.560919:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3168 00010000:00010000:2.0:1787826408.560948:0:45681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.560959:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.560988:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.560998:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.561019:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.561029:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826408.561034:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.561046:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.561060:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.561070:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dbb2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.561184:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2402:x1874668789992192:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 54851us (59933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.561199:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6478 00000100:00100000:1.0:1787826408.567336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.568790:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789993728 00000100:00100000:3.0:1787826408.568805:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789993728 00000100:00100000:3.0:1787826408.568893:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6479 00000100:00100000:3.0:1787826408.568904:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668789993728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.568928:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826408.568954:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd21e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.568988:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd5:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:3.0:1787826408.569012:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=3046s v=(0 0) 00010000:00010000:3.0:1787826408.569018:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.569030:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd21e expref: 27 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.569051:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd21e expref: 27 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.569082:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41795a00, rc 0) 00000100:00100000:3.0:1787826408.569167:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2400:x1874668789993728:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 264us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.569174:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6479 00000100:00100000:3.0:1787826408.571600:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.573100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.578924:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789994112 00000100:00100000:1.0:1787826408.578946:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789994112 00000100:00100000:1.0:1787826408.579033:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111976 00000100:00100000:1.0:1787826408.579045:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87488:x1874668789994112:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.579488:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789993856 00000100:00100000:3.0:1787826408.579494:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789993856 00000100:00100000:3.0:1787826408.579550:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6480 00000100:00100000:3.0:1787826408.579558:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668789993856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.579571:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826408.579598:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd225 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.579632:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd5:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:3.0:1787826408.579654:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=3046s v=(0 0) 00010000:00010000:3.0:1787826408.579659:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.579680:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd225 expref: 31 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.579700:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd225 expref: 31 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.579717:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794c00, rc 0) 00000100:00100000:3.0:1787826408.580051:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789993856:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 491us (6964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.580073:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6480 00000100:00100000:1.0:1787826408.580317:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87488:x1874668789994112:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 1273us (9084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.580327:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111976 00000100:00100000:0.0:1787826408.580463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.581466:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789994368 00000100:00100000:1.0:1787826408.581479:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789994368 00000100:00100000:1.0:1787826408.581789:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111977 00000100:00100000:1.0:1787826408.581803:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87486:x1874668789994368:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826408.581995:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87486:x1874668789994368:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 195us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.582003:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111977 00000100:00100000:2.0:1787826408.590842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.590941:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.591133:0:45404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789994624 00000100:00100000:1.0:1787826408.591146:0:45404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789994624 00002000:00100000:1.0:1787826408.591224:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xd5:0x0] (0->4095) req@ffff9bbf3fc7b480 x1874668789994624/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.591253:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fc7b480 with x1874668789994624 ext(0->4095) 00002000:00010000:1.0:1787826408.591260:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf3fc7b480 00000100:00100000:1.0:1787826408.591298:0:45404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1611 00000100:00100000:1.0:1787826408.591308:0:45404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2399:x1874668789994624:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787826408.591565:0:45404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2399:x1874668789994624:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 257us (623us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787826408.591575:0:45404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1611 00002000:00100000:1.0:1787826408.591581:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xd5:0x0] (0->4095) req@ffff9bbf3fc7b480 x1874668789994624/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/4536 e 0 to 0 dl 1787826419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.591590:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fc7b480 with x1874668789994624 ext(0->4095) 00002000:00010000:1.0:1787826408.591594:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf3fc7b480 00000100:00100000:0.0:1787826408.592708:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789994496 00000100:00100000:0.0:1787826408.592720:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789994496 00000100:00100000:0.0:1787826408.592781:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6481 00000100:00100000:0.0:1787826408.592791:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2399:x1874668789994496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.592808:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826408.592835:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd22c expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826408.592903:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd6:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:0.0:1787826408.592925:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=3046s v=(0 0) 00010000:00010000:0.0:1787826408.592931:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826408.592943:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd22c expref: 28 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.592965:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd22c expref: 28 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.592980:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205a00, rc 0) 00000100:00100000:0.0:1787826408.593033:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2399:x1874668789994496:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 244us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.593041:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6481 00000100:00100000:3.0:1787826408.600968:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.601202:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789994880 00000100:00100000:1.0:1787826408.601214:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789994880 00000100:00100000:1.0:1787826408.601299:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111978 00000100:00100000:1.0:1787826408.601310:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87487:x1874668789994880:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787826408.601446:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+94:87487:x1874668789994880:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 137us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.601455:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111978 00000100:00100000:1.0:1787826408.603775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.603821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.603966:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789995136 00000100:00100000:0.0:1787826408.603978:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789995136 00000100:00100000:0.0:1787826408.604045:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789995264 00000100:00100000:0.0:1787826408.604049:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789995264 00000100:00100000:3.0:1787826408.604057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111979 00000100:00100000:3.0:1787826408.604083:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+95:87488:x1874668789995136:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787826408.604084:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111980 00000100:00100000:0.0:1787826408.604201:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+95:87486:x1874668789995264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.604214:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787826408.604223:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+95:87488:x1874668789995136:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 156us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.604230:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111979 00010000:00010000:0.0:1787826408.604250:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dbce lrc: 2/0,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd233 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.604302:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.604322:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.604338:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.604481:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dbce lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd233 expref: 96 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.604503:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd233 expref: 95 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.604513:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:0.0:1787826408.604517:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826408.604969:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41205000, rc 0) 00000100:00100000:0.0:1787826408.605020:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+95:87486:x1874668789995264:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 928us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.605027:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111980 00000100:00100000:1.0:1787826408.606509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.606629:0:45405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789995392 00000100:00100000:3.0:1787826408.606644:0:45405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789995392 00002000:00100000:3.0:1787826408.606715:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xd5:0x0] (0->4095) req@ffff9bbe0b9f43c0 x1874668789995392/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.606727:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0b9f43c0 with x1874668789995392 ext(0->4095) 00002000:00010000:3.0:1787826408.606734:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0b9f43c0 00000100:00100000:3.0:1787826408.606767:0:45405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1612 00000100:00100000:3.0:1787826408.606778:0:45405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789995392:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.607015:0:45405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789995392:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 240us (518us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826408.607024:0:45405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1612 00002000:00100000:3.0:1787826408.607031:0:45405:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0xd5:0x0] (0->4095) req@ffff9bbe0b9f43c0 x1874668789995392/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/4536 e 0 to 0 dl 1787826419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.607039:0:45405:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0b9f43c0 with x1874668789995392 ext(0->4095) 00002000:00010000:3.0:1787826408.607042:0:45405:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0b9f43c0 00000100:00100000:2.0:1787826408.615109:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.615169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.615201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.615268:0:45401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789995648 00000100:00100000:3.0:1787826408.615283:0:45401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789995648 00002000:00100000:3.0:1787826408.615351:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xd6:0x0] (0->4095) req@ffff9bbf3fc78b40 x1874668789995648/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.615365:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fc78b40 with x1874668789995648 ext(0->4095) 00002000:00010000:3.0:1787826408.615372:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf3fc78b40 00000100:00100000:3.0:1787826408.615410:0:45401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1613 00000100:00100000:3.0:1787826408.615421:0:45401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789995648:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.615632:0:45401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789995648:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 211us (461us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826408.615642:0:45401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1613 00002000:00100000:3.0:1787826408.615649:0:45401:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xd6:0x0] (0->4095) req@ffff9bbf3fc78b40 x1874668789995648/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/4536 e 0 to 0 dl 1787826419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.615658:0:45401:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf3fc78b40 with x1874668789995648 ext(0->4095) 00002000:00010000:3.0:1787826408.615661:0:45401:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbf3fc78b40 00000100:00100000:3.0:1787826408.620183:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.625704:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789995520 00000100:00100000:1.0:1787826408.625735:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789995520 00000100:00100000:0.0:1787826408.625844:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789995776 00000100:00100000:0.0:1787826408.625859:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789995776 00000100:00100000:0.0:1787826408.625927:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789995904 00000100:00100000:0.0:1787826408.625930:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789995904 00000100:00100000:3.0:1787826408.626047:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111981 00000100:00100000:1.0:1787826408.626406:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111982 00000100:00100000:1.0:1787826408.626416:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87488:x1874668789995904:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1787826408.626505:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111983 00000100:00100000:0.0:1787826408.626515:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87486:x1874668789995520:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787826408.626626:0:23845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14b:0x0] from 18446744073709551615 #0 00010000:00010000:1.0:1787826408.626800:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826408.626831:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349dbdc lrc: 2/0,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd241 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.627038:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87487:x1874668789995776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.627052:0:45682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826408.627135:0:45682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dbe3 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd23a expref: -99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.627167:0:45682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.627184:0:45682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.627198:0:45682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.627518:0:45682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dbe3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd23a expref: 100 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.627543:0:45682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd23a expref: 99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.627629:0:45682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:3.0:1787826408.627633:0:45682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826408.627637:0:45682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794800, rc 0) 00010000:00010000:1.0:1787826408.627641:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.628242:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:bb930b33-002c-4632-a90b-528a6bdcd03e+99:87487:x1874668789995776:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2175us (13033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.628252:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111981 00010000:00010000:1.0:1787826408.628744:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.628761:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.628918:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ec00/0x68019081f349dbdc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd241 expref: 99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.628938:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd241 expref: 98 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.628947:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:1.0:1787826408.628949:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826408.628952:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0dd9e800, rc 0) 00000100:00100000:1.0:1787826408.629007:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+98:87488:x1874668789995904:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2593us (8838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.629014:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111982 00000100:00100000:0.0:1787826408.629736:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87486:x1874668789995520:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 3217us (14638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.629747:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111983 00000100:00100000:3.0:1787826408.633537:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.633621:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789996032 00000100:00100000:1.0:1787826408.633634:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789996032 00000100:00100000:1.0:1787826408.633722:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111984 00000100:00100000:1.0:1787826408.633734:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87488:x1874668789996032:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826408.633782:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14d:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826408.633973:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87488:x1874668789996032:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 240us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.633982:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111984 00000100:00100000:1.0:1787826408.635423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.635583:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789996288 00000100:00100000:3.0:1787826408.635593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789996288 00000100:00100000:3.0:1787826408.635647:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111985 00000100:00100000:3.0:1787826408.635657:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87487:x1874668789996288:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826408.635714:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14c:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826408.635878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.637702:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87487:x1874668789996288:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 2035us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.637718:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111985 00000100:00100000:3.0:1787826408.640328:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789996160 00000100:00100000:3.0:1787826408.640349:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789996160 00000100:00100000:3.0:1787826408.640580:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6482 00000100:00100000:3.0:1787826408.640593:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789996160:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.640653:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.640685:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.640690:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.640696:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.640712:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.640745:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.640753:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.640761:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.640769:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826408.640774:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.640776:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:3.0:1787826408.640784:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.640882:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789996416 00000100:00100000:1.0:1787826408.640888:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789996416 00000100:00100000:1.0:1787826408.640921:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6483 00000100:00100000:1.0:1787826408.640928:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789996416:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.640949:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.640961:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826408.640965:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826408.640969:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.640980:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.640996:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.641004:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.641013:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.641020:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0dd9fe00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826408.641023:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.641031:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.641041:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.641049:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d383d748/0x68019081f349dbff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.641149:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789996416:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 220us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.641157:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6483 00010000:00010000:3.0:1787826408.644928:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.644964:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036b1afc1/0x68019081f349dbf8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.645038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.645069:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789996160:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 4478us (9190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.645080:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6482 00000100:00100000:3.0:1787826408.645120:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789996544 00000100:00100000:3.0:1787826408.645129:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789996544 00000100:00100000:3.0:1787826408.645178:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6484 00000100:00100000:3.0:1787826408.645187:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789996544:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.645242:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.645258:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.645263:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826408.645270:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.645286:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.645317:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.645326:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.645335:0:45681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.645343:0:45681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826408.645348:0:45681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.645358:0:45681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.645376:0:45681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.645382:0:45681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4057218/0x68019081f349dc06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.645432:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668789996544:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 245us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.645439:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6484 00000100:00100000:1.0:1787826408.649029:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.649086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.649173:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789996800 00000100:00100000:0.0:1787826408.649185:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789996800 00000100:00100000:0.0:1787826408.649262:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789997056 00000100:00100000:0.0:1787826408.649265:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789997056 00000100:00100000:0.0:1787826408.649288:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111986 00000100:00100000:0.0:1787826408.649299:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+98:87488:x1874668789996800:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.649412:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.649444:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd241 expref: 98 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.649455:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 4/0,1 mode: --/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.649501:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd241 expref: 98 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.649518:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd241 expref: 98 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.649544:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1283f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778710528:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826408.649605:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111987 00000100:00100000:3.0:1787826408.649618:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+98:87486:x1874668789997056:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.649656:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.649673:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272ecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787826408.649677:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd233 expref: 98 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.649684:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.649705:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd233 expref: 98 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.649715:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd233 expref: 98 pid: 45683 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.649725:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778710656:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826408.649764:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ae1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826408.652053:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.654127:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789997312 00000100:00100000:3.0:1787826408.654148:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789997312 00000100:00100000:3.0:1787826408.654229:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111988 00000100:00100000:3.0:1787826408.654240:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+99:87487:x1874668789997312:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.654354:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.654377:0:23845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd23a expref: 99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.654387:0:23845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.654437:0:23845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd23a expref: 99 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.654452:0:23845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd23a expref: 99 pid: 45682 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.654470:0:23845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0810cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778710784:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826408.654604:0:23845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17ae1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826408.658976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.659011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.659045:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1283f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778710528:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826408.659045:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789997568 00000100:00100000:1.0:1787826408.659053:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789997568 00010000:00010000:0.0:1787826408.659078:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.659189:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789997440 00000100:00100000:0.0:1787826408.659194:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789997440 00000100:00100000:3.0:1787826408.659263:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7736:1874668778710656:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826408.659280:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.660799:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd233 expref: 101 pid: 45683 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.660883:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3169 00000100:00100000:2.0:1787826408.661031:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.661057:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789997696 00000100:00100000:2.0:1787826408.661065:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789997696 00000100:00100000:3.0:1787826408.661524:0:23845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0810cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23845:1874668778710784:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826408.661568:0:23845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.668837:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd241 expref: 102 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.668928:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3170 00000100:00100000:0.0:1787826408.668942:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+102:2401:x1874668789997440:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826408.668961:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826408.668970:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd241 expref: 102 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.668986:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd241 expref: 102 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669016:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9e800/0x68019081f349dbf1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd241 expref: 102 pid: 25756 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669037:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:0.0:1787826408.669044:0:45686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669055:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669065:0:45686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669098:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826408.669199:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+101:2401:x1874668789997440:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 241us (10166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.669208:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3170 00010000:00010000:0.0:1787826408.669250:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669259:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669467:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669476:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669483:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669489:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826408.669494:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669502:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669512:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:0.0:1787826408.669516:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826408.669521:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.669527:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc0d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.669846:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+101:87488:x1874668789996800:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 20547us (20829us total) trans 8590016831 rc 0/0 00000100:00100000:0.0:1787826408.669889:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111986 00000100:00100000:1.0:1787826408.673703:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+100:2401:x1874668789997568:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826408.673741:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826408.673755:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd233 expref: 100 pid: 45683 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.673776:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd233 expref: 100 pid: 45683 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.673807:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dbd5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd233 expref: 100 pid: 45683 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.673828:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:1.0:1787826408.673833:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.673845:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.673875:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.673917:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826408.673995:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+99:2401:x1874668789997568:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 13102us (15034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.674011:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3169 00010000:00010000:0.0:1787826408.675717:0:7736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.675739:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.675999:0:7736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.676009:0:7736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.676016:0:7736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.676023:0:7736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826408.676155:0:7736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.676166:0:7736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.676191:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:0.0:1787826408.676194:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826408.676200:0:7736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.676207:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc14 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.676712:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+99:87486:x1874668789997056:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 27092us (27619us total) trans 8590016832 rc 0/0 00000100:00100000:0.0:1787826408.676727:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111987 00010000:00010000:2.0:1787826408.678724:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd23a expref: 98 pid: 45682 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.678790:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3171 00000100:00100000:2.0:1787826408.678804:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+98:2401:x1874668789997696:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826408.678825:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826408.678832:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd23a expref: 98 pid: 45682 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.678847:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd23a expref: 98 pid: 45682 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.678895:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349dbea lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd23a expref: 98 pid: 45682 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.678912:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:2.0:1787826408.678918:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.678930:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.678939:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.678972:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826408.679046:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+97:2401:x1874668789997696:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 246us (18017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.679054:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3171 00010000:00010000:0.0:1787826408.682153:0:23845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.682176:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.682418:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.682427:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.682436:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.682442:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826408.682447:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.682460:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.682483:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:0.0:1787826408.682486:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826408.682491:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.682497:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc1b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.684740:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87487:x1874668789997312:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 30485us (32684us total) trans 8590016833 rc 0/0 00000100:00100000:0.0:1787826408.684757:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111988 00000100:00100000:2.0:1787826408.685872:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.689128:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789997952 00000100:00100000:2.0:1787826408.689151:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789997952 00000100:00100000:2.0:1787826408.689265:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2777 00000100:00100000:2.0:1787826408.689278:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+97:87486:x1874668789997952:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787826408.689689:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+98:87486:x1874668789997952:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 412us (3837us total) trans 8590016834 rc 0/0 00000100:00100000:2.0:1787826408.689702:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2777 00000100:00100000:2.0:1787826408.692996:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.693078:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789998208 00000100:00100000:0.0:1787826408.693091:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789998208 00000100:00100000:0.0:1787826408.693165:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2778 00000100:00100000:0.0:1787826408.693189:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+98:87488:x1874668789998208:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826408.693563:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+99:87488:x1874668789998208:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 387us (580us total) trans 8590016835 rc 0/0 00000100:00100000:0.0:1787826408.693572:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2778 00000040:00080000:1.0:1787826408.694463:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826408.694470:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826408.694700:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9732 count 29 00000040:00080000:1.0:1787826408.694709:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1787826408.695012:0:58431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0b9f7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778710912:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787826408.695111:0:58431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826408.700969:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.701887:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789998464 00000100:00100000:3.0:1787826408.701904:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789998464 00000100:00100000:3.0:1787826408.701976:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2779 00000100:00100000:3.0:1787826408.701988:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+100:87487:x1874668789998464:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.712240:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+101:87487:x1874668789998464:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 10234us (11264us total) trans 8590016836 rc 0/0 00000100:00100000:3.0:1787826408.712259:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2779 00000100:00100000:1.0:1787826408.714926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.714958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.715387:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789998592 00000100:00100000:1.0:1787826408.715398:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789998592 00000100:00100000:1.0:1787826408.715457:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789998720 00000100:00100000:1.0:1787826408.715460:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789998720 00000100:00100000:1.0:1787826408.715486:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111989 00000100:00100000:1.0:1787826408.715497:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87490:x1874668789998592:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826408.715545:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14f:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826408.715707:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87490:x1874668789998592:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 212us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.715715:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111989 00000100:00100000:1.0:1787826408.715739:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111990 00000100:00100000:1.0:1787826408.715745:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+101:87489:x1874668789998720:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787826408.715759:0:12105:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14e:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787826408.715799:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+101:87489:x1874668789998720:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 54us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.715805:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111990 00000100:00100000:0.0:1787826408.716792:0:58431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0b9f7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:58431:1874668778710912:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787826408.724017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.724076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.724216:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789998976 00000100:00100000:3.0:1787826408.724229:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789998976 00000100:00100000:3.0:1787826408.724417:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789999232 00000100:00100000:3.0:1787826408.724421:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789999232 00000100:00100000:3.0:1787826408.724445:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111991 00000100:00100000:3.0:1787826408.724456:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+101:87490:x1874668789998976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.724488:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826408.724515:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd248 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.724679:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349dc29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.724698:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349dc29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.724712:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349dc29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826408.724724:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14f:0x0]: returning size 1516 00010000:00010000:3.0:1787826408.724900:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd248 expref: 104 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.724924:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349dc29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd248 expref: 103 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.724932:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:3.0:1787826408.724936:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826408.724940:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794600, rc 0) 00000100:00100000:3.0:1787826408.725014:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+103:87490:x1874668789998976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 559us (1011us total) trans 8590016837 rc 0/0 00000100:00100000:3.0:1787826408.725038:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111991 00000100:00100000:3.0:1787826408.725063:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111992 00000100:00100000:3.0:1787826408.725072:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87489:x1874668789999232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.725082:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826408.725090:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349dc37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd24f expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.725139:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794400/0x68019081f349dc3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.725149:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794400/0x68019081f349dc3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.725157:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794400/0x68019081f349dc3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826408.725165:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14e:0x0]: returning size 1516 00010000:00010000:3.0:1787826408.725214:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349dc37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd24f expref: 105 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.725229:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794400/0x68019081f349dc3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd24f expref: 104 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.726085:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:3.0:1787826408.726089:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826408.726093:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794400, rc 0) 00000100:00100000:3.0:1787826408.726139:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe088492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+104:87489:x1874668789999232:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1066us (2060us total) trans 8590016838 rc 0/0 00000100:00100000:3.0:1787826408.726147:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111992 00000100:00100000:1.0:1787826408.735087:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.735126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.735155:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.735178:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.735220:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789999360 00000100:00100000:1.0:1787826408.735231:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789999360 00000100:00100000:1.0:1787826408.735299:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789999488 00000100:00100000:1.0:1787826408.735302:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789999488 00000100:00100000:1.0:1787826408.735324:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6485 00000100:00100000:1.0:1787826408.735333:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2400:x1874668789999360:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.735396:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.735422:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 31 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.735433:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826408.735439:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826408.735444:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 4/1,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.735488:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 31 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.735506:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 31 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.735522:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41061680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778711040:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826408.735629:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826408.735654:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6486 00000100:00100000:1.0:1787826408.735673:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2401:x1874668789999488:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.735700:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.735714:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 28 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.735720:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xd7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826408.735723:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826408.735727:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.735747:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 28 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.735756:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 28 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.735766:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41060b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778711168:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826408.735792:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826408.737165:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789999616 00000100:00100000:0.0:1787826408.737181:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789999616 00000100:00100000:0.0:1787826408.737252:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789999744 00000100:00100000:0.0:1787826408.737256:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789999744 00000100:00100000:0.0:1787826408.737296:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17308 00000100:00100000:0.0:1787826408.737307:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf2511f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+105:2399:x1874668789999616:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826408.737325:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826408.737356:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794400/0x68019081f349dc3e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd24f expref: 105 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.737376:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:0.0:1787826408.737382:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826408.737561:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf2511f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+104:2399:x1874668789999616:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 256us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.737571:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17308 00000100:00100000:0.0:1787826408.737629:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17309 00000100:00100000:0.0:1787826408.737637:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41062940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+103:2399:x1874668789999744:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826408.737646:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826408.737659:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349dc29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd248 expref: 103 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.737685:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:0.0:1787826408.737688:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826408.737708:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41062940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+102:2399:x1874668789999744:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 72us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.737714:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17309 00000100:00100000:1.0:1787826408.750077:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.750166:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41060b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874668778711168:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826408.750200:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.750436:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668789999872 00000100:00100000:3.0:1787826408.750445:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668789999872 00002000:00100000:3.0:1787826408.750506:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xd6:0x0] (0->1515) req@ffff9bbf41063840 x1874668789999872/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.750517:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf41063840 with x1874668789999872 ext(0->1515) 00010000:00010000:3.0:1787826408.750526:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.750541:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 32 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.750618:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbf41063840 00000100:00100000:3.0:1787826408.750659:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:3.0:1787826408.750679:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2402:x1874668789999872:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:0.0:1787826408.751946:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41061680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1874668778711040:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826408.751979:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.753734:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+34:2402:x1874668789999872:12345-192.168.203.9@tcp:4:cp.0 Request processed in 3042us (3655us total) trans 4294968215 rc 0/0 00000100:00100000:3.0:1787826408.753751:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 67 00002000:00100000:3.0:1787826408.753769:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xd6:0x0] (0->1515) req@ffff9bbf41063840 x1874668789999872/t4294968215(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/448 e 0 to 0 dl 1787826419 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.753780:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbf41063840 with x1874668789999872 ext(0->1515) 00010000:00010000:3.0:1787826408.753794:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 34 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.753814:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 34 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.753822:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bbf41063840 00000100:00100000:0.0:1787826408.754206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.754696:0:45403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790000000 00000100:00100000:3.0:1787826408.754707:0:45403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790000000 00002000:00100000:3.0:1787826408.754764:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xd7:0x0] (0->1515) req@ffff9bbe1283d2c0 x1874668790000000/t0(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.754775:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283d2c0 with x1874668790000000 ext(0->1515) 00010000:00010000:3.0:1787826408.754784:0:45403:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 29 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.754798:0:45403:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 29 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.754806:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe1283d2c0 00000100:00100000:3.0:1787826408.754847:0:45403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:3.0:1787826408.754996:0:45403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668790000000:12345-192.168.203.9@tcp:4:cp.0 00000100:00100000:3.0:1787826408.756020:0:45403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2402:x1874668790000000:12345-192.168.203.9@tcp:4:cp.0 Request processed in 1024us (1810us total) trans 4294968200 rc 0/0 00000100:00100000:3.0:1787826408.756636:0:45403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 68 00002000:00100000:3.0:1787826408.756652:0:45403:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xd7:0x0] (0->1515) req@ffff9bbe1283d2c0 x1874668790000000/t4294968200(0) o4->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 2008/448 e 0 to 0 dl 1787826419 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.756681:0:45403:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283d2c0 with x1874668790000000 ext(0->1515) 00010000:00010000:3.0:1787826408.756693:0:45403:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 31 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.756707:0:45403:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 31 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826408.756715:0:45403:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bbe1283d2c0 00000100:00100000:0.0:1787826408.768344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.769979:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790000128 00000100:00100000:2.0:1787826408.769997:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790000128 00010000:00010000:2.0:1787826408.770451:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 34 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.770560:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3172 00000100:00100000:2.0:1787826408.770574:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+34:2400:x1874668790000128:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826408.770596:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787826408.770621:0:9521:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd6:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:2.0:1787826408.770628:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 34 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.770644:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 34 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.770687:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349d89b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd08f expref: 34 pid: 45681 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.770710:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826408.770715:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826408.770722:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.770734:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.770780:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826408.770907:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.770918:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.770942:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.770951:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.770959:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.770967:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826408.770972:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.770982:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.770995:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.771002:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bb59078/0x68019081f349dc4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826408.771580:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2400:x1874668790000128:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1005us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.771591:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3172 00000100:00100000:3.0:1787826408.774001:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2400:x1874668789999360:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 38649us (38906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.774031:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6485 00000100:00100000:0.0:1787826408.781989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.782040:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790000256 00000100:00100000:0.0:1787826408.782052:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790000256 00010000:00010000:0.0:1787826408.782184:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 31 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.782233:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3173 00000100:00100000:0.0:1787826408.782245:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668790000256:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826408.782265:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787826408.782289:0:45686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xd7:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:0.0:1787826408.782297:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 31 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.782314:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 31 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.782345:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fa79f2f/0x68019081f349d935 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0c7 expref: 31 pid: 8605 timeout: 3146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.782364:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826408.782368:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826408.782375:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.782392:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.782502:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826408.782564:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668790000256:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 320us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.782573:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3173 00010000:00010000:1.0:1787826408.791802:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.791830:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.791886:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.791896:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.791905:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.791912:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826408.791917:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.791925:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.791953:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.791967:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc53 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.792933:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668789999488:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 56575us (57109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.792948:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6486 00000100:00100000:1.0:1787826408.794040:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.804497:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790000512 00000100:00100000:3.0:1787826408.804515:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790000512 00000100:00100000:3.0:1787826408.804837:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111993 00000100:00100000:3.0:1787826408.804872:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87489:x1874668790000512:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.805046:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87489:x1874668790000512:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 198us (11023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.805054:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111993 00000100:00100000:1.0:1787826408.805232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.806400:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790000768 00000100:00100000:3.0:1787826408.806414:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790000768 00000100:00100000:3.0:1787826408.806480:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111994 00000100:00100000:3.0:1787826408.806491:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87490:x1874668790000768:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.807931:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87490:x1874668790000768:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 1431us (2688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.807945:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111994 00000100:00100000:1.0:1787826408.822694:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.824004:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790000896 00000100:00100000:0.0:1787826408.824018:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790000896 00000100:00100000:0.0:1787826408.824100:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6487 00000100:00100000:0.0:1787826408.824110:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2401:x1874668790000896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.824133:0:19335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826408.824160:0:19335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd256 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826408.824193:0:19335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd7:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:0.0:1787826408.824217:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=3046s v=(0 0) 00010000:00010000:0.0:1787826408.824223:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826408.824235:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd256 expref: 30 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.824256:0:19335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd256 expref: 30 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.824271:0:19335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41204800, rc 0) 00000100:00100000:0.0:1787826408.824352:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668790000896:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 242us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.824360:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6487 00000100:00100000:0.0:1787826408.834152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.834200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.835527:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790001152 00000100:00100000:3.0:1787826408.835553:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790001152 00000100:00100000:3.0:1787826408.835651:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111995 00000100:00100000:3.0:1787826408.835673:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87490:x1874668790001152:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.835823:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87490:x1874668790001152:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 163us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.835831:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111995 00000100:00100000:2.0:1787826408.839279:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790001280 00000100:00100000:2.0:1787826408.839298:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790001280 00000100:00100000:2.0:1787826408.839374:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6488 00000100:00100000:2.0:1787826408.839386:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2400:x1874668790001280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787826408.839410:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826408.839436:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd25d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826408.839470:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd6:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:2.0:1787826408.839495:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=3046s v=(0 0) 00010000:00010000:2.0:1787826408.839501:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826408.839512:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd25d expref: 33 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.839531:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd25d expref: 33 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826408.839547:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:2.0:1787826408.839637:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2400:x1874668790001280:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 252us (5435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.839645:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6488 00000100:00100000:0.0:1787826408.845807:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.846076:0:45399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790001408 00000100:00100000:3.0:1787826408.846090:0:45399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790001408 00002000:00100000:3.0:1787826408.846162:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xd7:0x0] (0->4095) req@ffff9bbe1283cb40 x1874668790001408/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.846176:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283cb40 with x1874668790001408 ext(0->4095) 00002000:00010000:3.0:1787826408.846184:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1283cb40 00000100:00100000:3.0:1787826408.846226:0:45399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1614 00000100:00100000:3.0:1787826408.846240:0:45399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668790001408:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.846450:0:45399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668790001408:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 213us (656us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826408.846458:0:45399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1614 00002000:00100000:3.0:1787826408.846465:0:45399:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xd7:0x0] (0->4095) req@ffff9bbe1283cb40 x1874668790001408/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/4536 e 0 to 0 dl 1787826419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826408.846472:0:45399:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe1283cb40 with x1874668790001408 ext(0->4095) 00002000:00010000:3.0:1787826408.846475:0:45399:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bbe1283cb40 00000100:00100000:0.0:1787826408.846636:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.846787:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790001664 00000100:00100000:3.0:1787826408.846792:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790001664 00000100:00100000:3.0:1787826408.846835:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111996 00000100:00100000:3.0:1787826408.846843:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87489:x1874668790001664:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787826408.846950:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87489:x1874668790001664:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 108us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.846956:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111996 00000100:00100000:0.0:1787826408.861488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.861538:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.861632:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790001792 00000100:00100000:3.0:1787826408.861646:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790001792 00000100:00100000:1.0:1787826408.861648:0:45404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790001920 00000100:00100000:1.0:1787826408.861652:0:45404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790001920 00002000:00100000:1.0:1787826408.861720:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xd6:0x0] (0->4095) req@ffff9bbe0b9f52c0 x1874668790001920/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/0 e 0 to 0 dl 1787826419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826408.861724:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111997 00002000:00100000:1.0:1787826408.861733:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0b9f52c0 with x1874668790001920 ext(0->4095) 00000100:00100000:3.0:1787826408.861734:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+102:87490:x1874668790001792:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00002000:00010000:1.0:1787826408.861740:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0b9f52c0 00010000:00010000:3.0:1787826408.861753:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787826408.861760:0:45404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1615 00000100:00100000:1.0:1787826408.861766:0:45404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668790001920:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.861778:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349dc68 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.861821:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.861843:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.861877:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.861987:0:45404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668790001920:12345-192.168.203.9@tcp:3:lhsmtool_posix.0 Request processed in 220us (447us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787826408.861995:0:45404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1615 00010000:00010000:3.0:1787826408.862000:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795400/0x68019081f349dc68 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd264 expref: 104 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1787826408.862003:0:45404:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xd6:0x0] (0->4095) req@ffff9bbe0b9f52c0 x1874668790001920/t0(0) o3->bb930b33-002c-4632-a90b-528a6bdcd03e@192.168.203.9@tcp:9/0 lens 488/4536 e 0 to 0 dl 1787826419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826408.862010:0:45404:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9bbe0b9f52c0 with x1874668790001920 ext(0->4095) 00002000:00010000:1.0:1787826408.862014:0:45404:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bbe0b9f52c0 00010000:00010000:3.0:1787826408.862018:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd264 expref: 103 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.862028:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:3.0:1787826408.862031:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826408.862035:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41795c00, rc 0) 00000100:00100000:3.0:1787826408.862060:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+103:87490:x1874668790001792:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 328us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.862066:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111997 00000100:00100000:0.0:1787826408.878632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.878731:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.880567:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790002048 00000100:00100000:3.0:1787826408.880583:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790002048 00000100:00100000:3.0:1787826408.880672:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790002176 00000100:00100000:3.0:1787826408.880676:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790002176 00000100:00100000:3.0:1787826408.880752:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111998 00000100:00100000:3.0:1787826408.880764:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+104:87490:x1874668790002048:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826408.880808:0:7736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14f:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826408.880995:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+104:87490:x1874668790002048:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 232us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.881004:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111998 00000100:00100000:3.0:1787826408.881027:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111999 00000100:00100000:3.0:1787826408.881035:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+103:87489:x1874668790002176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787826408.881047:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826408.881073:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc76 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd26b expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.881110:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.881134:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.881147:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.881273:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795e00/0x68019081f349dc76 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd26b expref: 105 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.881296:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd26b expref: 104 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826408.881305:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:3.0:1787826408.881308:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826408.881312:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794000, rc 0) 00000100:00100000:3.0:1787826408.881337:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+104:87489:x1874668790002176:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 304us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.881344:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111999 00000100:00100000:2.0:1787826408.889517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.889735:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790002304 00000100:00100000:3.0:1787826408.889749:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790002304 00000100:00100000:3.0:1787826408.889834:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112000 00000100:00100000:3.0:1787826408.889886:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+104:87489:x1874668790002304:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787826408.889935:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000403:0x14e:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787826408.890104:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+104:87489:x1874668790002304:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 249us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.890112:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112000 00000100:00100000:0.0:1787826408.898097:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.898131:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.898897:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790002432 00000100:00100000:1.0:1787826408.898910:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790002432 00000100:00100000:1.0:1787826408.898970:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790002560 00000100:00100000:1.0:1787826408.898974:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790002560 00000100:00100000:1.0:1787826408.899005:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6489 00000100:00100000:1.0:1787826408.899016:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668790002432:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.899074:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899096:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826408.899101:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826408.899108:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899126:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899161:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899169:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899177:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899190:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826408.899195:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899205:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899223:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899231:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dc84 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.899322:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668790002432:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 307us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.899331:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6489 00000100:00100000:1.0:1787826408.899353:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6490 00000100:00100000:1.0:1787826408.899360:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668790002560:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787826408.899382:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899391:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826408.899394:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826408.899398:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899410:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899426:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899433:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899440:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899447:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826408.899451:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899459:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899469:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.899477:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aeb2325/0x68019081f349dc8b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.899515:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2402:x1874668790002560:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 155us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.899522:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6490 00000100:00100000:3.0:1787826408.911087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.911167:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790002816 00000100:00100000:0.0:1787826408.911180:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790002816 00000100:00100000:0.0:1787826408.911334:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112001 00000100:00100000:0.0:1787826408.911346:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+104:87489:x1874668790002816:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.911456:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.911479:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd26b expref: 104 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.911489:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.911530:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd26b expref: 104 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.911552:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd26b expref: 104 pid: 7736 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.911571:0:25759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe170843c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778711296:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826408.912407:0:25759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826408.914066:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.914154:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790003072 00000100:00100000:0.0:1787826408.914166:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790003072 00000100:00100000:0.0:1787826408.914310:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112002 00000100:00100000:0.0:1787826408.914323:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+105:87490:x1874668790003072:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787826408.914425:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.914448:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd264 expref: 105 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.914457:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.914502:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd264 expref: 105 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.914516:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd264 expref: 105 pid: 6517 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.914533:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17084780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778711424:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826408.914822:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15bab600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826408.915905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826408.915980:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790003200 00000100:00100000:1.0:1787826408.915989:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790003200 00000100:00100000:0.0:1787826408.916012:0:25759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe170843c0 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:25759:1874668778711296:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826408.916041:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.916655:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd26b expref: 106 pid: 7736 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.916742:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3174 00000100:00100000:1.0:1787826408.916760:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+106:2400:x1874668790003200:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826408.916783:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826408.916793:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd26b expref: 106 pid: 7736 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.916808:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd26b expref: 106 pid: 7736 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.916842:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dc7d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd26b expref: 106 pid: 7736 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.917285:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:1.0:1787826408.917294:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.917305:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.917318:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.917348:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826408.917414:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+105:2400:x1874668790003200:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 661us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.917422:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3174 00010000:00010000:1.0:1787826408.917455:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.917462:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.918704:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.918719:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.918727:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.918733:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826408.918738:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.918746:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.918763:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:1.0:1787826408.918767:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826408.918772:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826408.918778:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205000/0x68019081f349dc92 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826408.918930:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+105:87489:x1874668790002816:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 7583us (7854us total) trans 8590016839 rc 0/0 00000100:00100000:1.0:1787826408.918942:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112001 00000100:00100000:1.0:1787826408.919882:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17084780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1874668778711424:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826408.919914:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826408.926477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826408.926528:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826408.927303:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790003584 00000100:00100000:2.0:1787826408.927318:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790003584 00000100:00100000:2.0:1787826408.927409:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2780 00000100:00100000:2.0:1787826408.927421:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+105:87489:x1874668790003584:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826408.927923:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790003328 00000100:00100000:0.0:1787826408.927928:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790003328 00010000:00010000:0.0:1787826408.927960:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd264 expref: 106 pid: 6517 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.927996:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3175 00000100:00100000:0.0:1787826408.928004:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+106:2401:x1874668790003328:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826408.928018:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826408.928026:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd264 expref: 106 pid: 6517 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.928042:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd264 expref: 106 pid: 6517 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.928141:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dc6f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd264 expref: 106 pid: 6517 timeout: 3147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.928158:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:0.0:1787826408.928164:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.928177:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.928188:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.928218:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826408.928293:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+105:2401:x1874668790003328:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 290us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.928302:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3175 00000100:00100000:2.0:1787826408.928525:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+105:87489:x1874668790003584:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1105us (1995us total) trans 8590016840 rc 0/0 00000100:00100000:2.0:1787826408.928539:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2780 00010000:00010000:0.0:1787826408.929931:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.929948:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.930380:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.930390:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.930397:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.930404:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41204400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826408.930408:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.930417:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.930436:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:0.0:1787826408.930439:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826408.930445:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826408.930457:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204400/0x68019081f349dc99 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826408.931278:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+105:87490:x1874668790003072:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 16949us (17222us total) trans 8590016841 rc 0/0 00000100:00100000:0.0:1787826408.931290:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112002 00000040:00080000:0.0:1787826408.931430:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826408.931435:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826408.932975:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 64768 count 29 00000040:00080000:0.0:1787826408.932997:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1787826408.933368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826408.933403:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790003840 00000100:00100000:0.0:1787826408.933413:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790003840 00000100:00100000:0.0:1787826408.933467:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2781 00000100:00100000:0.0:1787826408.933477:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+105:87490:x1874668790003840:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787826408.933836:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+106:87490:x1874668790003840:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 359us (472us total) trans 8590016842 rc 0/0 00000100:00100000:0.0:1787826408.933845:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2781 00000100:00100000:1.0:1787826409.280287:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778711680:0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.280386:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826409.280453:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778712192:0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.280482:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826409.280504:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778712704:0@lo:400:kworker.0 00000100:00100000:3.0:1787826409.280516:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778712192 00000100:00100000:3.0:1787826409.280527:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778712192 00000100:00100000:1.0:1787826409.280528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826409.280561:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787826409.280567:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778711808:0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.280593:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826409.280596:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3583 00000100:00100000:3.0:1787826409.280608:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778712192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.280616:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778712320:0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.280653:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826409.280678:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778712192:12345-0@lo:400:kworker.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826409.280682:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778712832:0@lo:400:kworker.0 00000100:00100000:3.0:1787826409.280687:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3583 00000100:00100000:1.0:1787826409.280703:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826409.280720:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778712832 00000100:00100000:3.0:1787826409.280723:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778712832 00000100:00100000:1.0:1787826409.280744:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778712192:0@lo:400:kworker.0 00000100:00100000:3.0:1787826409.280748:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3584 00000100:00100000:3.0:1787826409.280754:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778712832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.280780:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778711680 00000100:00100000:1.0:1787826409.280784:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778711680 00000100:00100000:3.0:1787826409.280789:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778712832:12345-0@lo:400:kworker.0 Request processed in 36us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826409.280796:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3584 00000100:00100000:1.0:1787826409.280817:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778712704 00000100:00100000:1.0:1787826409.280820:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778712704 00000100:00100000:2.0:1787826409.280913:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf410621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778711552:0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.280956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826409.280985:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1874668778712064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826409.280999:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778711936:0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826409.281028:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778712576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826409.281029:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826409.281050:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778712448:0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826409.281066:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778713088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826409.281070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826409.281087:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778712960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826409.281108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826409.281116:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778711552 00000100:00100000:2.0:1787826409.281120:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778711552 00000100:00080000:0.0:1787826409.281135:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826409.281150:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778712576 00000100:00100000:2.0:1787826409.281151:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1787826409.281153:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778712576 00000100:00100000:2.0:1787826409.281158:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778711552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826409.281181:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778712960 00000100:00100000:0.0:1787826409.281184:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778712960 00000100:00100000:2.0:1787826409.281193:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3646:x1874668778711552:12345-0@lo:400:kworker.0 Request processed in 36us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.281199:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1787826409.281205:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585 00000100:00100000:0.0:1787826409.281211:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778712576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281230:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778711808 00000100:00100000:2.0:1787826409.281234:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778711808 00000100:00100000:0.0:1787826409.281242:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778712576:12345-0@lo:400:kworker.0 Request processed in 32us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826409.281248:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585 00000100:00100000:2.0:1787826409.281261:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778712320 00000100:00100000:0.0:1787826409.281262:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3586 00000100:00100000:2.0:1787826409.281263:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778712320 00000100:00100000:0.0:1787826409.281267:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17086580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778712960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281282:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778712064 00000100:00100000:2.0:1787826409.281285:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778712064 00000100:00100000:0.0:1787826409.281295:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17086580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778712960:12345-0@lo:400:kworker.0 Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826409.281301:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3586 00000100:00100000:2.0:1787826409.281304:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778711936 00000100:00100000:2.0:1787826409.281307:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778711936 00000100:00080000:0.0:1787826409.281315:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826409.281318:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826409.281320:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826409.281325:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778712448 00000100:00100000:2.0:1787826409.281327:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778712448 00000100:00100000:0.0:1787826409.281342:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778712960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281345:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778713088 00000100:00100000:2.0:1787826409.281347:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778713088 00000100:00100000:2.0:1787826409.281358:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5175 00000100:00100000:2.0:1787826409.281364:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778711808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281398:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874668778711808:12345-0@lo:400:kworker.0 Request processed in 34us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.281404:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5175 00000100:00100000:2.0:1787826409.281416:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5176 00000100:00100000:2.0:1787826409.281422:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778712320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281448:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778712320:12345-0@lo:400:kworker.0 Request processed in 27us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.281454:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5176 00000100:00100000:2.0:1787826409.281466:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5177 00000100:00100000:2.0:1787826409.281473:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874668778712064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.281491:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3494 00000100:00100000:1.0:1787826409.281500:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778711680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281501:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874668778712064:12345-0@lo:400:kworker.0 Request processed in 30us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.281507:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5177 00000100:00100000:2.0:1787826409.281517:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5178 00000100:00100000:2.0:1787826409.281523:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778711936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.281537:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778711680:12345-0@lo:400:kworker.0 Request processed in 39us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826409.281544:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3494 00000100:00100000:2.0:1787826409.281547:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778711936:12345-0@lo:400:kworker.0 Request processed in 24us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.281552:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5178 00000100:00100000:1.0:1787826409.281558:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3495 00000100:00100000:2.0:1787826409.281560:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5179 00000100:00100000:1.0:1787826409.281564:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778712704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281565:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778712448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.281590:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778712704:12345-0@lo:400:kworker.0 Request processed in 27us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.281590:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778712448:12345-0@lo:400:kworker.0 Request processed in 25us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826409.281597:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3495 00000100:00100000:2.0:1787826409.281597:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5179 00000100:00100000:2.0:1787826409.281607:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5180 00000100:00100000:2.0:1787826409.281613:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778713088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281641:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778713088:12345-0@lo:400:kworker.0 Request processed in 28us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.281647:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5180 00000100:00100000:2.0:1787826409.281696:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf410621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c687310c-1e82-4391-b632-324cfd2cb9dd:3646:1874668778711552:0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281707:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1874668778712064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826409.281715:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778711936:0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281717:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778712576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826409.281724:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778712448:0@lo:400:kworker.0 00000100:00100000:2.0:1787826409.281725:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778713088:0@lo:400:kworker.0 00000100:00080000:2.0:1787826409.281756:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826409.281815:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874668778711808:0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.281828:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778712320:0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.285267:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778712832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.285292:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778711680:0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.285308:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778712704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826409.285361:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a562940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778713216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826409.285442:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826409.286182:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778713216 00000100:00100000:2.0:1787826409.286386:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778713216 00000100:00100000:2.0:1787826409.286485:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00100000:2.0:1787826409.286502:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778713216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826409.286533:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570248640 pending 114688 free 3828547584 avail 3597025280 00000100:00100000:2.0:1787826409.286731:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778713216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 237us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.286740:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1787826409.291573:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a562940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778713216:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1787826409.328396:0:59358:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826409.328406:0:59358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826409.328732:0:59358:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9732 count 29 00000040:00080000:0.0:1787826409.328741:0:59358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:0.0:1787826409.329214:0:59358:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826409.329219:0:59358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826409.329533:0:59358:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9732 count 29 00000040:00080000:0.0:1787826409.329539:0:59358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:3.0:1787826409.344288:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826409.792279:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778713344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826409.792348:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826409.792488:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778713344 00000100:00100000:1.0:1787826409.792496:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778713344 00000100:00100000:1.0:1787826409.792547:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:1.0:1787826409.792556:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778713344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826409.792577:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671100352 pending 114688 free 3894722560 avail 3663200256 00000100:00100000:1.0:1787826409.792626:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778713344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826409.792633:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:0.0:1787826409.792730:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778713344:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826410.370103:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826410.419142:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.419291:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790004096 00000100:00100000:2.0:1787826410.419301:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790004096 00000100:00100000:2.0:1787826410.419368:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112003 00000100:00100000:2.0:1787826410.419383:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+63:87230:x1874668790004096:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1787826410.419405:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826410.419426:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349dca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd272 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826410.419537:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x4d:0x0]: returning size 4096 00010000:00010000:2.0:1787826410.419669:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349dca0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd272 expref: 65 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.419683:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:2.0:1787826410.419686:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826410.419692:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349dca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd272 expref: 65 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.419705:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:2.0:1787826410.419761:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+64:87230:x1874668790004096:12345-192.168.203.9@tcp:101:bash.0 Request processed in 385us (630us total) trans 8590016843 rc 301/301 00000100:00080000:3.0:1787826410.420769:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826410.428161:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112003 00000100:00100000:0.0:1787826410.428320:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.428543:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790004352 00000100:00100000:2.0:1787826410.428551:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790004352 00000100:00100000:2.0:1787826410.428635:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2782 00000100:00100000:2.0:1787826410.428644:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+64:87230:x1874668790004352:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:2.0:1787826410.428916:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+65:87230:x1874668790004352:12345-192.168.203.9@tcp:35:bash.0 Request processed in 272us (595us total) trans 8590016844 rc 0/0 00000100:00100000:2.0:1787826410.428923:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2782 00000100:00100000:1.0:1787826410.445589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.445680:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790004480 00000100:00100000:3.0:1787826410.445690:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790004480 00000100:00100000:3.0:1787826410.445767:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6491 00000100:00100000:3.0:1787826410.445779:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668790004480:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826410.445797:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826410.445816:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd279 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.445843:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787826410.445847:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.445888:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd279 expref: 7 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.445907:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd279 expref: 7 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.445921:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41795e00, rc 0) 00000100:00100000:3.0:1787826410.445973:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+7:2399:x1874668790004480:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 197us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.445980:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6491 00000100:00080000:2.0:1787826410.446123:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826410.461096:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.461147:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.461182:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.461204:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.461224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.461242:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.461260:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.461286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.461315:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790004608 00000100:00100000:3.0:1787826410.461323:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790004608 00000100:00100000:1.0:1787826410.461373:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790004864 00000100:00100000:1.0:1787826410.461379:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790004864 00000100:00100000:3.0:1787826410.461383:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790004992 00000100:00100000:3.0:1787826410.461388:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790004992 00000100:00100000:1.0:1787826410.461411:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790005120 00000100:00100000:3.0:1787826410.461413:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790005248 00000100:00100000:1.0:1787826410.461416:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790005120 00000100:00100000:3.0:1787826410.461419:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790005248 00000100:00100000:1.0:1787826410.461437:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790005376 00000100:00100000:3.0:1787826410.461442:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790005504 00000100:00100000:1.0:1787826410.461443:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790005376 00000100:00100000:3.0:1787826410.461448:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790005504 00000100:00100000:1.0:1787826410.461471:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6492 00000100:00100000:1.0:1787826410.461482:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+12:2399:x1874668790004608:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826410.461497:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826410.461515:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd280 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.461550:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787826410.461556:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.461566:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd280 expref: 13 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.461570:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790004736 00000100:00100000:2.0:1787826410.461576:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790004736 00010000:00010000:1.0:1787826410.461589:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd280 expref: 13 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.461605:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:2.0:1787826410.461615:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3496 00000100:00100000:2.0:1787826410.461625:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+65:2401:x1874668790004736:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:2.0:1787826410.461663:0:45678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787826410.461672:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+13:2399:x1874668790004608:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 191us (523us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826410.461679:0:45678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349dcbc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd287 expref: -99 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461737:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461750:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461761:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461775:0:45678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461783:0:45678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461789:0:45678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461827:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461840:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461882:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461888:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.461892:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461899:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461915:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826410.461918:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826410.461922:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461929:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dcc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461941:0:45678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461947:0:45678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461952:0:45678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461956:0:45678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.461959:0:45678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461968:0:45678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461975:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x9f9da1de (ffff9bbe16cc5000) 00010000:00010000:2.0:1787826410.461978:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826410.461981:0:45678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.461987:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dcca lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x9f9da1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.462015:0:45678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349dcbc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd287 expref: 66 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.462025:0:45678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826410.462028:0:45678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826410.462031:0:45678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349dcbc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd287 expref: 66 pid: 45678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.462040:0:45678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc -2) 00000100:00100000:2.0:1787826410.462077:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+65:2401:x1874668790004736:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 454us (1032us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826410.462086:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3496 00000100:00080000:2.0:1787826410.462122:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826410.462936:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6493 00000100:00100000:3.0:1787826410.462951:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668790004864:12345-192.168.203.9@tcp:101:ll_sa.0 00010000:00010000:3.0:1787826410.462963:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826410.462977:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd295 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.462997:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787826410.463001:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.463009:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd295 expref: 10 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.463022:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd295 expref: 10 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.463034:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41795400, rc 0) 00000100:00100000:3.0:1787826410.463072:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+10:2402:x1874668790004864:12345-192.168.203.9@tcp:101:ll_sa.0 Request processed in 126us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.463080:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6493 00000100:00100000:3.0:1787826410.463101:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6494 00000100:00100000:3.0:1787826410.463109:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+13:2401:x1874668790004992:12345-192.168.203.9@tcp:101:ll_sa.0 00010000:00010000:3.0:1787826410.463118:0:25038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826410.463126:0:25038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd29c expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.463144:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787826410.463147:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.463153:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd29c expref: 14 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.463164:0:25038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd29c expref: 14 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.463172:0:25038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794800, rc 0) 00000100:00100000:3.0:1787826410.463193:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+14:2401:x1874668790004992:12345-192.168.203.9@tcp:101:ll_sa.0 Request processed in 85us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.463199:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6494 00000100:00100000:0.0:1787826410.465879:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6495 00000100:00100000:0.0:1787826410.465905:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668790005120:12345-192.168.203.9@tcp:101:ll_sa.0 00010000:00010000:0.0:1787826410.465923:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826410.465941:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd2a3 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.465968:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787826410.465974:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.465983:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2a3 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.465998:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2a3 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.466011:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17203e00, rc 0) 00000100:00100000:0.0:1787826410.466062:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+10:2402:x1874668790005120:12345-192.168.203.9@tcp:101:ll_sa.0 Request processed in 172us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.466070:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6495 00000100:00100000:0.0:1787826410.466106:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6496 00000100:00100000:0.0:1787826410.466113:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+14:2401:x1874668790005248:12345-192.168.203.9@tcp:101:ll_sa.0 00010000:00010000:0.0:1787826410.466121:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826410.466131:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd2aa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.466145:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787826410.466149:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.466155:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2aa expref: 15 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.466166:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2aa expref: 15 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.466176:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202e00, rc 0) 00000100:00100000:0.0:1787826410.466197:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+15:2401:x1874668790005248:12345-192.168.203.9@tcp:101:ll_sa.0 Request processed in 85us (4954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.466203:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6496 00000100:00100000:0.0:1787826410.466218:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6497 00000100:00100000:0.0:1787826410.466224:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668790005376:12345-192.168.203.9@tcp:101:ll_sa.0 00010000:00010000:0.0:1787826410.466231:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826410.466238:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd2b1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.466250:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826410.466252:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.466258:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b1 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.466384:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6492 00000100:00100000:1.0:1787826410.466405:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6498 00000100:00100000:1.0:1787826410.466415:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+13:2401:x1874668790005504:12345-192.168.203.9@tcp:101:ll_sa.0 00010000:00010000:1.0:1787826410.466423:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826410.466433:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd2b8 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.466447:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826410.466450:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.466456:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b8 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.466467:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b8 expref: 14 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.466476:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6800, rc 0) 00000100:00100000:1.0:1787826410.466499:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa787581-6963-4f39-b38f-836255c71d7c+14:2401:x1874668790005504:12345-192.168.203.9@tcp:101:ll_sa.0 Request processed in 87us (5214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.466506:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6498 00000100:00100000:3.0:1787826410.466846:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.466905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.466933:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790005760 00000100:00100000:1.0:1787826410.466941:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790005760 00000100:00100000:1.0:1787826410.466983:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3497 00000100:00100000:1.0:1787826410.466990:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+65:2402:x1874668790005760:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826410.467017:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b1 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.467033:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe17202600, rc 0) 00010000:00010000:1.0:1787826410.467033:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787826410.467062:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+10:2402:x1874668790005376:12345-192.168.203.9@tcp:101:ll_sa.0 Request processed in 838us (5800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.467070:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6497 00000100:00100000:0.0:1787826410.467084:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790005632 00000100:00100000:0.0:1787826410.467088:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790005632 00000100:00100000:0.0:1787826410.467114:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6499 00000100:00100000:0.0:1787826410.467120:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf417c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+10:2402:x1874668790005632:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826410.467128:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826410.467138:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd2bf expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.467151:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.467154:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.467160:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2bf expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.467172:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2bf expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.467181:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf19146600, rc 0) 00000100:00100000:0.0:1787826410.467203:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf417c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+11:2402:x1874668790005632:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 83us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.467209:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6499 00010000:00010000:1.0:1787826410.467501:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349dcfb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd2c6 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.467569:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468553:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468568:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468683:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468700:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468708:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468752:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468758:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468764:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468771:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826410.468775:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468782:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468792:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826410.468795:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826410.468799:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468805:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349dd09 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468819:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468824:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468830:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468834:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f7c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826410.468836:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468842:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468889:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x16638b30 (ffff9bbe1342f500) 00010000:00010000:1.0:1787826410.468892:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826410.468895:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468901:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349dd10 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x16638b30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468932:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349dcfb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2c6 expref: 66 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468942:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:1.0:1787826410.468944:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826410.468947:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7200/0x68019081f349dcfb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2c6 expref: 66 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.468955:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7200, rc -2) 00000100:00100000:1.0:1787826410.469006:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+65:2402:x1874668790005760:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 2017us (2111us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826410.469015:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3497 00000100:00100000:0.0:1787826410.477075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.477157:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790005888 00000100:00100000:1.0:1787826410.477166:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790005888 00000100:00100000:1.0:1787826410.477217:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6500 00000100:00100000:1.0:1787826410.477227:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+11:2399:x1874668790005888:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826410.477243:0:45681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826410.477261:0:45681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd305 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.477290:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.477294:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.477303:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd305 expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.477318:0:45681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd305 expref: 12 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.477333:0:45681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826410.477387:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fa787581-6963-4f39-b38f-836255c71d7c+12:2399:x1874668790005888:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 162us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.477394:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6500 00000100:00100000:1.0:1787826410.487464:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.487680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.487758:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.487799:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790006272 00000100:00100000:3.0:1787826410.487810:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790006272 00000100:00100000:3.0:1787826410.487896:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112004 00000100:00100000:3.0:1787826410.487906:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+65:87493:x1874668790006272:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826410.487926:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826410.487946:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd1e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd5ba expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.488070:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349dd25 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.488086:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349dd25 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.488099:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349dd25 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826410.488111:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x148:0x0]: returning size 1516 00010000:00010000:3.0:1787826410.488213:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd1e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x148:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd5ba expref: 68 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.488232:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349dd25 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd5ba expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.488241:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:3.0:1787826410.488244:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826410.488247:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41795600, rc 0) 00000100:00100000:3.0:1787826410.488303:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+67:87493:x1874668790006272:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 398us (623us total) trans 8590016845 rc 0/0 00000100:00100000:3.0:1787826410.488310:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112004 00000100:00100000:1.0:1787826410.491327:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.491404:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790006528 00000100:00100000:0.0:1787826410.491414:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790006528 00000100:00100000:0.0:1787826410.491475:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6501 00000100:00100000:0.0:1787826410.491485:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+12:2399:x1874668790006528:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:0.0:1787826410.491541:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.491562:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1df expref: 32 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.491570:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd279 expref: 12 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.491585:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.491590:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.491595:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 5/0,1 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.491630:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd279 expref: 12 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.491645:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd279 expref: 12 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.491669:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778713472:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826410.491761:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1df expref: 32 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.491771:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1df expref: 32 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.491781:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17086580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778713600:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.491804:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe1272e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826410.493766:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790006016 00000100:00100000:2.0:1787826410.493778:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790006016 00000100:00100000:2.0:1787826410.493844:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790006400 00000100:00100000:2.0:1787826410.493847:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790006400 00000100:00100000:2.0:1787826410.493890:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3498 00000100:00100000:2.0:1787826410.493898:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+68:2399:x1874668790006016:12345-192.168.203.9@tcp:63:ll_sa.0 00000100:00100000:0.0:1787826410.494082:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3499 00000100:00100000:0.0:1787826410.494093:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+69:2399:x1874668790006400:12345-192.168.203.9@tcp:63:ll_sa.0 00000100:00100000:2.0:1787826410.494980:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778713472:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826410.494992:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17086580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778713600:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.495014:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.501075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.501218:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790006656 00000100:00100000:1.0:1787826410.501229:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790006656 00010000:00010000:1.0:1787826410.501270:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd279 expref: 13 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.501318:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3176 00000100:00100000:1.0:1787826410.501328:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fa787581-6963-4f39-b38f-836255c71d7c+13:2400:x1874668790006656:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.501343:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.501366:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd279 expref: 13 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.501382:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd279 expref: 13 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.501405:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048a92d17/0x68019081f349dcae lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd279 expref: 13 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.501422:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.501468:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fa787581-6963-4f39-b38f-836255c71d7c+12:2400:x1874668790006656:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 142us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.501476:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3176 00010000:00010000:2.0:1787826410.501763:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826410.501781:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349dd3a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd30c expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501827:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501840:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501892:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501908:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501915:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501922:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501964:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501971:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501977:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501983:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.501986:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.501993:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502003:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826410.502006:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826410.502009:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502015:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349dd41 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502024:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502029:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502034:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502038:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.502040:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502058:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502064:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xe1221ba8 (ffff9bbe16cc5000) 00010000:00010000:2.0:1787826410.502067:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826410.502069:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502074:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349dd48 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0xe1221ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502101:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349dd3a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd30c expref: 71 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502109:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826410.502112:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826410.502115:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349dd3a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd30c expref: 71 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.502123:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc -2) 00000100:00100000:2.0:1787826410.502179:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+69:2399:x1874668790006016:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 8281us (14729us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826410.502188:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3498 00000100:00100000:3.0:1787826410.505485:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.505528:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790006784 00000100:00100000:3.0:1787826410.505536:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790006784 00010000:00010000:3.0:1787826410.505593:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1df expref: 33 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.505626:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3177 00000100:00100000:3.0:1787826410.505635:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0f544050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+33:2400:x1874668790006784:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826410.505649:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826410.505681:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1df expref: 33 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.505695:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1df expref: 33 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.505716:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bff283e3/0x68019081f349dafc lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1df expref: 33 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.505731:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.505736:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.505741:0:15760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.505751:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.505773:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826410.505811:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0f544050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2400:x1874668790006784:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 177us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.505819:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3177 00000100:00080000:3.0:1787826410.505887:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787826410.506132:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826410.506151:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349dd4f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd4cc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506204:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506218:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506228:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506243:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506250:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506257:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506295:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506301:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506308:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506314:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.506318:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506330:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506339:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826410.506342:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826410.506346:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506352:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349dd56 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506362:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506368:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506374:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506385:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.506387:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506394:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506401:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x99417f8d (ffff9bbe16cc5f00) 00010000:00010000:2.0:1787826410.506403:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826410.506406:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506416:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd5d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x99417f8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506446:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349dd4f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd4cc expref: 69 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506455:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:2.0:1787826410.506458:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826410.506461:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349dd4f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd4cc expref: 69 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506470:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc -2) 00000100:00100000:2.0:1787826410.506523:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+67:2399:x1874668790006400:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 12433us (18765us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826410.506532:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3499 00010000:00010000:2.0:1787826410.506562:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506572:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506792:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506801:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506814:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506821:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826410.506825:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506833:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506846:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.506889:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cb00e03/0x68019081f349dd33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.506934:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+11:2399:x1874668790006528:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 15451us (15615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.506941:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6501 00000100:00100000:0.0:1787826410.521487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.521588:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790007040 00000100:00100000:2.0:1787826410.521598:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790007040 00000100:00100000:2.0:1787826410.521662:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2783 00000100:00100000:2.0:1787826410.521672:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+67:87493:x1874668790007040:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:2.0:1787826410.521751:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000403:0x148:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349dd25 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x148:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd5ba expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826410.521967:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016846 00000001:00080000:2.0:1787826410.522254:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016847 00010000:00010000:2.0:1787826410.522287:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.522303:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceb3 expref: 105 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.522312:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0dc expref: 70 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.522320:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.522350:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0dc expref: 70 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.522364:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0dc expref: 70 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.522377:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a562d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778713728:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.522449:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceb3 expref: 105 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.522459:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceb3 expref: 105 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.522474:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778713856:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826410.522492:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15bab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826410.524838:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a562d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778713728:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.525881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.529133:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.529215:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778713856:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.529244:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.530141:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790007168 00000100:00100000:1.0:1787826410.530150:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790007168 00010000:00010000:1.0:1787826410.530192:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0dc expref: 71 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.530265:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790007296 00000100:00100000:1.0:1787826410.530268:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790007296 00010000:00010000:1.0:1787826410.530300:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceb3 expref: 106 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826410.530339:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826410.530376:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3178 00000100:00100000:2.0:1787826410.530386:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+71:2401:x1874668790007168:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826410.530401:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826410.530408:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0dc expref: 71 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530420:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0dc expref: 71 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530440:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3400/0x68019081f349d96d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0dc expref: 71 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530454:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:2.0:1787826410.530459:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530467:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530473:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826410.530526:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+70:2401:x1874668790007168:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 141us (4649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.530540:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3178 00000100:00100000:2.0:1787826410.530559:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3179 00000100:00100000:2.0:1787826410.530566:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+106:2401:x1874668790007296:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826410.530577:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826410.530582:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceb3 expref: 106 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530592:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceb3 expref: 106 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530603:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb400/0x68019081f349d496 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceb3 expref: 106 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530612:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:2.0:1787826410.530615:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530622:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530629:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.530661:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826410.530681:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+105:2401:x1874668790007296:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 115us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.530687:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3179 00010000:00010000:3.0:1787826410.532022:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.532038:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826410.532163:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016848 00000001:00080000:3.0:1787826410.532288:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016849 00000100:00100000:3.0:1787826410.532388:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa95e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778713984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826410.532445:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826410.532481:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.532617:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778713984 00000100:00100000:0.0:1787826410.532625:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778713984 00000100:00100000:0.0:1787826410.532683:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3500 00000100:00100000:0.0:1787826410.532706:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6518:x1874668778713984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826410.532792:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6518:x1874668778713984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.532800:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3500 00000100:00100000:0.0:1787826410.532837:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa95e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778713984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787826410.532970:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016850 00000100:00100000:0.0:1787826410.533014:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe170852c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778714112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826410.533054:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826410.533071:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16292480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.533084:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778714112 00000100:00100000:0.0:1787826410.533087:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778714112 00000100:00100000:0.0:1787826410.533113:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3501 00000100:00100000:0.0:1787826410.533119:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6518:x1874668778714112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826410.533211:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6518:x1874668778714112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (166us total) trans 4294968216 rc 0/0 00000100:00100000:0.0:1787826410.533218:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3501 00000100:00100000:0.0:1787826410.533246:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe170852c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778714112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787826410.533276:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016851 00010000:00010000:0.0:1787826410.533299:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.533308:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.533315:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.533320:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826410.533325:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.533332:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.533347:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:0.0:1787826410.533350:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826410.533355:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.533366:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dd64 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826410.533443:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x4e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787826410.533501:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].44, 64 off11056 00000004:00080000:0.0:1787826410.533510:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3048644657788ns, next at 3049644656080ns, rc = 0 00000001:00080000:0.0:1787826410.533516:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016852 00010000:00010000:0.0:1787826410.533534:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16cc5d00) 00010000:00010000:0.0:1787826410.533537:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826410.533543:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795600/0x68019081f349dd25 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x148:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd5ba expref: 74 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.533622:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+73:87493:x1874668790007040:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 11951us (12143us total) trans 8590016853 rc 0/0 00000100:00100000:0.0:1787826410.533629:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2783 00000020:00080000:0.0:1787826410.533633:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787826410.535975:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.536058:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790007552 00000100:00100000:0.0:1787826410.536065:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790007552 00000100:00100000:0.0:1787826410.536117:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112005 00000100:00100000:0.0:1787826410.536126:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+73:87493:x1874668790007552:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826410.536147:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826410.536164:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146000/0x68019081f349dd6b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd646 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.536267:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349dd72 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.536286:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349dd72 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.536296:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349dd72 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826410.536308:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x149:0x0]: returning size 1516 00010000:00010000:0.0:1787826410.536392:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146000/0x68019081f349dd6b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x149:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd646 expref: 76 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.536409:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349dd72 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd646 expref: 75 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.536417:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:0.0:1787826410.536420:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826410.536423:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf19146800, rc 0) 00000100:00100000:0.0:1787826410.536469:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+75:87493:x1874668790007552:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 344us (502us total) trans 8590016854 rc 0/0 00000100:00100000:0.0:1787826410.536477:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112005 00000100:00100000:0.0:1787826410.538574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.538646:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790007680 00000100:00100000:3.0:1787826410.538665:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790007680 00000100:00100000:3.0:1787826410.538721:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6502 00000100:00100000:3.0:1787826410.538730:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+13:2400:x1874668790007680:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:3.0:1787826410.538772:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.538794:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1e6 expref: 29 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.538803:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd280 expref: 13 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.538811:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.538815:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.538820:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.538877:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd280 expref: 13 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.538892:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd280 expref: 13 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.538907:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778714240:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826410.538989:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1e6 expref: 29 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.539000:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1e6 expref: 29 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.539010:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778714368:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826410.539032:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826410.541889:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.542003:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790007808 00000100:00100000:1.0:1787826410.542011:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790007808 00010000:00010000:1.0:1787826410.542062:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd280 expref: 14 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.542109:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3180 00000100:00100000:1.0:1787826410.542120:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa787581-6963-4f39-b38f-836255c71d7c+14:2402:x1874668790007808:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.542135:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.542156:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd280 expref: 14 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.542170:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd280 expref: 14 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.542196:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.542247:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa787581-6963-4f39-b38f-836255c71d7c+14:2402:x1874668790007808:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 129us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.542256:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3180 00010000:00010000:0.0:1787826410.542511:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f9882c/0x68019081f349dcb5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd280 expref: 13 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.542526:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778714240:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.542544:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778714368:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826410.542569:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.544935:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.545056:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790007936 00000100:00100000:0.0:1787826410.545065:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790007936 00010000:00010000:0.0:1787826410.545116:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1e6 expref: 30 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.545156:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3181 00000100:00100000:0.0:1787826410.545166:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668790007936:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826410.545179:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826410.545199:0:45686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1e6 expref: 30 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.545214:0:45686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1e6 expref: 30 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.545237:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000683c14d/0x68019081f349db03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1e6 expref: 30 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.545254:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.545258:0:45686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.545264:0:45686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.545275:0:45686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.545360:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826410.545404:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668790007936:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 240us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.545412:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3181 00000100:00080000:3.0:1787826410.546140:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826410.549877:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.549898:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.549930:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.549938:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.549946:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.549953:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826410.549957:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.549965:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.549983:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.549996:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000563d659b/0x68019081f349dd80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.550123:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+12:2400:x1874668790007680:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 11387us (11551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.550133:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6502 00000100:00100000:3.0:1787826410.555566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.555634:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790008192 00000100:00100000:2.0:1787826410.555644:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790008192 00000100:00100000:2.0:1787826410.555711:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2784 00000100:00100000:2.0:1787826410.555722:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+75:87493:x1874668790008192:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:2.0:1787826410.555786:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000403:0x149:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349dd72 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x149:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd646 expref: 75 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826410.556288:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016855 00000001:00080000:3.0:1787826410.556540:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016856 00010000:00010000:3.0:1787826410.556574:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.556590:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceeb expref: 104 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.556599:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ea expref: 78 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.556608:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.556636:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ea expref: 78 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.556649:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ea expref: 78 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.556674:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778714496:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826410.556805:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceeb expref: 104 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.556816:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceeb expref: 104 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.556826:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778714624:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826410.556847:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.560629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.560753:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778714496:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826410.560767:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778714624:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826410.560796:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.562223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.567006:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790008448 00000100:00100000:1.0:1787826410.567020:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790008448 00000100:00100000:2.0:1787826410.567147:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790008320 00000100:00100000:2.0:1787826410.567152:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790008320 00010000:00010000:1.0:1787826410.568484:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceeb expref: 105 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.568544:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3182 00000100:00100000:1.0:1787826410.568558:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+105:2401:x1874668790008448:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.568574:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.568581:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceeb expref: 105 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.568601:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceeb expref: 105 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.568634:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205200/0x68019081f349d530 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fceeb expref: 105 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.568661:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:1.0:1787826410.568668:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.568675:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.568681:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.568744:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+104:2401:x1874668790008448:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 192us (8125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.568752:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3182 00010000:00010000:0.0:1787826410.569925:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ea expref: 79 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.569957:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3183 00000100:00100000:0.0:1787826410.569967:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+79:2401:x1874668790008320:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826410.569981:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826410.569986:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ea expref: 79 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.569998:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ea expref: 79 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.570017:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349d990 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0ea expref: 79 pid: 23845 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.570030:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:0.0:1787826410.570035:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.570043:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.570149:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.570222:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826410.570279:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+78:2401:x1874668790008320:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 314us (8061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.570286:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3183 00010000:00010000:3.0:1787826410.572529:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.572813:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826410.575716:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016857 00000001:00080000:3.0:1787826410.576025:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016858 00000100:00100000:3.0:1787826410.576199:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778714752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826410.576268:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826410.576364:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826410.576452:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778714752 00000100:00100000:2.0:1787826410.576459:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778714752 00000100:00100000:2.0:1787826410.576601:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3502 00000100:00100000:2.0:1787826410.576612:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6519:x1874668778714752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826410.576727:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6519:x1874668778714752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.576734:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3502 00000100:00100000:3.0:1787826410.576796:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778714752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787826410.576943:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016859 00000100:00100000:3.0:1787826410.577004:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778714880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826410.577040:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826410.577541:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c1b4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.577711:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778714880 00000100:00100000:0.0:1787826410.577717:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778714880 00000100:00100000:0.0:1787826410.577760:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3503 00000100:00100000:0.0:1787826410.577769:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe02258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6519:x1874668778714880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826410.577918:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe02258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6519:x1874668778714880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (877us total) trans 4294968201 rc 0/0 00000100:00100000:0.0:1787826410.577926:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3503 00000100:00100000:3.0:1787826410.578293:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778714880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787826410.578346:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016860 00010000:00010000:3.0:1787826410.578375:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.578387:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.578394:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.578400:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826410.578405:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.578418:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.578435:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:3.0:1787826410.578438:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826410.578443:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.578449:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dd87 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826410.578551:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x4f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826410.578621:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].43, 64 off10968 00000004:00080000:3.0:1787826410.579591:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3048690736497ns, next at 3049690731405ns, rc = 0 00000001:00080000:3.0:1787826410.579605:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016861 00010000:00010000:3.0:1787826410.579803:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467200) 00010000:00010000:3.0:1787826410.579808:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826410.579818:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349dd72 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x149:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd646 expref: 82 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.579972:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+81:87493:x1874668790008192:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 24251us (24416us total) trans 8590016862 rc 0/0 00000100:00100000:3.0:1787826410.579981:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2784 00000020:00080000:3.0:1787826410.579987:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1787826410.589536:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.589620:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790008704 00000100:00100000:3.0:1787826410.589629:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790008704 00000100:00100000:3.0:1787826410.589702:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112006 00000100:00100000:3.0:1787826410.589714:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+81:87493:x1874668790008704:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826410.589753:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826410.589773:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dd8e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd64d expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.589904:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dd95 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.589919:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dd95 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.589930:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dd95 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826410.589942:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14a:0x0]: returning size 1516 00010000:00010000:3.0:1787826410.590034:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dd8e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd64d expref: 84 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.590065:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dd95 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd64d expref: 83 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.590074:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:3.0:1787826410.590077:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826410.590081:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794000, rc 0) 00000100:00100000:3.0:1787826410.590138:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+83:87493:x1874668790008704:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 427us (619us total) trans 8590016863 rc 0/0 00000100:00100000:3.0:1787826410.590146:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112006 00000100:00100000:3.0:1787826410.592195:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.592281:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790008832 00000100:00100000:1.0:1787826410.592290:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790008832 00000100:00100000:1.0:1787826410.592344:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6503 00000100:00100000:1.0:1787826410.592355:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+11:2400:x1874668790008832:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:1.0:1787826410.592394:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.592413:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ed expref: 31 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.592427:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2bf expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.592435:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd295 expref: 11 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.592443:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.592448:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.592452:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.592482:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd295 expref: 11 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.592495:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd295 expref: 11 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.592508:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778715008:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826410.592594:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2bf expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.592604:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2bf expref: 11 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.592620:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778715136:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826410.592646:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ed expref: 31 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.592667:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ed expref: 31 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.592676:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778715264:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826410.592699:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826410.603157:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.603192:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.603314:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778715008:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826410.603328:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778715136:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826410.603337:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778715264:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826410.603364:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.603619:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790009088 00000100:00100000:2.0:1787826410.603639:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790009088 00010000:00010000:2.0:1787826410.603684:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ed expref: 32 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.603718:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790008960 00000100:00100000:2.0:1787826410.603722:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790008960 00010000:00010000:2.0:1787826410.603735:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd295 expref: 12 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.603763:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3184 00000100:00100000:2.0:1787826410.603772:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf19037850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+32:2401:x1874668790009088:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826410.603786:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826410.603807:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ed expref: 32 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.603818:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ed expref: 32 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.603840:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05be6bf/0x68019081f349db0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd1ed expref: 32 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.603887:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826410.603935:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf19037850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668790009088:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 163us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.603943:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3184 00000100:00100000:2.0:1787826410.603987:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3185 00000100:00100000:2.0:1787826410.603994:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+12:2401:x1874668790008960:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826410.604003:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826410.604012:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd295 expref: 12 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.604023:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd295 expref: 12 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.604038:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adda9cca/0x68019081f349dcd1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd295 expref: 12 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.604048:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826410.604067:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+11:2401:x1874668790008960:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 73us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.604074:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3185 00000100:00100000:2.0:1787826410.608270:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.608361:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790009216 00000100:00100000:0.0:1787826410.608370:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790009216 00010000:00010000:0.0:1787826410.608409:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2bf expref: 11 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.608452:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3186 00000100:00100000:0.0:1787826410.608462:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+11:2401:x1874668790009216:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826410.608478:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826410.608501:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2bf expref: 11 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.608514:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2bf expref: 11 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.608535:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1952b8c/0x68019081f349dd02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2bf expref: 11 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.608553:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.608558:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.608563:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.608572:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.608702:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826410.608757:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+10:2401:x1874668790009216:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 296us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.608765:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3186 00010000:00010000:1.0:1787826410.612848:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.612947:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.612979:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.612988:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.612997:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.613004:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:1.0:1787826410.613008:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.613016:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.613035:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.613044:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7a2da9/0x68019081f349dda3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.614017:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668790008832:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 21658us (21823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.614028:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6503 00000100:00100000:2.0:1787826410.617482:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.617560:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790009472 00000100:00100000:0.0:1787826410.617570:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790009472 00000100:00100000:0.0:1787826410.617643:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2785 00000100:00100000:0.0:1787826410.617665:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+83:87493:x1874668790009472:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:0.0:1787826410.617731:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000403:0x14a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dd95 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd64d expref: 83 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826410.618173:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016864 00000001:00080000:0.0:1787826410.618470:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016865 00010000:00010000:0.0:1787826410.618510:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.618543:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf23 expref: 103 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.618554:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f8 expref: 86 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.618563:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 5/0,1 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.618597:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f8 expref: 86 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.618613:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f8 expref: 86 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.618641:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778715392:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826410.618875:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf23 expref: 103 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.618887:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf23 expref: 103 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.618896:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17085a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778715520:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.618924:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.621776:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778715392:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.621789:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17085a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778715520:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826410.621816:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826410.624058:0:58480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787826410.624067:0:58480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826410.624625:0:58480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787826410.624639:0:58480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787826410.631007:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.631112:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.631327:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790009728 00000100:00100000:3.0:1787826410.631337:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790009728 00010000:00010000:3.0:1787826410.631375:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf23 expref: 104 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.631415:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790009600 00000100:00100000:3.0:1787826410.631419:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790009600 00010000:00010000:3.0:1787826410.631433:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f8 expref: 87 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.631463:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3187 00000100:00100000:3.0:1787826410.631472:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+104:2402:x1874668790009728:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826410.631486:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826410.631493:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf23 expref: 104 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631505:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf23 expref: 104 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631526:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606600/0x68019081f349d5ca lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf23 expref: 104 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631554:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:3.0:1787826410.631559:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631567:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631579:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826410.631630:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+103:2402:x1874668790009728:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 159us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.631638:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3187 00000100:00100000:3.0:1787826410.631667:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3188 00000100:00100000:3.0:1787826410.631675:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+87:2402:x1874668790009600:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826410.631683:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826410.631688:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f8 expref: 87 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631699:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f8 expref: 87 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631713:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16607800/0x68019081f349d9b3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0f8 expref: 87 pid: 12105 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631722:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:3.0:1787826410.631726:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631733:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631740:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631767:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826410.631788:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+86:2402:x1874668790009600:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 114us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.631795:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3188 00010000:00010000:3.0:1787826410.631817:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.631824:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826410.631971:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016866 00000001:00080000:3.0:1787826410.632078:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016867 00000100:00100000:3.0:1787826410.632161:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa96940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778715648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826410.632252:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826410.632278:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.636480:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778715648 00000100:00100000:1.0:1787826410.636495:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778715648 00000100:00100000:1.0:1787826410.636563:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504 00000100:00100000:1.0:1787826410.636574:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6518:x1874668778715648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826410.636725:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6518:x1874668778715648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 152us (4471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.636732:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504 00000100:00100000:3.0:1787826410.637363:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa96940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778715648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826410.638037:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016868 00000100:00100000:3.0:1787826410.638192:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa96940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778715776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826410.638244:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826410.638273:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.638874:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778715776 00000100:00100000:0.0:1787826410.638881:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778715776 00000100:00100000:0.0:1787826410.638940:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3505 00000100:00100000:0.0:1787826410.638949:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6518:x1874668778715776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826410.639089:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6518:x1874668778715776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 141us (843us total) trans 4294968217 rc 0/0 00000100:00100000:0.0:1787826410.639096:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3505 00000100:00100000:3.0:1787826410.643101:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa96940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778715776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826410.643186:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016869 00010000:00010000:3.0:1787826410.643231:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.643241:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.643248:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.643258:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826410.643263:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.643271:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.643287:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:3.0:1787826410.643290:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826410.643294:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.643301:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddaa lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826410.643408:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x50:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826410.643460:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].45, 64 off11120 00000001:00080000:3.0:1787826410.643468:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016870 00010000:00010000:3.0:1787826410.643492:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbf14059e00) 00010000:00010000:3.0:1787826410.643496:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826410.643503:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dd95 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14a:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd64d expref: 90 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.643612:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+89:87493:x1874668790009472:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 25959us (26139us total) trans 8590016871 rc 0/0 00000100:00100000:3.0:1787826410.643622:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2785 00000020:00080000:3.0:1787826410.643628:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1787826410.646779:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.646887:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790009984 00000100:00100000:1.0:1787826410.646896:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790009984 00000100:00100000:1.0:1787826410.646953:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112007 00000100:00100000:1.0:1787826410.646963:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+89:87493:x1874668790009984:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826410.646986:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826410.647004:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ddb1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd654 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.647121:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ddb8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.647136:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ddb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.647148:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ddb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826410.647160:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14b:0x0]: returning size 1516 00010000:00010000:1.0:1787826410.647260:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349ddb1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd654 expref: 92 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.647293:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ddb8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd654 expref: 91 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.647302:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:1.0:1787826410.647305:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826410.647308:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7000, rc 0) 00000100:00100000:1.0:1787826410.647371:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+91:87493:x1874668790009984:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 402us (594us total) trans 8590016872 rc 0/0 00000100:00100000:1.0:1787826410.647378:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112007 00000100:00100000:0.0:1787826410.649693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.649833:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790010112 00000100:00100000:1.0:1787826410.649842:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790010112 00000100:00100000:1.0:1787826410.649919:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6504 00000100:00100000:1.0:1787826410.649929:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+12:2399:x1874668790010112:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:1.0:1787826410.649966:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.649984:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd21e expref: 28 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.649992:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd29c expref: 12 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.649998:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.650002:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.650006:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.650035:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd29c expref: 12 pid: 25038 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.650048:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd29c expref: 12 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.650062:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778715904:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826410.650236:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd21e expref: 28 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.650246:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd21e expref: 28 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.650257:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778716032:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826410.650298:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.653075:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778715904:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826410.653093:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778716032:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826410.653133:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.656927:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.657003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.657095:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790010368 00000100:00100000:1.0:1787826410.657103:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790010368 00010000:00010000:1.0:1787826410.657153:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd21e expref: 29 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.657182:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790010240 00000100:00100000:1.0:1787826410.657185:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790010240 00010000:00010000:1.0:1787826410.657198:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd29c expref: 13 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.657232:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3189 00000100:00100000:1.0:1787826410.657241:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668790010368:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.657256:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.657288:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd21e expref: 29 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.657303:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd21e expref: 29 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.657310:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3190 00000100:00100000:3.0:1787826410.657324:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+13:2402:x1874668790010240:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.657335:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf70200/0x68019081f349dbb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd21e expref: 29 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657335:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826410.657350:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd29c expref: 13 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.657356:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826410.657366:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd29c expref: 13 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657381:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349dcd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd29c expref: 13 pid: 25038 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657393:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.657397:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.657403:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657414:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.657420:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2402:x1874668790010368:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 177us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.657431:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3189 00010000:00010000:3.0:1787826410.657445:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826410.657467:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+12:2402:x1874668790010240:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 147us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.657479:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3190 00010000:00010000:3.0:1787826410.657504:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657513:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657543:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657551:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657559:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657566:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:3.0:1787826410.657570:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657578:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657589:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.657597:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349ddc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.657636:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+11:2399:x1874668790010112:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 7710us (7951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.657643:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6504 00000100:00100000:3.0:1787826410.663413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.663689:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790010624 00000100:00100000:0.0:1787826410.663698:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790010624 00000100:00100000:0.0:1787826410.663760:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2786 00000100:00100000:0.0:1787826410.663770:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+91:87493:x1874668790010624:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:0.0:1787826410.663833:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000403:0x14b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ddb8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd654 expref: 91 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826410.664049:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016873 00000001:00080000:0.0:1787826410.664355:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016874 00010000:00010000:0.0:1787826410.664396:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.664418:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf5b expref: 102 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.664428:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd106 expref: 94 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.664436:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 5/0,1 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.664469:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd106 expref: 94 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.664484:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd106 expref: 94 pid: 25756 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.664497:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17086d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778716160:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826410.664595:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf5b expref: 102 pid: 45682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.664606:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf5b expref: 102 pid: 45682 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.664616:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778716288:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.664645:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826410.670267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.670530:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.670824:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790010880 00000100:00100000:2.0:1787826410.670834:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790010880 00010000:00010000:2.0:1787826410.670917:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf5b expref: 103 pid: 45682 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.670958:0:45686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790010752 00000100:00100000:2.0:1787826410.670962:0:45686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790010752 00010000:00010000:2.0:1787826410.670976:0:45686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd106 expref: 95 pid: 25756 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.671030:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17086d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778716160:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.671044:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778716288:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826410.671067:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.672639:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3191 00000100:00100000:1.0:1787826410.672674:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c7dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+103:2402:x1874668790010880:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.672694:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.672705:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf5b expref: 103 pid: 45682 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.672719:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf5b expref: 103 pid: 45682 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.672755:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb600/0x68019081f349d664 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fcf5b expref: 103 pid: 45682 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.672774:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:1.0:1787826410.672781:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.672790:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.672796:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.672881:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c7dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+102:2402:x1874668790010880:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 229us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.672890:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3191 00000100:00100000:1.0:1787826410.672952:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3192 00000100:00100000:1.0:1787826410.672961:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+95:2402:x1874668790010752:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.672970:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.672975:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd106 expref: 95 pid: 25756 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.672987:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd106 expref: 95 pid: 25756 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.673002:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41204000/0x68019081f349d9d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd106 expref: 95 pid: 25756 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.673020:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:1.0:1787826410.673025:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.673034:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.673041:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.673071:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.673101:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+94:2402:x1874668790010752:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 141us (2571us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826410.673109:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.673119:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.673123:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3192 00000001:00080000:0.0:1787826410.673241:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016875 00000001:00080000:0.0:1787826410.673490:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016876 00000100:00100000:0.0:1787826410.673576:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778716416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826410.673624:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826410.673663:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.673680:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778716416 00000100:00100000:1.0:1787826410.673688:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778716416 00000100:00100000:1.0:1787826410.673734:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3506 00000100:00100000:1.0:1787826410.673751:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17086d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6519:x1874668778716416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826410.673831:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17086d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6519:x1874668778716416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.673837:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3506 00000100:00100000:0.0:1787826410.674675:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778716416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787826410.674799:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016877 00000100:00100000:0.0:1787826410.676046:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778716544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826410.676234:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826410.676269:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.676527:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778716544 00000100:00100000:1.0:1787826410.676534:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778716544 00000100:00100000:1.0:1787826410.676586:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3507 00000100:00100000:1.0:1787826410.676595:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6519:x1874668778716544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826410.676759:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6519:x1874668778716544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (525us total) trans 4294968202 rc 0/0 00000100:00100000:1.0:1787826410.676777:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3507 00000100:00100000:2.0:1787826410.676994:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778716544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826410.677055:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016878 00010000:00010000:2.0:1787826410.677085:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.677095:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.677103:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.677109:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.677114:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.677121:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.677137:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:2.0:1787826410.677140:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826410.677145:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.677152:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349ddcd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826410.677401:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x51:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787826410.677452:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].44, 64 off11032 00000001:00080000:2.0:1787826410.677461:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016879 00010000:00010000:2.0:1787826410.677485:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:2.0:1787826410.677488:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826410.677494:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349ddb8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd654 expref: 98 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.677748:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+97:87493:x1874668790010624:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 13979us (14344us total) trans 8590016880 rc 0/0 00000100:00100000:2.0:1787826410.677757:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2786 00000020:00080000:2.0:1787826410.677761:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1787826410.683995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.684034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790011136 00000100:00100000:2.0:1787826410.684044:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790011136 00000100:00100000:2.0:1787826410.684110:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112008 00000100:00100000:2.0:1787826410.684120:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+97:87493:x1874668790011136:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826410.684144:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826410.684166:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349ddd4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd65b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.684283:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349dddb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.684297:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349dddb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.684308:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349dddb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826410.684320:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14c:0x0]: returning size 1516 00010000:00010000:2.0:1787826410.684437:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349ddd4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd65b expref: 100 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.684463:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349dddb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd65b expref: 99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.684473:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:2.0:1787826410.684477:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826410.684481:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993cc00, rc 0) 00000100:00100000:2.0:1787826410.684546:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+99:87493:x1874668790011136:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 427us (560us total) trans 8590016881 rc 0/0 00000100:00100000:2.0:1787826410.684554:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112008 00000100:00100000:3.0:1787826410.694500:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.695724:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790011264 00000100:00100000:2.0:1787826410.695736:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790011264 00000100:00100000:2.0:1787826410.695841:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6505 00000100:00100000:2.0:1787826410.695869:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668790011264:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:2.0:1787826410.695914:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.695935:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd225 expref: 30 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.695945:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd305 expref: 9 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.695953:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2a3 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.695967:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826410.695971:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826410.695975:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.696008:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2a3 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.696023:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2a3 expref: 9 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.696038:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a560000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778716672:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.696149:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd305 expref: 9 pid: 45681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.696160:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd305 expref: 9 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.696170:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a562d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778716800:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.696217:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd225 expref: 30 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.696227:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd225 expref: 30 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.696237:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a5630c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778716928:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826410.696260:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17885900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.702996:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.703101:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a560000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778716672:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826410.703114:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a562d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778716800:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.703220:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790011520 00000100:00100000:0.0:1787826410.703227:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790011520 00010000:00010000:0.0:1787826410.703277:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd305 expref: 10 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.703314:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3193 00000100:00100000:0.0:1787826410.703324:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa787581-6963-4f39-b38f-836255c71d7c+10:2401:x1874668790011520:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826410.703338:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826410.703357:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd305 expref: 10 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.703368:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd305 expref: 10 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.703389:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be6e1168/0x68019081f349dd17 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd305 expref: 10 pid: 45681 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.703410:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826410.703459:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668790011520:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 137us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.703468:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3193 00000100:00100000:3.0:1787826410.703628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.703664:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a5630c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1874668778716928:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.703695:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.703774:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790011648 00000100:00100000:1.0:1787826410.703779:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790011648 00010000:00010000:1.0:1787826410.703799:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd225 expref: 31 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.703828:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3194 00000100:00100000:1.0:1787826410.703836:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+31:2401:x1874668790011648:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.703844:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.703877:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd225 expref: 31 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.703888:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd225 expref: 31 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.703903:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070283fea/0x68019081f349dbc0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd225 expref: 31 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.703914:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.703944:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2401:x1874668790011648:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.703951:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3194 00000100:00100000:3.0:1787826410.714260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.714349:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790011392 00000100:00100000:1.0:1787826410.714359:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790011392 00010000:00010000:1.0:1787826410.714403:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2a3 expref: 9 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.714447:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3195 00000100:00100000:1.0:1787826410.714457:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668790011392:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.714472:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.714494:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2a3 expref: 9 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.714510:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2a3 expref: 9 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.714533:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2ce88d/0x68019081f349dcdf lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2a3 expref: 9 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.714551:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.714555:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.714560:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.714571:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.714604:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.714667:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+8:2400:x1874668790011392:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 211us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.714684:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3195 00010000:00010000:2.0:1787826410.714758:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.714768:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.714789:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.714798:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.714806:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.714819:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826410.714824:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.714833:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.714846:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.714892:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1595ca3/0x68019081f349dde9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.714945:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa787581-6963-4f39-b38f-836255c71d7c+7:2400:x1874668790011264:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 19094us (20454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.714953:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6505 00000100:00100000:3.0:1787826410.718528:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.718633:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790011904 00000100:00100000:0.0:1787826410.718642:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790011904 00000100:00100000:0.0:1787826410.718715:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2787 00000100:00100000:0.0:1787826410.718727:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+99:87493:x1874668790011904:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:0.0:1787826410.718799:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000403:0x14c:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349dddb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd65b expref: 99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826410.719008:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016882 00000001:00080000:0.0:1787826410.719393:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016883 00010000:00010000:0.0:1787826410.719429:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.719445:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd00a expref: 101 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.719460:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd114 expref: 102 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.719468:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.719498:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd114 expref: 102 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.719513:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd114 expref: 102 pid: 25759 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.719528:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17086580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778717056:192.168.203.9@tcp:104: 00010000:00010000:0.0:1787826410.719621:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd00a expref: 101 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.719631:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd00a expref: 101 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.719640:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe17087c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778717184:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.719674:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0cb0ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.722963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.723001:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790012032 00000100:00100000:1.0:1787826410.723011:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790012032 00010000:00010000:1.0:1787826410.723049:0:15760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd114 expref: 103 pid: 25759 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.723093:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17086580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778717056:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826410.723105:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe17087c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778717184:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826410.723126:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3196 00000100:00100000:1.0:1787826410.723137:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa787581-6963-4f39-b38f-836255c71d7c+103:2401:x1874668790012032:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826410.723143:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.723153:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.723162:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd114 expref: 103 pid: 25759 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.723176:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd114 expref: 103 pid: 25759 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.723210:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9f800/0x68019081f349d9f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd114 expref: 103 pid: 25759 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.723225:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:1.0:1787826410.723230:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.723239:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.723246:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.723300:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa787581-6963-4f39-b38f-836255c71d7c+102:2401:x1874668790012032:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 165us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.723307:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3196 00000100:00100000:3.0:1787826410.727820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.727992:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790012160 00000100:00100000:0.0:1787826410.728001:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790012160 00010000:00010000:0.0:1787826410.728042:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd00a expref: 102 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.728095:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3197 00000100:00100000:0.0:1787826410.728105:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+102:2401:x1874668790012160:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826410.728119:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826410.728127:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd00a expref: 102 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.728145:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd00a expref: 102 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.728167:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a2800/0x68019081f349d73d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd00a expref: 102 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.728184:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:0.0:1787826410.728189:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.728198:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.728205:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.728234:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826410.728266:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.728276:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.728285:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+101:2401:x1874668790012160:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 181us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.728294:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3197 00000001:00080000:3.0:1787826410.728381:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016884 00000001:00080000:3.0:1787826410.728493:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016885 00000100:00100000:3.0:1787826410.728801:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa952c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778717312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826410.728846:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826410.728890:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826410.730293:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778717312 00000100:00100000:2.0:1787826410.730303:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778717312 00000100:00100000:2.0:1787826410.730360:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3508 00000100:00100000:2.0:1787826410.730369:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6518:x1874668778717312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787826410.730530:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6518:x1874668778717312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.730539:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3508 00000100:00100000:3.0:1787826410.731206:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa952c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778717312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826410.731406:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016886 00000100:00100000:3.0:1787826410.731721:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa952c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778717440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826410.731770:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826410.731833:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.732475:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778717440 00000100:00100000:0.0:1787826410.732482:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778717440 00000100:00100000:0.0:1787826410.732561:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3509 00000100:00100000:0.0:1787826410.732570:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6518:x1874668778717440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826410.732725:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6518:x1874668778717440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 156us (954us total) trans 4294968218 rc 0/0 00000100:00100000:0.0:1787826410.732732:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3509 00000100:00100000:3.0:1787826410.732795:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa952c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778717440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826410.732845:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016887 00010000:00010000:3.0:1787826410.732894:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.732904:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.732911:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.732917:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826410.732922:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.732931:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.732946:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:3.0:1787826410.732949:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826410.732953:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.732959:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349ddf0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826410.733051:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x52:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826410.733095:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].46, 64 off11184 00000001:00080000:3.0:1787826410.733102:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016888 00010000:00010000:3.0:1787826410.733124:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbf14059400) 00010000:00010000:3.0:1787826410.733127:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826410.733135:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349dddb lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14c:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd65b expref: 106 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.733231:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+105:87493:x1874668790011904:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 14507us (14711us total) trans 8590016889 rc 0/0 00000100:00100000:3.0:1787826410.733240:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2787 00000020:00080000:3.0:1787826410.733244:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787826410.740445:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.740542:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790012416 00000100:00100000:2.0:1787826410.740551:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790012416 00000100:00100000:2.0:1787826410.740615:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112009 00000100:00100000:2.0:1787826410.740634:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+105:87493:x1874668790012416:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826410.740667:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826410.740688:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349ddf7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd662 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.740797:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349ddfe lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.740812:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349ddfe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.740824:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349ddfe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826410.740836:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14d:0x0]: returning size 1516 00010000:00010000:2.0:1787826410.741307:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349ddf7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd662 expref: 108 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.741325:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349ddfe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd662 expref: 107 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.741334:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826410.741338:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826410.741341:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d600, rc 0) 00000100:00100000:2.0:1787826410.741441:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+107:87493:x1874668790012416:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 817us (1005us total) trans 8590016890 rc 0/0 00000100:00100000:2.0:1787826410.741449:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112009 00000100:00100000:2.0:1787826410.746627:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.746766:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790012544 00000100:00100000:3.0:1787826410.746775:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790012544 00000100:00100000:3.0:1787826410.746837:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6506 00000100:00100000:3.0:1787826410.746846:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+11:2400:x1874668790012544:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:3.0:1787826410.746978:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.746998:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd22c expref: 27 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.747008:0:25038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2aa expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.747015:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.747020:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.747025:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.747188:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2aa expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.747204:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2aa expref: 11 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.747218:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778717568:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826410.747350:0:25038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd22c expref: 27 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.747361:0:25038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd22c expref: 27 pid: 8605 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.747370:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778717696:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826410.747398:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd609c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.755261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.755348:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.756085:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778717568:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826410.756101:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25038:1874668778717696:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826410.756130:0:25038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.756639:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790012800 00000100:00100000:1.0:1787826410.756646:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790012800 00010000:00010000:1.0:1787826410.756696:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd22c expref: 28 pid: 8605 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.756735:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790012672 00000100:00100000:1.0:1787826410.756739:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790012672 00010000:00010000:1.0:1787826410.756753:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2aa expref: 12 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.756781:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3198 00000100:00100000:1.0:1787826410.756791:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c7dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+28:2402:x1874668790012800:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.756806:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.756825:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd22c expref: 28 pid: 8605 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.756837:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd22c expref: 28 pid: 8605 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.756885:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2024453/0x68019081f349dbc7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd22c expref: 28 pid: 8605 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.756902:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.756964:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c7dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2402:x1874668790012800:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 173us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.756972:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3198 00000100:00100000:1.0:1787826410.757017:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3199 00000100:00100000:1.0:1787826410.757025:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+12:2402:x1874668790012672:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.757034:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.757043:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2aa expref: 12 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.757055:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2aa expref: 12 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.757069:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b54af437/0x68019081f349dce6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2aa expref: 12 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.757081:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.757085:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.757090:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.757100:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.757135:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.757163:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa787581-6963-4f39-b38f-836255c71d7c+11:2402:x1874668790012672:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 138us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.757169:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3199 00010000:00010000:0.0:1787826410.757689:0:25038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.757702:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.757724:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.757734:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.757742:0:25038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.757749:0:25038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826410.757753:0:25038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.757767:0:25038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.757780:0:25038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.757800:0:25038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000506f0508/0x68019081f349de0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.757873:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a5630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+10:2400:x1874668790012544:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 11006us (11234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.757882:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6506 00000100:00100000:0.0:1787826410.761592:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.762380:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790013056 00000100:00100000:2.0:1787826410.762391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790013056 00000100:00100000:2.0:1787826410.762484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2788 00000100:00100000:2.0:1787826410.762495:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+107:87493:x1874668790013056:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:2.0:1787826410.762557:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000403:0x14d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349ddfe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd662 expref: 107 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826410.762757:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016891 00000001:00080000:2.0:1787826410.763129:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016892 00010000:00010000:2.0:1787826410.763172:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.763188:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd049 expref: 100 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.763196:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd122 expref: 110 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.763204:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.763231:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd122 expref: 110 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.763245:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd122 expref: 110 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.763259:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a562d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778717824:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.763350:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd049 expref: 100 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.763360:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd049 expref: 100 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.763369:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a560000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778717952:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826410.763391:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.767067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.767146:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790013184 00000100:00100000:0.0:1787826410.767154:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790013184 00010000:00010000:0.0:1787826410.767193:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd122 expref: 111 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.767237:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3200 00000100:00100000:0.0:1787826410.767246:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+111:2399:x1874668790013184:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826410.767259:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826410.767265:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd122 expref: 111 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.767277:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd122 expref: 111 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.767299:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:0.0:1787826410.767304:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.767312:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.767318:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826410.767406:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0dd9ea00/0x68019081f349da1c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd122 expref: 111 pid: 6517 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.767423:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a562d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778717824:192.168.203.9@tcp:104: 00000100:00100000:0.0:1787826410.773028:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+110:2399:x1874668790013184:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 5770us (5957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.773045:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3200 00000100:00100000:2.0:1787826410.773376:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a560000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778717952:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.773408:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.773502:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.773583:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790013312 00000100:00100000:2.0:1787826410.773590:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790013312 00010000:00010000:2.0:1787826410.773621:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd049 expref: 101 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.773706:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3201 00000100:00100000:2.0:1787826410.773820:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+101:2399:x1874668790013312:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826410.773835:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826410.773842:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd049 expref: 101 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.773883:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd049 expref: 101 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.773905:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349d7ec lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd049 expref: 101 pid: 7736 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.773920:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826410.773925:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.773935:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.773943:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.773965:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826410.773994:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+100:2399:x1874668790013312:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 279us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.774000:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3201 00010000:00010000:2.0:1787826410.774101:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.774109:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826410.774211:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016893 00000001:00080000:2.0:1787826410.774316:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016894 00000100:00100000:2.0:1787826410.774395:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a560000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778718080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826410.774440:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826410.774509:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a1706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.774559:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778718080 00000100:00100000:1.0:1787826410.774564:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778718080 00000100:00100000:1.0:1787826410.774632:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3510 00000100:00100000:1.0:1787826410.774640:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6519:x1874668778718080:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826410.774734:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6519:x1874668778718080:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.774742:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3510 00000100:00100000:3.0:1787826410.775938:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a560000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778718080:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787826410.776088:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016895 00000100:00100000:3.0:1787826410.776149:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bd680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778718208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826410.776192:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826410.776403:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.776871:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778718208 00000100:00100000:1.0:1787826410.776879:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778718208 00000100:00100000:1.0:1787826410.776970:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3511 00000100:00100000:1.0:1787826410.776981:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6519:x1874668778718208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826410.777244:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6519:x1874668778718208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 264us (1050us total) trans 4294968203 rc 0/0 00000100:00100000:1.0:1787826410.777251:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3511 00000100:00100000:2.0:1787826410.777324:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bd680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778718208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826410.777375:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016896 00010000:00010000:2.0:1787826410.777405:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.777414:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.777421:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.777426:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.777430:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.777438:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.777453:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826410.777456:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826410.777461:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.777467:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349de13 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826410.777570:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x53:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787826410.777614:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].45, 64 off11096 00000001:00080000:2.0:1787826410.777622:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016897 00010000:00010000:2.0:1787826410.777645:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826410.777657:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826410.777664:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349ddfe lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14d:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd662 expref: 114 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.777900:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+113:87493:x1874668790013056:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 15407us (16316us total) trans 8590016898 rc 0/0 00000100:00100000:2.0:1787826410.777910:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2788 00000020:00080000:2.0:1787826410.777914:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1787826410.780027:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.780187:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790013568 00000100:00100000:1.0:1787826410.780195:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790013568 00000100:00100000:1.0:1787826410.780290:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112010 00000100:00100000:1.0:1787826410.780300:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17086580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+113:87493:x1874668790013568:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826410.780324:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826410.780345:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349de1a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd669 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.780450:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349de21 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.780464:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349de21 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.780475:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349de21 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826410.780487:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14e:0x0]: returning size 1516 00010000:00010000:1.0:1787826410.780663:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349de1a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd669 expref: 116 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.780683:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349de21 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd669 expref: 115 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.780691:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:1.0:1787826410.780694:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826410.780698:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826410.780810:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17086580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+115:87493:x1874668790013568:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 510us (792us total) trans 8590016899 rc 0/0 00000100:00100000:1.0:1787826410.780816:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112010 00000100:00100000:1.0:1787826410.783946:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.784054:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790013696 00000100:00100000:2.0:1787826410.784063:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790013696 00000100:00100000:2.0:1787826410.784109:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6507 00000100:00100000:2.0:1787826410.784118:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+7:2400:x1874668790013696:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:2.0:1787826410.784160:0:19335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.784180:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd25d expref: 29 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.784190:0:19335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b1 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.784197:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826410.784202:0:19335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826410.784206:0:19335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 5/0,1 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.784243:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b1 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.784259:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b1 expref: 7 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.784273:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778718336:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.784367:0:19335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd25d expref: 29 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.784378:0:19335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd25d expref: 29 pid: 8432 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.784387:0:19335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778718464:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826410.784411:0:19335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a170f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.790764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.790920:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778718336:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826410.790935:0:19335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19335:1874668778718464:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.790962:0:19335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.791074:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.791815:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790013952 00000100:00100000:1.0:1787826410.791823:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790013952 00010000:00010000:1.0:1787826410.791893:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd25d expref: 30 pid: 8432 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.791973:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790013824 00000100:00100000:1.0:1787826410.791977:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790013824 00010000:00010000:1.0:1787826410.791991:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b1 expref: 8 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.792088:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3202 00000100:00100000:3.0:1787826410.792102:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+30:2402:x1874668790013952:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826410.792118:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826410.792141:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd25d expref: 30 pid: 8432 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.792154:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd25d expref: 30 pid: 8432 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.792177:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074e5e250/0x68019081f349dc61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd25d expref: 30 pid: 8432 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.792193:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826410.792255:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2402:x1874668790013952:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 158us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.792263:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3202 00000100:00100000:3.0:1787826410.792281:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3203 00000100:00100000:3.0:1787826410.792288:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+8:2401:x1874668790013824:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826410.792296:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826410.792305:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b1 expref: 8 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.792316:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b1 expref: 8 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.792335:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fe6ea9c/0x68019081f349dced lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b1 expref: 8 pid: 8430 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.792346:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.792349:0:9521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826410.792355:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.792364:0:9521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.792389:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826410.792407:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa787581-6963-4f39-b38f-836255c71d7c+7:2401:x1874668790013824:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 119us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.792414:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3203 00010000:00010000:2.0:1787826410.792704:0:19335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.792721:0:19335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.792744:0:19335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.792752:0:19335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.792760:0:19335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.792767:0:19335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993cc00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826410.792771:0:19335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.792779:0:19335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.792792:0:19335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.792800:0:19335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b271efe/0x68019081f349de2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.793437:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668790013696:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 9315us (9497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.793447:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6507 00000100:00100000:0.0:1787826410.807120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.807189:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790014208 00000100:00100000:3.0:1787826410.807198:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790014208 00000100:00100000:3.0:1787826410.807249:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2789 00000100:00100000:3.0:1787826410.807258:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+115:87493:x1874668790014208:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:3.0:1787826410.807317:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000403:0x14e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349de21 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd669 expref: 115 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826410.807481:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016900 00000001:00080000:3.0:1787826410.807751:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016901 00010000:00010000:3.0:1787826410.807788:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.807804:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd081 expref: 99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.807812:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd130 expref: 118 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.807819:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.807849:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd130 expref: 118 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.807896:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd130 expref: 118 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.807911:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778718592:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826410.807995:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd081 expref: 99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.808005:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd081 expref: 99 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.808014:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778718720:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826410.808033:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0dd60a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826410.810098:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6be940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778718592:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826410.810112:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1874668778718720:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826410.810141:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.812163:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.812251:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.812333:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790014336 00000100:00100000:2.0:1787826410.812342:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790014336 00010000:00010000:2.0:1787826410.812378:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd130 expref: 119 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.812414:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790014464 00000100:00100000:2.0:1787826410.812418:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790014464 00010000:00010000:2.0:1787826410.812430:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd081 expref: 100 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.812463:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3204 00000100:00100000:2.0:1787826410.812473:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+119:2401:x1874668790014336:12345-192.168.203.9@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787826410.812483:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3205 00010000:00010000:2.0:1787826410.812488:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826410.812496:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd130 expref: 119 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.812498:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c7de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+100:2402:x1874668790014464:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826410.812516:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd130 expref: 119 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.812522:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826410.812536:0:15760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd081 expref: 100 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.812546:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202200/0x68019081f349da3f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd130 expref: 119 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.812553:0:15760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd081 expref: 100 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826410.812572:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17202c00/0x68019081f349d886 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd081 expref: 100 pid: 6515 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.813069:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:2.0:1787826410.813077:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.813089:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.813096:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.813162:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826410.813222:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+118:2401:x1874668790014336:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 750us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826410.813231:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3204 00010000:00010000:3.0:1787826410.813308:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:3.0:1787826410.813313:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826410.813338:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c7de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+99:2402:x1874668790014464:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 846us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.813346:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3205 00010000:00010000:0.0:1787826410.814142:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.814154:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826410.814248:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016902 00000001:00080000:0.0:1787826410.814342:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016903 00000100:00100000:0.0:1787826410.814436:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf137643c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778718848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826410.814482:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826410.814514:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0fd099c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.814613:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778718848 00000100:00100000:1.0:1787826410.814620:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778718848 00000100:00100000:1.0:1787826410.814671:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3512 00000100:00100000:1.0:1787826410.814680:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6518:x1874668778718848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826410.814762:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6518:x1874668778718848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.814771:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3512 00000100:00100000:3.0:1787826410.814895:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf137643c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778718848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787826410.815187:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016904 00000100:00100000:0.0:1787826410.815233:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778718976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826410.815259:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826410.815315:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0c66db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826410.815506:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778718976 00000100:00100000:1.0:1787826410.815510:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778718976 00000100:00100000:1.0:1787826410.815617:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3513 00000100:00100000:1.0:1787826410.815626:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6518:x1874668778718976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826410.815769:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6518:x1874668778718976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (508us total) trans 4294968219 rc 0/0 00000100:00100000:1.0:1787826410.815776:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3513 00000100:00100000:2.0:1787826410.815836:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1874668778718976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787826410.815896:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016905 00010000:00010000:2.0:1787826410.815922:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.815931:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.815938:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.815944:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.815948:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.815956:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.815975:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:2.0:1787826410.815978:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826410.815982:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.815989:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de36 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826410.816066:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x54:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787826410.816109:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].47, 64 off11248 00000001:00080000:2.0:1787826410.816116:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016906 00010000:00010000:2.0:1787826410.816138:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe16467100) 00010000:00010000:2.0:1787826410.816142:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826410.816149:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349de21 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd669 expref: 122 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.816242:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+121:87493:x1874668790014208:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 8984us (9131us total) trans 8590016907 rc 0/0 00000100:00100000:2.0:1787826410.816250:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2789 00000020:00080000:2.0:1787826410.816253:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787826410.818336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.818410:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790014720 00000100:00100000:2.0:1787826410.818418:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790014720 00000100:00100000:2.0:1787826410.818467:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112011 00000100:00100000:2.0:1787826410.818475:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+121:87493:x1874668790014720:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826410.818495:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826410.818513:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de3d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd670 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.818620:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349de44 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.818633:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349de44 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.818644:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349de44 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826410.818663:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14f:0x0]: returning size 1516 00010000:00010000:2.0:1787826410.818758:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de3d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd670 expref: 124 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.818775:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349de44 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd670 expref: 123 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.818783:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:2.0:1787826410.818785:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826410.818789:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d600, rc 0) 00000100:00100000:2.0:1787826410.818836:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+123:87493:x1874668790014720:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 362us (508us total) trans 8590016908 rc 0/0 00000100:00100000:2.0:1787826410.818844:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112011 00000100:00100000:3.0:1787826410.826305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.826590:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790014848 00000100:00100000:1.0:1787826410.826600:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790014848 00000100:00100000:1.0:1787826410.826668:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6508 00000100:00100000:1.0:1787826410.826680:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+10:2402:x1874668790014848:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:1.0:1787826410.826724:0:8605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.826746:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd256 expref: 26 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.826755:0:8605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b8 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.826763:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.826767:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826410.826773:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.826808:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b8 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.826823:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b8 expref: 10 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.826838:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778719104:192.168.203.9@tcp:104: 00010000:00010000:1.0:1787826410.827073:0:8605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd256 expref: 26 pid: 19335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.827084:0:8605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd256 expref: 26 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.827093:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778719232:192.168.203.9@tcp:104: 00000100:00100000:1.0:1787826410.827114:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe15d38900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826410.829155:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778719104:192.168.203.9@tcp:104: 00000100:00100000:3.0:1787826410.829167:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8605:1874668778719232:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826410.829191:0:8605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826410.830544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826410.830632:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.830724:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790015104 00000100:00100000:0.0:1787826410.830732:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790015104 00010000:00010000:0.0:1787826410.830771:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd256 expref: 27 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.830809:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790014976 00000100:00100000:0.0:1787826410.830812:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790014976 00010000:00010000:0.0:1787826410.830826:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b8 expref: 11 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.830876:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3206 00000100:00100000:0.0:1787826410.830886:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+27:2401:x1874668790015104:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826410.830900:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826410.830921:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd256 expref: 27 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.830933:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd256 expref: 27 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.830955:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd5d670f/0x68019081f349dc5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd256 expref: 27 pid: 19335 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.830975:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826410.831025:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2401:x1874668790015104:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 141us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.831033:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3206 00000100:00100000:0.0:1787826410.831065:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3207 00000100:00100000:0.0:1787826410.831072:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+11:2401:x1874668790014976:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826410.831080:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826410.831088:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b8 expref: 11 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831099:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b8 expref: 11 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831111:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349dcf4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd2b8 expref: 11 pid: 8433 timeout: 3148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831121:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.831125:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826410.831131:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831139:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831164:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826410.831183:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+10:2401:x1874668790014976:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 111us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.831193:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3207 00010000:00010000:0.0:1787826410.831213:0:8605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831221:0:8605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831238:0:8605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831246:0:8605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831252:0:8605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831257:0:8605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:0.0:1787826410.831261:0:8605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831268:0:8605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831279:0:8605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826410.831292:0:8605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349de52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826410.831334:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668790014848:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 4656us (5038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.831342:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6508 00000100:00100000:1.0:1787826410.835414:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.835504:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790015360 00000100:00100000:2.0:1787826410.835514:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790015360 00000100:00100000:2.0:1787826410.835576:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2790 00000100:00100000:2.0:1787826410.835585:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+123:87493:x1874668790015360:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:2.0:1787826410.835643:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000403:0x14f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349de44 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd670 expref: 123 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826410.835848:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016909 00000001:00080000:2.0:1787826410.836153:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016910 00010000:00010000:2.0:1787826410.836189:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.836204:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b9 expref: 98 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.836212:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd137 expref: 126 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.836219:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.836254:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd137 expref: 126 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.836267:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd137 expref: 126 pid: 8442 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.836281:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778719360:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.836376:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b9 expref: 98 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.836386:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b9 expref: 98 pid: 6516 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.836402:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778719488:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826410.836424:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe17885480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826410.839820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.839897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826410.839992:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778719360:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826410.840005:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1874668778719488:192.168.203.9@tcp:104: 00010000:00010000:2.0:1787826410.840031:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.840110:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790015616 00000100:00100000:1.0:1787826410.840116:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790015616 00010000:00010000:1.0:1787826410.840152:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b9 expref: 99 pid: 6516 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.840186:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790015488 00000100:00100000:1.0:1787826410.840189:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790015488 00010000:00010000:1.0:1787826410.840202:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd137 expref: 127 pid: 8442 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826410.840227:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3208 00000100:00100000:1.0:1787826410.840235:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+99:2401:x1874668790015616:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.840249:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.840255:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b9 expref: 99 pid: 6516 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840265:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b9 expref: 99 pid: 6516 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840285:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349d920 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd0b9 expref: 99 pid: 6516 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840298:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:1.0:1787826410.840303:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840311:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840318:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.840364:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+98:2401:x1874668790015616:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 129us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.840375:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3208 00000100:00100000:1.0:1787826410.840391:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3209 00000100:00100000:1.0:1787826410.840398:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+127:2401:x1874668790015488:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826410.840405:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826410.840409:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd137 expref: 127 pid: 8442 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840420:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd137 expref: 127 pid: 8442 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840433:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349da5b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd137 expref: 127 pid: 8442 timeout: 3148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840442:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:1.0:1787826410.840446:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840454:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840461:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826410.840479:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826410.840495:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+126:2401:x1874668790015488:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 98us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.840500:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3209 00010000:00010000:2.0:1787826410.840612:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.840619:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826410.840727:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016911 00000001:00080000:2.0:1787826410.840834:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016912 00000100:00100000:2.0:1787826410.840940:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778719616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826410.840989:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826410.841012:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0a1706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826410.841582:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778719616 00000100:00100000:3.0:1787826410.841588:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778719616 00000100:00100000:3.0:1787826410.841634:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3514 00000100:00100000:3.0:1787826410.841643:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6519:x1874668778719616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826410.841746:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a563c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6519:x1874668778719616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826410.841753:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3514 00000100:00100000:2.0:1787826410.842090:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778719616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826410.842214:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016913 00000100:00100000:2.0:1787826410.842267:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778719744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826410.842300:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826410.842328:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbf134e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826410.842481:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778719744 00000100:00100000:3.0:1787826410.842488:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778719744 00000100:00100000:3.0:1787826410.842525:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3515 00000100:00100000:3.0:1787826410.842540:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6519:x1874668778719744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826410.842660:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a561e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6519:x1874668778719744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (349us total) trans 4294968204 rc 0/0 00000100:00100000:3.0:1787826410.842667:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3515 00000100:00100000:2.0:1787826410.842784:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0a563840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1874668778719744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826410.842825:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016914 00010000:00010000:2.0:1787826410.842890:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.842901:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.842908:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.842915:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993cc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826410.842919:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.842927:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.842941:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:2.0:1787826410.842944:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826410.842948:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826410.842955:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de59 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826410.843145:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd2:0x55:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787826410.843194:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].46, 64 off11160 00000001:00080000:2.0:1787826410.843202:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8590016915 00010000:00010000:2.0:1787826410.843226:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe1342f100) 00010000:00010000:2.0:1787826410.843229:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826410.843236:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349de44 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x14f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd670 expref: 130 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826410.843327:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+129:87493:x1874668790015360:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 7743us (7923us total) trans 8590016916 rc 0/0 00000100:00100000:2.0:1787826410.843335:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2790 00000020:00080000:2.0:1787826410.843339:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1787826410.930208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826410.930298:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790015744 00000100:00100000:1.0:1787826410.930307:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790015744 00000100:00100000:1.0:1787826410.930372:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112012 00000100:00100000:1.0:1787826410.930382:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+98:87419:x1874668790015744:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787826410.930495:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+98:87419:x1874668790015744:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826410.930503:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112012 00000100:00100000:2.0:1787826410.936769:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826410.936928:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790015872 00000100:00100000:0.0:1787826410.936938:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790015872 00000100:00100000:0.0:1787826410.937015:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112013 00000100:00100000:0.0:1787826410.937026:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:87419:x1874668790015872:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787826410.937140:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a562940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:87419:x1874668790015872:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 116us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826410.937148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112013 00000100:00080000:3.0:1787826410.937887:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1787826411.008164:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826411.008174:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826411.008377:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9732 count 29 00000040:00080000:0.0:1787826411.008387:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1787826411.102320:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.102453:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790016000 00000100:00100000:0.0:1787826411.102463:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790016000 00000100:00100000:0.0:1787826411.102527:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112014 00000100:00100000:0.0:1787826411.102545:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+129:87513:x1874668790016000:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1787826411.102570:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.102591:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349de60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd677 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102669:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102683:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102706:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102722:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102730:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102737:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102796:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146000/0x68019081f349de75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102805:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146000/0x68019081f349de75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102812:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146000/0x68019081f349de75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826411.102846:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826411.102876:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826411.102924:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146000/0x68019081f349de75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102937:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102942:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102948:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102954:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102959:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826411.102963:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102969:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102980:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826411.102982:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826411.102986:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.102992:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349de67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103002:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103008:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103014:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103019:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826411.103021:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103027:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103033:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bbe16467300) 00010000:00010000:0.0:1787826411.103036:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826411.103050:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103056:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349de6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103085:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349de60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd677 expref: 131 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103100:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146000/0x68019081f349de75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd677 expref: 130 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.103107:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bbe0a651100) 00010000:00010000:0.0:1787826411.103110:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826411.103112:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf19146000, rc 0) 00000100:00100000:0.0:1787826411.103176:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+130:87513:x1874668790016000:12345-192.168.203.9@tcp:101:cat.0 Request processed in 633us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.103188:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112014 00000100:00100000:1.0:1787826411.113329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826411.113419:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790016128 00000100:00100000:3.0:1787826411.113428:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790016128 00000100:00100000:3.0:1787826411.113486:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112015 00000100:00100000:3.0:1787826411.113496:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+130:87513:x1874668790016128:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:3.0:1787826411.113516:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.113547:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349de7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd67e expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113612:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113626:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113636:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113663:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113672:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113679:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113736:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de91 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113745:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113753:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826411.113788:0:12105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1787826411.113792:0:12105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826411.113813:0:12105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113825:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113832:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113838:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113845:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113895:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.113900:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113908:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113920:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bbe0a651100) 00010000:00010000:3.0:1787826411.113923:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.113928:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113934:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349de83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113948:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113953:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113959:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113964:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.113966:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113971:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113978:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bbf14059400) 00010000:00010000:3.0:1787826411.113980:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.113983:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.113989:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349de8a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.114018:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349de7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd67e expref: 132 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.114032:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794600/0x68019081f349de91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd67e expref: 131 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.114039:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:3.0:1787826411.114041:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826411.114043:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794600, rc 0) 00000100:00100000:3.0:1787826411.114105:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+131:87513:x1874668790016128:12345-192.168.203.9@tcp:101:cat.0 Request processed in 610us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.114116:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112015 00000100:00100000:3.0:1787826411.137591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826411.137700:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790016256 00000100:00100000:2.0:1787826411.137709:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790016256 00000100:00100000:2.0:1787826411.137766:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112016 00000100:00100000:2.0:1787826411.137776:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+131:87512:x1874668790016256:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1787826411.137796:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.137816:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349de98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd685 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.137902:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.137917:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.137928:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.137943:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.137950:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.137957:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138014:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349dead lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138031:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349dead lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138038:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349dead lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826411.138078:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1787826411.138082:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826411.138103:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349dead lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138113:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138120:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138126:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138132:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993cc00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826411.138135:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138142:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138154:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bbe0a651100) 00010000:00010000:2.0:1787826411.138157:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826411.138162:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138168:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349de9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138181:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138187:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138193:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138197:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826411.138200:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138207:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138214:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bbe16cc5500) 00010000:00010000:2.0:1787826411.138217:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826411.138219:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138225:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349dea6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138256:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349de98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd685 expref: 133 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138273:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349dead lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd685 expref: 132 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.138280:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:2.0:1787826411.138283:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826411.138285:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d800, rc 0) 00000100:00100000:2.0:1787826411.138350:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+132:87512:x1874668790016256:12345-192.168.203.9@tcp:101:cat.0 Request processed in 575us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826411.138357:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112016 00000100:00100000:0.0:1787826411.142797:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826411.143029:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790016768 00000100:00100000:1.0:1787826411.143038:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790016768 00000100:00100000:1.0:1787826411.143110:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112017 00000100:00100000:1.0:1787826411.143120:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+132:87512:x1874668790016768:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:1.0:1787826411.143140:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.143160:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349deb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd693 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.143285:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349debb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.143299:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349debb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.143310:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349debb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826411.143321:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x148:0x0]: returning size 1516 00010000:00010000:1.0:1787826411.143439:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349deb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd693 expref: 135 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.143463:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349debb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd693 expref: 134 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.143471:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe1342f500) 00010000:00010000:1.0:1787826411.143474:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826411.143477:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7000, rc 0) 00000100:00100000:1.0:1787826411.143543:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+134:87512:x1874668790016768:12345-192.168.203.9@tcp:101:cat.0 Request processed in 425us (756us total) trans 8590016917 rc 0/0 00000100:00100000:1.0:1787826411.143551:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112017 00000001:00080000:3.0:1787826411.146218:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016917 is committed 00000020:00080000:3.0:1787826411.146238:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe15bab300 refcount 2 committed 0 result 0 batchid 4294970911 00000020:00080000:3.0:1787826411.146244:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe16055c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0a7cfcc0 00000020:00080000:3.0:1787826411.146247:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe16055200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0f95d600 00000020:00080000:3.0:1787826411.146283:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe16292480 refcount 2 committed 0 result 0 batchid 4294970910 00000020:00080000:3.0:1787826411.146287:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe07311000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0dd603c0 00000020:00080000:3.0:1787826411.146290:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe07311200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbf41220e00 00000020:00080000:3.0:1787826411.146312:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0dd60f00 refcount 2 committed 0 result 0 batchid 4294970909 00000020:00080000:3.0:1787826411.146316:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3d6c3a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0dd609c0 00000020:00080000:3.0:1787826411.146318:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe0709a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c166e00 00000020:00080000:3.0:1787826411.146333:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0dd60780 refcount 2 committed 0 result 0 batchid 4294970908 00000020:00080000:3.0:1787826411.146336:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09bd2b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0dd60c00 00000020:00080000:3.0:1787826411.146338:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09bd2d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0b95ec00 00000020:00080000:3.0:1787826411.146354:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe134b2240 refcount 2 committed 0 result 0 batchid 4294970907 00000020:00080000:3.0:1787826411.146356:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe07206600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe134b2c00 00000020:00080000:3.0:1787826411.146359:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf1168bd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0e942e00 00000020:00080000:3.0:1787826411.146375:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0dd60cc0 refcount 2 committed 0 result 0 batchid 4294970906 00000020:00080000:3.0:1787826411.146378:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09bd2800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0dd60600 00000020:00080000:3.0:1787826411.146381:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09bd2e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe17545a00 00000004:00080000:3.0:1787826411.146395:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 26 committed 00000020:00080000:3.0:1787826411.146417:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe0c1b4e40 refcount 2 committed 0 result 0 batchid 4294970905 00000020:00080000:3.0:1787826411.146420:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09bd2200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0c1b4a80 00000020:00080000:3.0:1787826411.146423:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbe09bd2000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe15806800 00000004:00080000:3.0:1787826411.146433:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 29 committed 00000020:00080000:3.0:1787826411.146443:0:38181:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bbe1272ed80 refcount 2 committed 0 result 0 batchid 4294970904 00000020:00080000:3.0:1787826411.146446:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3d6c3b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe1272e0c0 00000020:00080000:3.0:1787826411.146449:0:38181:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bbf3d6c3200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bbe0d7d6a00 00000001:00080000:3.0:1787826411.146470:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016842 is committed 00010000:00010000:3.0:1787826411.146572:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146584:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146591:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146598:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.146602:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146611:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146627:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xde9470f2 (ffff9bbe16cc5600) 00010000:00010000:3.0:1787826411.146630:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.146635:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146643:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea800/0x68019081f349d48f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xde9470f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146682:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146688:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146694:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146699:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41205600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.146702:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146708:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146715:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x7481f5ae (ffff9bbe16467c00) 00010000:00010000:3.0:1787826411.146717:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.146720:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146726:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205600/0x68019081f349d529 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0x7481f5ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146755:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146762:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146768:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146773:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe16606e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.146775:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146781:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146789:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xc8f218d (ffff9bbf14059500) 00010000:00010000:3.0:1787826411.146792:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.146795:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146801:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe16606e00/0x68019081f349d5c3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xc8f218d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146817:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146823:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146829:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146833:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cea400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.146836:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146845:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146879:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xa9df8504 (ffff9bbe16cc5c00) 00010000:00010000:3.0:1787826411.146881:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.146884:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146889:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cea400/0x68019081f349d65d lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xa9df8504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146904:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146910:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146916:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146921:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf094a3600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.146923:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146929:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146935:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xaab21ffe (ffff9bbf14059600) 00010000:00010000:3.0:1787826411.146938:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.146941:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146946:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf094a3600/0x68019081f349d736 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xaab21ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146968:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146975:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146981:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146987:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.146990:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.146995:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147003:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x761ac3a8 (ffff9bbe16cc5200) 00010000:00010000:3.0:1787826411.147006:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.147009:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147014:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349d7e5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0x761ac3a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147030:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147035:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147051:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147057:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe17203200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.147059:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147066:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147084:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0xf457de12 (ffff9bbe16467000) 00010000:00010000:3.0:1787826411.147087:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.147089:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147095:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe17203200/0x68019081f349d87f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0xf457de12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147110:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147117:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147122:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147126:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993c800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826411.147129:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147138:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147146:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x2e415c5a (ffff9bbe1342fc00) 00010000:00010000:3.0:1787826411.147148:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.147151:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.147156:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349d919 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0x2e415c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826411.147309:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294970911 committed batchid 4294970903 00000020:00080000:2.0:1787826411.147370:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970903 00000100:00100000:2.0:1787826411.147784:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778719872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787826411.147878:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826411.147939:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826411.147945:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778720000:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826411.147971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826411.148004:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778719872 00000100:00100000:2.0:1787826411.148011:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778719872 00000100:00100000:2.0:1787826411.148066:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778720000 00000100:00100000:2.0:1787826411.148069:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778720000 00000100:00100000:2.0:1787826411.148092:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6509 00000100:00100000:2.0:1787826411.148100:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3645:x1874668778719872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787826411.148126:0:45681:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:212 count 1 00002000:00010000:2.0:1787826411.148157:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd4:0x0] initial LVB size: 1516, mtime: 0x6a9010e6, atime: 0x0, ctime: 0x6a9010e6, blocks: 0x8 00010000:00010000:2.0:1787826411.148164:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148180:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=3049s v=(0 0) 00010000:00010000:2.0:1787826411.148184:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826411.148190:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148205:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148214:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148221:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148237:0:45681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826411.148378:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3645:x1874668778719872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 278us (526us total) trans 4294968205 rc 0/0 00000100:00100000:2.0:1787826411.148386:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6509 00000100:00100000:2.0:1787826411.148404:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6510 00000100:00100000:2.0:1787826411.148411:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3645:x1874668778720000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826411.148425:0:45681:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:211 count 1 00002000:00010000:2.0:1787826411.148444:0:45681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd3:0x0] initial LVB size: 1516, mtime: 0x6a9010e6, atime: 0x0, ctime: 0x6a9010e6, blocks: 0x8 00010000:00010000:2.0:1787826411.148449:0:45681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148463:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=3049s v=(0 0) 00010000:00010000:2.0:1787826411.148466:0:45681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826411.148470:0:45681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148480:0:45681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148487:0:45681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148494:0:45681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148508:0:45681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1787826411.148597:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3645:x1874668778720000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 186us (624us total) trans 4294968220 rc 0/0 00000100:00100000:2.0:1787826411.148603:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6510 00010000:00010000:2.0:1787826411.148823:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826411.148829:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148838:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993d600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826411.148841:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148878:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148894:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148902:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1595ca3/0x68019081f349dec9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148920:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826411.148924:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148930:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe0993de00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826411.148933:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148941:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148950:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148958:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015699e59/0x68019081f349ded0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 45681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.148974:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826411.148975:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826411.148977:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826411.148983:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826411.148992:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826411.148996:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787826411.149031:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0dbc6580/2, rc 0, transno 4294968220 00000100:00100000:2.0:1787826411.149053:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778720000:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787826411.149067:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe0dbc70c0/2, rc 0, transno 4294968205 00000100:00100000:2.0:1787826411.149074:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778719872:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787826411.149202:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149212:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149219:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149224:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09ceb000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826411.149228:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149235:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149245:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbaabd53a (ffff9bbe16cc5b00) 00010000:00010000:0.0:1787826411.149248:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826411.149252:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149258:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceb000/0x68019081f349d3b6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbaabd53a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149285:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149292:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149299:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149304:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe09cebe00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826411.149306:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149312:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149320:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9bbe16cc5400) 00010000:00010000:0.0:1787826411.149323:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826411.149325:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.149331:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09cebe00/0x68019081f349d3bd lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826411.158557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826411.158599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826411.158631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826411.158669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826411.158688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826411.158715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826411.158744:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790017152 00000100:00100000:1.0:1787826411.158753:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790017152 00000100:00100000:1.0:1787826411.158820:0:45686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17310 00000100:00100000:1.0:1787826411.158830:0:45686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fa787581-6963-4f39-b38f-836255c71d7c+55:2402:x1874668790017152:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826411.158847:0:45686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826411.158906:0:45686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d800/0x68019081f349dead lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd685 expref: 55 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.158927:0:45686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:1.0:1787826411.158932:0:45686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826411.158986:0:45686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fa787581-6963-4f39-b38f-836255c71d7c+54:2402:x1874668790017152:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 157us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.158993:0:45686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17310 00000100:00100000:2.0:1787826411.159153:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790016512 00000100:00100000:2.0:1787826411.159158:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790016512 00000100:00100000:2.0:1787826411.159193:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790017408 00000100:00100000:2.0:1787826411.159196:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790017408 00000100:00100000:2.0:1787826411.159213:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790017664 00000100:00100000:2.0:1787826411.159216:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790017664 00000100:00100000:2.0:1787826411.159231:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790017024 00000100:00100000:2.0:1787826411.159235:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790017024 00000100:00100000:2.0:1787826411.159248:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790017920 00000100:00100000:2.0:1787826411.159250:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790017920 00000100:00100000:2.0:1787826411.159268:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112018 00000100:00100000:2.0:1787826411.159275:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+58:87513:x1874668790016512:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1787826411.159292:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.159307:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349ded7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd68c expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159413:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dede lrc: 3/1,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159426:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dede lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159437:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dede lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826411.159447:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x149:0x0]: returning size 1516 00010000:00010000:2.0:1787826411.159556:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993de00/0x68019081f349ded7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd68c expref: 61 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159570:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dede lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd68c expref: 60 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159578:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:2.0:1787826411.159581:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826411.159584:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993d600, rc 0) 00000100:00100000:2.0:1787826411.159611:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+60:87513:x1874668790016512:12345-192.168.203.9@tcp:101:cat.0 Request processed in 337us (1065us total) trans 8590016918 rc 0/0 00000100:00100000:2.0:1787826411.159619:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112018 00000100:00100000:2.0:1787826411.159634:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112019 00000100:00100000:2.0:1787826411.159641:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+59:87519:x1874668790017408:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1787826411.159660:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.159669:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349deec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd6a1 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159721:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349def3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159734:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349def3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159741:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349def3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826411.159749:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14f:0x0]: returning size 1516 00010000:00010000:2.0:1787826411.159793:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993cc00/0x68019081f349deec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6a1 expref: 62 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159805:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349def3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6a1 expref: 61 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159812:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe16cc5500) 00010000:00010000:2.0:1787826411.159814:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826411.159816:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe0993c800, rc 0) 00000100:00100000:2.0:1787826411.159836:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+61:87519:x1874668790017408:12345-192.168.203.9@tcp:101:cat.0 Request processed in 195us (1236us total) trans 8590016919 rc 0/0 00000100:00100000:2.0:1787826411.159842:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112019 00000100:00100000:2.0:1787826411.159892:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112020 00000100:00100000:2.0:1787826411.159901:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+60:87515:x1874668790017664:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1787826411.159909:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.159918:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349df01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd6a8 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159962:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349df08 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159975:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349df08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.159983:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349df08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826411.159991:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14b:0x0]: returning size 1516 00010000:00010000:2.0:1787826411.160033:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349df01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6a8 expref: 63 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160128:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349df08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6a8 expref: 62 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160136:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:2.0:1787826411.160138:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826411.160140:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2400, rc 0) 00000100:00100000:2.0:1787826411.160162:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+62:87515:x1874668790017664:12345-192.168.203.9@tcp:101:cat.0 Request processed in 263us (1530us total) trans 8590016920 rc 0/0 00000100:00100000:2.0:1787826411.160168:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112020 00000100:00100000:2.0:1787826411.160182:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112021 00000100:00100000:2.0:1787826411.160189:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+61:87514:x1874668790017024:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1787826411.160198:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.160205:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349df16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd69a expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160249:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349df1d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160263:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349df1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160270:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349df1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826411.160279:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14a:0x0]: returning size 1516 00010000:00010000:2.0:1787826411.160324:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349df16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd69a expref: 64 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160337:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349df1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd69a expref: 63 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160344:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbe16cc5300) 00010000:00010000:2.0:1787826411.160347:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826411.160349:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3400, rc 0) 00000100:00100000:2.0:1787826411.160372:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+63:87514:x1874668790017024:12345-192.168.203.9@tcp:101:cat.0 Request processed in 184us (1703us total) trans 8590016921 rc 0/0 00000100:00100000:2.0:1787826411.160379:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112021 00000100:00100000:2.0:1787826411.160392:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112022 00000100:00100000:2.0:1787826411.160400:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+62:87516:x1874668790017920:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1787826411.160408:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.160415:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349df2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd6af expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160459:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349df32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160472:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349df32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160479:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349df32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826411.160487:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14c:0x0]: returning size 1516 00010000:00010000:2.0:1787826411.160532:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349df2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6af expref: 65 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160545:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349df32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6af expref: 64 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.160552:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbe16cc5f00) 00010000:00010000:2.0:1787826411.160554:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826411.160556:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2600, rc 0) 00000100:00100000:2.0:1787826411.160579:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+64:87516:x1874668790017920:12345-192.168.203.9@tcp:101:cat.0 Request processed in 180us (1863us total) trans 8590016922 rc 0/0 00000100:00100000:2.0:1787826411.160586:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112022 00000100:00100000:0.0:1787826411.172106:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.172178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.172212:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.174445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.174492:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790018432 00000100:00100000:0.0:1787826411.174501:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790018432 00000100:00100000:0.0:1787826411.174559:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790018688 00000100:00100000:0.0:1787826411.174562:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790018688 00000100:00100000:0.0:1787826411.174580:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790018944 00000100:00100000:0.0:1787826411.174583:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790018944 00000100:00100000:0.0:1787826411.174607:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17311 00000100:00100000:0.0:1787826411.174616:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+66:87512:x1874668790018432:12345-192.168.203.9@tcp:103:cat.0 00010000:00010000:0.0:1787826411.174634:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826411.174668:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349debb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd693 expref: 66 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.174687:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe1342f500) 00010000:00010000:0.0:1787826411.174701:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826411.174755:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+65:87512:x1874668790018432:12345-192.168.203.9@tcp:103:cat.0 Request processed in 139us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.174762:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17311 00000100:00100000:0.0:1787826411.174781:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17312 00000100:00100000:0.0:1787826411.174787:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c7df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+64:87513:x1874668790018688:12345-192.168.203.9@tcp:103:cat.0 00010000:00010000:0.0:1787826411.174794:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826411.174804:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993d600/0x68019081f349dede lrc: 0/0,0 mode: --/PR res: [0x200000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd68c expref: 64 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.174815:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16cc5e00) 00010000:00010000:0.0:1787826411.174821:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826411.174838:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c7df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+63:87513:x1874668790018688:12345-192.168.203.9@tcp:103:cat.0 Request processed in 52us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.174843:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17312 00000100:00100000:0.0:1787826411.174914:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17313 00000100:00100000:0.0:1787826411.174922:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+62:87515:x1874668790018944:12345-192.168.203.9@tcp:103:cat.0 00010000:00010000:0.0:1787826411.174930:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826411.174941:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349df08 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6a8 expref: 62 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.174957:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16cc5900) 00010000:00010000:0.0:1787826411.174964:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826411.174982:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+61:87515:x1874668790018944:12345-192.168.203.9@tcp:103:cat.0 Request processed in 61us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.174988:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17313 00000100:00100000:2.0:1787826411.177972:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790018176 00000100:00100000:2.0:1787826411.177986:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790018176 00000100:00100000:2.0:1787826411.178098:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112023 00000100:00100000:2.0:1787826411.178108:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+61:87517:x1874668790018176:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1787826411.178130:0:7736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.178150:0:7736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349df40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd6b6 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.178265:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349df47 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.178354:0:7736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349df47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.178364:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349df47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826411.178375:0:7736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14d:0x0]: returning size 1516 00010000:00010000:2.0:1787826411.178478:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349df40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6b6 expref: 64 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.178495:0:7736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349df47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6b6 expref: 63 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.178503:0:7736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5000) 00010000:00010000:2.0:1787826411.178506:0:7736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826411.178510:0:7736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:2.0:1787826411.179036:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa787581-6963-4f39-b38f-836255c71d7c+63:87517:x1874668790018176:12345-192.168.203.9@tcp:101:cat.0 Request processed in 927us (6937us total) trans 8590016923 rc 0/0 00000100:00100000:2.0:1787826411.179044:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112023 00000100:00100000:3.0:1787826411.179164:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.179341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.179367:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790019200 00000100:00100000:0.0:1787826411.179372:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790019200 00000100:00100000:0.0:1787826411.179421:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17314 00000100:00100000:0.0:1787826411.179429:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+63:87514:x1874668790019200:12345-192.168.203.9@tcp:103:cat.0 00010000:00010000:0.0:1787826411.179441:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826411.179461:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3400/0x68019081f349df1d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd69a expref: 63 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.179474:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbe16cc5300) 00010000:00010000:0.0:1787826411.179482:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826411.179503:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+62:87514:x1874668790019200:12345-192.168.203.9@tcp:103:cat.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.179509:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17314 00000100:00100000:0.0:1787826411.179569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.179617:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.179633:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790019712 00000100:00100000:0.0:1787826411.179637:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790019712 00000100:00100000:0.0:1787826411.179668:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790019456 00000100:00100000:0.0:1787826411.179671:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790019456 00000100:00100000:0.0:1787826411.179704:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17315 00000100:00100000:0.0:1787826411.179712:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+63:87516:x1874668790019712:12345-192.168.203.9@tcp:103:cat.0 00010000:00010000:0.0:1787826411.179719:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826411.179729:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349df32 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6af expref: 63 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.179741:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbe16cc5f00) 00010000:00010000:0.0:1787826411.179747:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826411.179769:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+62:87516:x1874668790019712:12345-192.168.203.9@tcp:103:cat.0 Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.179777:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17315 00000100:00100000:0.0:1787826411.179790:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17316 00000100:00100000:0.0:1787826411.179796:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+61:87519:x1874668790019456:12345-192.168.203.9@tcp:103:cat.0 00010000:00010000:0.0:1787826411.179804:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826411.179816:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe0993c800/0x68019081f349def3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6a1 expref: 61 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.179827:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe16cc5500) 00010000:00010000:0.0:1787826411.179832:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826411.179869:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+60:87519:x1874668790019456:12345-192.168.203.9@tcp:103:cat.0 Request processed in 54us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.179876:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17316 00000100:00100000:0.0:1787826411.179928:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.180428:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790020096 00000100:00100000:0.0:1787826411.180434:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790020096 00000100:00100000:0.0:1787826411.180466:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3516 00000100:00100000:0.0:1787826411.180473:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+60:2399:x1874668790020096:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826411.180525:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.180539:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146a00/0x68019081f349df55 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd6bd expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180584:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180596:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180605:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180617:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180625:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180631:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180644:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180661:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180668:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180674:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826411.180679:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180687:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180707:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826411.180710:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826411.180714:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180721:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146c00/0x68019081f349df5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180732:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180738:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180743:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180748:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826411.180751:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180756:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180764:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8dc2c7cc (ffff9bbe16467300) 00010000:00010000:0.0:1787826411.180766:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826411.180770:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180776:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146800/0x68019081f349df63 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8dc2c7cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180800:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146a00/0x68019081f349df55 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6bd expref: 61 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180810:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bbe0812c200) 00010000:00010000:0.0:1787826411.180812:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826411.180816:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146a00/0x68019081f349df55 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6bd expref: 61 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.180824:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf19146a00, rc -2) 00000100:00100000:0.0:1787826411.180880:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+60:2399:x1874668790020096:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 407us (1716us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826411.180888:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3516 00000100:00100000:1.0:1787826411.181105:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790019968 00000100:00100000:1.0:1787826411.181109:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790019968 00000100:00100000:1.0:1787826411.181151:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112024 00000100:00100000:1.0:1787826411.181159:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+60:87518:x1874668790019968:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:1.0:1787826411.181169:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.181180:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349df6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd6e0 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.181253:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349df71 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.181263:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349df71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.181272:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349df71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826411.181281:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x14e:0x0]: returning size 1516 00010000:00010000:1.0:1787826411.181369:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349df6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6e0 expref: 63 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.181383:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349df71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6e0 expref: 62 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.181391:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe1342f900) 00010000:00010000:1.0:1787826411.181393:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826411.181396:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6000, rc 0) 00000100:00100000:1.0:1787826411.181427:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+62:87518:x1874668790019968:12345-192.168.203.9@tcp:101:cat.0 Request processed in 269us (1499us total) trans 8590016924 rc 0/0 00000100:00100000:1.0:1787826411.181433:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112024 00000100:00100000:0.0:1787826411.187117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.187157:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.187191:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.187256:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.187284:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790020224 00000100:00100000:0.0:1787826411.187292:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790020224 00000100:00100000:0.0:1787826411.187338:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790020352 00000100:00100000:0.0:1787826411.187341:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790020352 00000100:00100000:0.0:1787826411.187358:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790020736 00000100:00100000:0.0:1787826411.187361:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790020736 00000100:00100000:0.0:1787826411.187380:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112025 00000100:00100000:0.0:1787826411.187389:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+64:87513:x1874668790020224:12345-192.168.203.9@tcp:58:cat.0 00010000:00010000:0.0:1787826411.187504:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.187520:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.187531:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826411.187624:0:45683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9732, 136 off1315208 00000100:00100000:0.0:1787826411.187713:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+64:87513:x1874668790020224:12345-192.168.203.9@tcp:58:cat.0 Request processed in 324us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.187721:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112025 00000100:00100000:0.0:1787826411.187742:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112026 00000100:00100000:0.0:1787826411.187749:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+63:87512:x1874668790020352:12345-192.168.203.9@tcp:58:cat.0 00010000:00010000:0.0:1787826411.187795:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.187803:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.187811:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826411.187841:0:45683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9733, 136 off1315344 00000100:00100000:0.0:1787826411.187898:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+63:87512:x1874668790020352:12345-192.168.203.9@tcp:58:cat.0 Request processed in 150us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.187905:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112026 00000100:00100000:0.0:1787826411.187919:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112027 00000100:00100000:0.0:1787826411.187927:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+62:87515:x1874668790020736:12345-192.168.203.9@tcp:58:cat.0 00010000:00010000:0.0:1787826411.187964:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.187976:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.187983:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826411.188011:0:45683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9734, 136 off1315480 00000100:00100000:0.0:1787826411.188042:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+62:87515:x1874668790020736:12345-192.168.203.9@tcp:58:cat.0 Request processed in 115us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.188050:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112027 00000100:00100000:3.0:1787826411.199364:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790020608 00000100:00100000:3.0:1787826411.199378:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790020608 00000100:00100000:3.0:1787826411.199489:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17317 00000100:00100000:3.0:1787826411.199500:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+62:87517:x1874668790020608:12345-192.168.203.9@tcp:103:cat.0 00010000:00010000:3.0:1787826411.199517:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826411.199542:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349df47 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6b6 expref: 62 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.199563:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe16cc5000) 00010000:00010000:3.0:1787826411.199576:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826411.199653:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa787581-6963-4f39-b38f-836255c71d7c+61:87517:x1874668790020608:12345-192.168.203.9@tcp:103:cat.0 Request processed in 148us (12453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.199661:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17317 00000100:00100000:0.0:1787826411.199749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.199886:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.199905:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790020864 00000100:00100000:0.0:1787826411.199909:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790020864 00000100:00100000:0.0:1787826411.199938:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790020992 00000100:00100000:0.0:1787826411.199941:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790020992 00000100:00100000:0.0:1787826411.199965:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112028 00000100:00100000:0.0:1787826411.199973:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+62:87514:x1874668790020864:12345-192.168.203.9@tcp:58:cat.0 00010000:00010000:0.0:1787826411.200068:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.200082:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.200092:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826411.200177:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9735, 136 off1315616 00000100:00100000:0.0:1787826411.200225:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+62:87514:x1874668790020864:12345-192.168.203.9@tcp:58:cat.0 Request processed in 253us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.200232:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112028 00000100:00100000:0.0:1787826411.200247:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112029 00000100:00100000:0.0:1787826411.200253:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+61:87519:x1874668790020992:12345-192.168.203.9@tcp:58:cat.0 00010000:00010000:0.0:1787826411.200297:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.200306:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.200313:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826411.200342:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9736, 136 off1315752 00000100:00100000:0.0:1787826411.200374:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+61:87519:x1874668790020992:12345-192.168.203.9@tcp:58:cat.0 Request processed in 120us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.200380:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112029 00000100:00100000:0.0:1787826411.203812:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.203908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826411.203980:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790021376 00000100:00100000:1.0:1787826411.203990:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790021376 00000100:00100000:1.0:1787826411.204051:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17318 00000100:00100000:1.0:1787826411.204063:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+61:87518:x1874668790021376:12345-192.168.203.9@tcp:103:cat.0 00010000:00010000:1.0:1787826411.204077:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826411.204101:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349df71 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6e0 expref: 61 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.204118:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe1342f900) 00010000:00010000:1.0:1787826411.204127:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826411.204182:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa787581-6963-4f39-b38f-836255c71d7c+60:87518:x1874668790021376:12345-192.168.203.9@tcp:103:cat.0 Request processed in 121us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.204189:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17318 00000100:00100000:2.0:1787826411.204297:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790021120 00000100:00100000:2.0:1787826411.204301:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790021120 00000100:00100000:2.0:1787826411.204337:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112030 00000100:00100000:2.0:1787826411.204344:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+60:87516:x1874668790021120:12345-192.168.203.9@tcp:58:cat.0 00010000:00010000:2.0:1787826411.204437:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.204450:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.204459:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826411.204546:0:45683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9737, 136 off1315888 00000100:00100000:2.0:1787826411.204590:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+60:87516:x1874668790021120:12345-192.168.203.9@tcp:58:cat.0 Request processed in 246us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826411.204596:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112030 00000100:00100000:3.0:1787826411.210349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826411.210464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826411.218815:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790021632 00000100:00100000:1.0:1787826411.218832:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790021632 00000100:00100000:1.0:1787826411.218911:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790021760 00000100:00100000:1.0:1787826411.218915:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790021760 00000100:00100000:1.0:1787826411.218946:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112031 00000100:00100000:1.0:1787826411.218958:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+61:87513:x1874668790021632:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:1.0:1787826411.218984:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.219006:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349dfa9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd703 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.219063:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.219075:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349dfa9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd703 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.219093:0:6517:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.219107:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349dfa9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd703 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.219121:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467400) 00010000:00010000:1.0:1787826411.219124:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826411.219128:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349dfa9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd703 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.219135:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7000, rc 0) 00000100:00100000:1.0:1787826411.219193:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+62:87513:x1874668790021632:12345-192.168.203.9@tcp:101:cat.0 Request processed in 238us (8854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.219200:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112031 00000100:00100000:1.0:1787826411.219221:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112032 00000100:00100000:1.0:1787826411.219228:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+61:87517:x1874668790021760:12345-192.168.203.9@tcp:58:cat.0 00010000:00010000:1.0:1787826411.219303:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.219314:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.219325:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826411.219409:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9738, 136 off1316024 00000100:00100000:1.0:1787826411.219448:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa787581-6963-4f39-b38f-836255c71d7c+61:87517:x1874668790021760:12345-192.168.203.9@tcp:58:cat.0 Request processed in 220us (8983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.219456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112032 00000100:00100000:0.0:1787826411.219918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.219982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.220063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.220086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.220104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.220125:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.220147:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790021504 00000100:00100000:0.0:1787826411.220152:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790021504 00000100:00100000:0.0:1787826411.220176:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790021888 00000100:00100000:0.0:1787826411.220179:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790021888 00000100:00100000:0.0:1787826411.220191:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790022016 00000100:00100000:0.0:1787826411.220193:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790022016 00000100:00100000:0.0:1787826411.220204:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790022144 00000100:00100000:0.0:1787826411.220207:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790022144 00000100:00100000:0.0:1787826411.220215:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790022272 00000100:00100000:0.0:1787826411.220217:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790022272 00000100:00100000:0.0:1787826411.220226:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790022400 00000100:00100000:0.0:1787826411.220228:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790022400 00000100:00100000:0.0:1787826411.220240:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112033 00000100:00100000:0.0:1787826411.220247:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+66:87512:x1874668790021504:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1787826411.220257:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.220271:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5e00/0x68019081f349dfb7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd6fc expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220304:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220313:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5e00/0x68019081f349dfb7 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6fc expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220327:0:12105:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220338:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5e00/0x68019081f349dfb7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6fc expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220349:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16467500) 00010000:00010000:0.0:1787826411.220352:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826411.220355:0:12105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5e00/0x68019081f349dfb7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6fc expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220362:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe08bf5e00, rc 0) 00000100:00100000:0.0:1787826411.220392:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+67:87512:x1874668790021504:12345-192.168.203.9@tcp:101:cat.0 Request processed in 145us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.220398:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112033 00000100:00100000:0.0:1787826411.220414:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112034 00000100:00100000:0.0:1787826411.220421:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+66:87515:x1874668790021888:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1787826411.220430:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.220439:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4a00/0x68019081f349dfbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd70a expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220460:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220468:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4a00/0x68019081f349dfbe lrc: 4/0,0 mode: --/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd70a expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220479:0:12105:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220488:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4a00/0x68019081f349dfbe lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd70a expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220496:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16467900) 00010000:00010000:0.0:1787826411.220498:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826411.220502:0:12105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4a00/0x68019081f349dfbe lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd70a expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220509:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe08bf4a00, rc 0) 00000100:00100000:0.0:1787826411.220531:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+67:87515:x1874668790021888:12345-192.168.203.9@tcp:101:cat.0 Request processed in 111us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.220537:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112034 00000100:00100000:0.0:1787826411.220551:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112035 00000100:00100000:0.0:1787826411.220558:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+66:87519:x1874668790022016:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1787826411.220565:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.220574:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5a00/0x68019081f349dfc5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd711 expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220596:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220605:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5a00/0x68019081f349dfc5 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd711 expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220615:0:12105:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220624:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5a00/0x68019081f349dfc5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd711 expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.220633:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe16467800) 00010000:00010000:0.0:1787826411.220635:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826411.220638:0:12105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5a00/0x68019081f349dfc5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd711 expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.221816:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112036 00000100:00100000:3.0:1787826411.221833:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+67:87514:x1874668790022144:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:3.0:1787826411.221847:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.221968:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dfcc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd718 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222009:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222019:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dfcc lrc: 4/0,0 mode: --/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd718 expref: 68 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222034:0:25756:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222047:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dfcc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd718 expref: 68 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222059:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbe16467f00) 00010000:00010000:3.0:1787826411.222062:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826411.222066:0:25756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dfcc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd718 expref: 68 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222073:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794000, rc 0) 00000100:00100000:3.0:1787826411.222111:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+68:87514:x1874668790022144:12345-192.168.203.9@tcp:101:cat.0 Request processed in 285us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.222118:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112036 00000100:00100000:3.0:1787826411.222141:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112037 00000100:00100000:3.0:1787826411.222148:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+67:87518:x1874668790022272:12345-192.168.203.9@tcp:58:cat.0 00010000:00010000:3.0:1787826411.222217:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222226:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222236:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826411.222326:0:25756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9739, 136 off1316160 00000100:00100000:3.0:1787826411.222365:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+67:87518:x1874668790022272:12345-192.168.203.9@tcp:58:cat.0 Request processed in 217us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.222372:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112037 00000100:00100000:3.0:1787826411.222385:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112038 00000100:00100000:3.0:1787826411.222392:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+66:87516:x1874668790022400:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:3.0:1787826411.222399:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.222408:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dfda lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd71f expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222428:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222435:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dfda lrc: 4/0,0 mode: --/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd71f expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222444:0:25756:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222456:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dfda lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd71f expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222464:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:3.0:1787826411.222466:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826411.222469:0:25756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dfda lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd71f expref: 67 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.222475:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794200, rc 0) 00000100:00100000:3.0:1787826411.222493:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+67:87516:x1874668790022400:12345-192.168.203.9@tcp:101:cat.0 Request processed in 102us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.222498:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112038 00010000:00010000:0.0:1787826411.222780:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe08bf5a00, rc 0) 00000100:00100000:0.0:1787826411.222808:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0810ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+66:87519:x1874668790022016:12345-192.168.203.9@tcp:101:cat.0 Request processed in 2251us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.222814:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112035 00000100:00100000:0.0:1787826411.222892:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826411.223019:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790022528 00000100:00100000:0.0:1787826411.223027:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790022528 00000100:00100000:0.0:1787826411.223061:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112039 00000100:00100000:0.0:1787826411.223067:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+66:87517:x1874668790022528:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1787826411.223076:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.223087:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4e00/0x68019081f349dfe1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd726 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.223117:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.223125:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4e00/0x68019081f349dfe1 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd726 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.223137:0:6515:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.223146:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4e00/0x68019081f349dfe1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd726 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.223156:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe1342f400) 00010000:00010000:0.0:1787826411.223159:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826411.223163:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4e00/0x68019081f349dfe1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd726 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.223170:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe08bf4e00, rc 0) 00000100:00100000:0.0:1787826411.223195:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+67:87517:x1874668790022528:12345-192.168.203.9@tcp:101:cat.0 Request processed in 128us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.223202:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112039 00000100:00100000:0.0:1787826411.225371:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826411.225452:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790022656 00000100:00100000:2.0:1787826411.225460:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790022656 00000100:00100000:2.0:1787826411.225509:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112040 00000100:00100000:2.0:1787826411.225518:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+67:87518:x1874668790022656:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1787826411.225543:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.225562:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349dfe8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd72d expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.225604:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.225613:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349dfe8 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd72d expref: 68 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.225629:0:12105:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.225643:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349dfe8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd72d expref: 68 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.225667:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:2.0:1787826411.225670:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826411.225674:0:12105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349dfe8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd72d expref: 68 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.225680:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3200, rc 0) 00000100:00100000:2.0:1787826411.225744:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+68:87518:x1874668790022656:12345-192.168.203.9@tcp:101:cat.0 Request processed in 226us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826411.225750:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112040 00000100:00100000:3.0:1787826411.328060:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778720128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826411.328134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.328370:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778720128 00000100:00100000:1.0:1787826411.328377:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778720128 00000100:00100000:1.0:1787826411.328433:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3517 00000100:00100000:1.0:1787826411.328443:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778720128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826411.328476:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1787826411.328536:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778720128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.328544:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3517 00000100:00100000:1.0:1787826411.328589:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778720128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826411.332373:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778720256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826411.332448:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.333930:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778720256 00000100:00100000:1.0:1787826411.333940:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778720256 00000100:00100000:1.0:1787826411.333997:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3518 00000100:00100000:1.0:1787826411.334006:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778720256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826411.334052:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440509952 avail 1294270464 00000100:00100000:1.0:1787826411.334127:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778720256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.334135:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3518 00000100:00100000:1.0:1787826411.334190:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778720256:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826411.397396:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826411.841285:0:38203:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3049952430030ns, next at 3050952427360ns, rc = 0 00000100:00100000:1.0:1787826411.841319:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0aa95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778720384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826411.841384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.841456:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778720384 00000100:00100000:1.0:1787826411.841463:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778720384 00000100:00100000:1.0:1787826411.841508:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00100000:1.0:1787826411.841516:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3645:x1874668778720384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826411.841543:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570248640 pending 114688 free 3828535296 avail 3597012992 00000100:00100000:1.0:1787826411.841584:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3645:x1874668778720384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.841591:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00100000:1.0:1787826411.841637:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0aa95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778720384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826411.843286:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778720512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826411.843344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787826411.843439:0:38205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3049954585354ns, next at 3050954582371ns, rc = 0 00000100:00100000:3.0:1787826411.844883:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778720512 00000100:00100000:3.0:1787826411.844894:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778720512 00000100:00100000:3.0:1787826411.844953:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00100000:3.0:1787826411.844965:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3646:x1874668778720512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826411.844996:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 671100352 pending 114688 free 3894710272 avail 3663187968 00000100:00100000:3.0:1787826411.850265:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3646:x1874668778720512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5290us (6908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.850282:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00100000:1.0:1787826411.850971:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778720512:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787826412.032240:0:59408:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826412.032249:0:59408:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00010000:00010000:2.0:1787826412.032481:0:59408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.032492:0:59408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.032501:0:59408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.032508:0:59408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19147400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826412.032513:0:59408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.032533:0:59408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.032554:0:59408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x149:0x0].0x0 (ffff9bbe16467400) 00010000:00010000:2.0:1787826412.032558:0:59408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826412.032567:0:59408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349dfa9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd703 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.032579:0:59408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349dfa9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd703 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.032589:0:59408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349dfa9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd703 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.032683:0:59408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7000/0x68019081f349dfa9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd703 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.032701:0:59408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41060000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778720640:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826412.032839:0:59408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826412.037735:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826412.037831:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790022784 00000100:00100000:1.0:1787826412.037840:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790022784 00000100:00100000:1.0:1787826412.037943:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2791 00000100:00100000:1.0:1787826412.037954:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+68:87513:x1874668790022784:12345-192.168.203.9@tcp:49:cat.0 00000100:00100000:1.0:1787826412.038080:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+68:87513:x1874668790022784:12345-192.168.203.9@tcp:49:cat.0 Request processed in 129us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.038089:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2791 00000100:00080000:3.0:1787826412.038217:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826412.038600:0:59408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41060000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778720640:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826412.038625:0:59408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038635:0:59408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19147400/0x68019081f349df7f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038729:0:59408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038737:0:59408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038744:0:59408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038749:0:59408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826412.038753:0:59408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038760:0:59408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038773:0:59408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x148:0x0].0x0 (ffff9bbe16467500) 00010000:00010000:2.0:1787826412.038776:0:59408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826412.038781:0:59408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5e00/0x68019081f349dfb7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6fc expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038790:0:59408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5e00/0x68019081f349dfb7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6fc expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038798:0:59408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5e00/0x68019081f349dfb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6fc expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.038830:0:59408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5e00/0x68019081f349dfb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd6fc expref: 67 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.038843:0:59408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41060000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778720768:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826412.038932:0:59408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe16cae180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826412.046693:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826412.046812:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826412.046935:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790023040 00000100:00100000:1.0:1787826412.046944:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790023040 00000100:00100000:1.0:1787826412.046994:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790023168 00000100:00100000:1.0:1787826412.046998:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790023168 00000100:00100000:1.0:1787826412.047014:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2792 00000100:00100000:1.0:1787826412.047022:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+69:87513:x1874668790023040:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:1.0:1787826412.047257:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+70:87513:x1874668790023040:12345-192.168.203.9@tcp:35:cat.0 Request processed in 235us (574us total) trans 8590016925 rc 0/0 00000100:00100000:1.0:1787826412.047266:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2792 00000100:00100000:1.0:1787826412.047285:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2793 00000100:00100000:1.0:1787826412.047292:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+69:87512:x1874668790023168:12345-192.168.203.9@tcp:49:cat.0 00000100:00100000:1.0:1787826412.047345:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+69:87512:x1874668790023168:12345-192.168.203.9@tcp:49:cat.0 Request processed in 53us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.047351:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2793 00000100:00100000:3.0:1787826412.048798:0:59408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41060000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778720768:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826412.048830:0:59408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.048842:0:59408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146e00/0x68019081f349df86 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.048968:0:59408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.048976:0:59408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.048983:0:59408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.048988:0:59408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf19146600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826412.048993:0:59408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.049000:0:59408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.049014:0:59408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14b:0x0].0x0 (ffff9bbe16467900) 00010000:00010000:3.0:1787826412.049017:0:59408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826412.049023:0:59408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4a00/0x68019081f349dfbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd70a expref: 68 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.049044:0:59408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4a00/0x68019081f349dfbe lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd70a expref: 68 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.049058:0:59408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4a00/0x68019081f349dfbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd70a expref: 68 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.049093:0:59408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4a00/0x68019081f349dfbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd70a expref: 68 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.049106:0:59408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778720896:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826412.049178:0:59408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.060069:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826412.060133:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826412.060226:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790023424 00000100:00100000:0.0:1787826412.060235:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790023424 00000100:00100000:0.0:1787826412.060289:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790023552 00000100:00100000:0.0:1787826412.060292:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790023552 00000100:00100000:0.0:1787826412.060309:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2794 00000100:00100000:0.0:1787826412.060318:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+70:87512:x1874668790023424:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:0.0:1787826412.060556:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+71:87512:x1874668790023424:12345-192.168.203.9@tcp:35:cat.0 Request processed in 237us (495us total) trans 8590016926 rc 0/0 00000100:00100000:0.0:1787826412.060564:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2794 00000100:00100000:0.0:1787826412.060583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2795 00000100:00100000:0.0:1787826412.060590:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+70:87515:x1874668790023552:12345-192.168.203.9@tcp:49:cat.0 00000100:00100000:0.0:1787826412.060658:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+70:87515:x1874668790023552:12345-192.168.203.9@tcp:49:cat.0 Request processed in 68us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.060665:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2795 00000100:00100000:3.0:1787826412.061434:0:59408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778720896:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826412.061463:0:59408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061474:0:59408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf19146600/0x68019081f349df8d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061558:0:59408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061567:0:59408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061573:0:59408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061579:0:59408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe08bf5400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826412.061582:0:59408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061594:0:59408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061608:0:59408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14a:0x0].0x0 (ffff9bbe16467f00) 00010000:00010000:3.0:1787826412.061611:0:59408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826412.061616:0:59408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dfcc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd718 expref: 69 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061626:0:59408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dfcc lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd718 expref: 69 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061635:0:59408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dfcc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd718 expref: 69 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.061680:0:59408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794000/0x68019081f349dfcc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd718 expref: 69 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.061707:0:59408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721024:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826412.061774:0:59408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.065481:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826412.065606:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790023808 00000100:00100000:0.0:1787826412.065615:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790023808 00000100:00100000:0.0:1787826412.065680:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2796 00000100:00100000:0.0:1787826412.065690:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+70:87515:x1874668790023808:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:0.0:1787826412.065946:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+71:87515:x1874668790023808:12345-192.168.203.9@tcp:35:cat.0 Request processed in 257us (474us total) trans 8590016927 rc 0/0 00000100:00100000:0.0:1787826412.065954:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2796 00000100:00100000:3.0:1787826412.070200:0:59408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721024:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826412.070233:0:59408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070245:0:59408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5400/0x68019081f349df94 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070342:0:59408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070352:0:59408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070359:0:59408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070365:0:59408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe08bf5800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826412.070369:0:59408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070376:0:59408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070392:0:59408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14f:0x0].0x0 (ffff9bbe16467800) 00010000:00010000:3.0:1787826412.070395:0:59408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826412.070401:0:59408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5a00/0x68019081f349dfc5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd711 expref: 70 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070412:0:59408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5a00/0x68019081f349dfc5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd711 expref: 70 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070422:0:59408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5a00/0x68019081f349dfc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd711 expref: 70 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070488:0:59408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5a00/0x68019081f349dfc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd711 expref: 70 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.070504:0:59408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721152:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826412.070606:0:59408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.073657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826412.073903:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790023936 00000100:00100000:0.0:1787826412.073913:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790023936 00000100:00100000:0.0:1787826412.073960:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2797 00000100:00100000:0.0:1787826412.073971:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+71:87514:x1874668790023936:12345-192.168.203.9@tcp:49:cat.0 00000100:00100000:0.0:1787826412.074111:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+71:87514:x1874668790023936:12345-192.168.203.9@tcp:49:cat.0 Request processed in 142us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.074119:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2797 00000100:00100000:2.0:1787826412.078472:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826412.078559:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790024192 00000100:00100000:1.0:1787826412.078569:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790024192 00000100:00100000:1.0:1787826412.078624:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2798 00000100:00100000:1.0:1787826412.078633:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+71:87514:x1874668790024192:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:1.0:1787826412.079116:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa787581-6963-4f39-b38f-836255c71d7c+72:87514:x1874668790024192:12345-192.168.203.9@tcp:35:cat.0 Request processed in 481us (651us total) trans 8590016928 rc 0/0 00000100:00100000:1.0:1787826412.079124:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2798 00000100:00100000:1.0:1787826412.083329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826412.083488:0:59408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721152:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826412.083517:0:59408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083538:0:59408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349df9b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083623:0:59408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083631:0:59408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083637:0:59408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083653:0:59408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826412.083657:0:59408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083665:0:59408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083680:0:59408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14c:0x0].0x0 (ffff9bbe16cc5a00) 00010000:00010000:3.0:1787826412.083683:0:59408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826412.083688:0:59408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dfda lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd71f expref: 71 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083709:0:59408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dfda lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd71f expref: 71 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083732:0:59408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dfda lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd71f expref: 71 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.083771:0:59408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794200/0x68019081f349dfda lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd71f expref: 71 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.083785:0:59408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721280:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826412.083900:0:59408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.084483:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790024320 00000100:00100000:2.0:1787826412.084491:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790024320 00000100:00100000:2.0:1787826412.084552:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2799 00000100:00100000:2.0:1787826412.084563:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+72:87519:x1874668790024320:12345-192.168.203.9@tcp:49:cat.0 00000100:00100000:2.0:1787826412.084686:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+72:87519:x1874668790024320:12345-192.168.203.9@tcp:49:cat.0 Request processed in 124us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.084879:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2799 00000100:00100000:3.0:1787826412.090297:0:59408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721280:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826412.090328:0:59408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090339:0:59408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349dfa2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090426:0:59408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090435:0:59408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090441:0:59408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090447:0:59408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826412.090452:0:59408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090463:0:59408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090479:0:59408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14d:0x0].0x0 (ffff9bbe1342f400) 00010000:00010000:3.0:1787826412.090482:0:59408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826412.090488:0:59408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4e00/0x68019081f349dfe1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd726 expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090498:0:59408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4e00/0x68019081f349dfe1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd726 expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090506:0:59408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4e00/0x68019081f349dfe1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd726 expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.090552:0:59408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4e00/0x68019081f349dfe1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd726 expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.090566:0:59408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721408:192.168.203.9@tcp:105: 00000100:00100000:3.0:1787826412.090692:0:59408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.092775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826412.092816:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826412.093016:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790024576 00000100:00100000:0.0:1787826412.093024:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790024576 00000100:00100000:0.0:1787826412.093087:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790024704 00000100:00100000:0.0:1787826412.093091:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790024704 00000100:00100000:0.0:1787826412.093108:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2800 00000100:00100000:0.0:1787826412.093117:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+73:87519:x1874668790024576:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:0.0:1787826412.093325:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+74:87519:x1874668790024576:12345-192.168.203.9@tcp:35:cat.0 Request processed in 208us (558us total) trans 8590016929 rc 0/0 00000100:00100000:0.0:1787826412.093333:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2800 00000100:00100000:0.0:1787826412.093351:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2801 00000100:00100000:0.0:1787826412.093358:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+73:87516:x1874668790024704:12345-192.168.203.9@tcp:49:cat.0 00000100:00100000:0.0:1787826412.093411:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+73:87516:x1874668790024704:12345-192.168.203.9@tcp:49:cat.0 Request processed in 53us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.093419:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2801 00000100:00100000:3.0:1787826412.096550:0:59408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721408:192.168.203.9@tcp:105: 00010000:00010000:3.0:1787826412.096580:0:59408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.096593:0:59408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349dfb0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.096924:0:59408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.096935:0:59408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.096941:0:59408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.096947:0:59408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826412.096952:0:59408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.096959:0:59408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.096976:0:59408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14e:0x0].0x0 (ffff9bbe12458a00) 00010000:00010000:3.0:1787826412.096979:0:59408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826412.096985:0:59408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349dfe8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd72d expref: 72 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.096997:0:59408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349dfe8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd72d expref: 72 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.097007:0:59408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349dfe8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd72d expref: 72 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.097283:0:59408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3200/0x68019081f349dfe8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd72d expref: 72 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.097300:0:59408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721536:192.168.203.9@tcp:105: 00000100:00100000:2.0:1787826412.097384:0:59408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe134b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826412.100624:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826412.100983:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790024832 00000100:00100000:0.0:1787826412.100994:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790024832 00000100:00100000:0.0:1787826412.101065:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2802 00000100:00100000:0.0:1787826412.101075:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+73:87517:x1874668790024832:12345-192.168.203.9@tcp:49:cat.0 00000100:00100000:0.0:1787826412.101202:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+73:87517:x1874668790024832:12345-192.168.203.9@tcp:49:cat.0 Request processed in 129us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.101210:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2802 00000100:00100000:0.0:1787826412.105360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826412.105406:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826412.105492:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790024960 00000100:00100000:3.0:1787826412.105502:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790024960 00000100:00100000:3.0:1787826412.105565:0:23877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790025216 00000100:00100000:3.0:1787826412.105569:0:23877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790025216 00000100:00100000:3.0:1787826412.105588:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2803 00000100:00100000:3.0:1787826412.105597:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf067af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+74:87518:x1874668790024960:12345-192.168.203.9@tcp:49:cat.0 00000100:00100000:3.0:1787826412.105757:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf067af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+74:87518:x1874668790024960:12345-192.168.203.9@tcp:49:cat.0 Request processed in 160us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.105765:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2803 00000100:00100000:3.0:1787826412.105802:0:23877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2804 00000100:00100000:3.0:1787826412.105809:0:23877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+73:87516:x1874668790025216:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:3.0:1787826412.105988:0:23877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fa787581-6963-4f39-b38f-836255c71d7c+74:87516:x1874668790025216:12345-192.168.203.9@tcp:35:cat.0 Request processed in 178us (581us total) trans 8590016930 rc 0/0 00000100:00100000:3.0:1787826412.105995:0:23877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2804 00000100:00100000:2.0:1787826412.106572:0:59408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0e6bc000 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000_UUID:59408:1874668778721536:192.168.203.9@tcp:105: 00010000:00010000:2.0:1787826412.106599:0:59408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.106610:0:59408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795c00/0x68019081f349dfd3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x14e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826412.106668:0:59408:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9740 count 37 00000040:00080000:2.0:1787826412.106681:0:59408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1787826412.134065:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826412.134103:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826412.134241:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790025472 00000100:00100000:1.0:1787826412.134252:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790025472 00000100:00100000:1.0:1787826412.134333:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790025728 00000100:00100000:1.0:1787826412.134337:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790025728 00000100:00100000:1.0:1787826412.134357:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2805 00000100:00100000:1.0:1787826412.134367:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+75:87517:x1874668790025472:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:1.0:1787826412.134598:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+76:87517:x1874668790025472:12345-192.168.203.9@tcp:35:cat.0 Request processed in 231us (541us total) trans 8590016931 rc 0/0 00000100:00100000:1.0:1787826412.134607:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2805 00000100:00100000:1.0:1787826412.134626:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2806 00000100:00100000:1.0:1787826412.134634:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf410621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+75:87518:x1874668790025728:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:1.0:1787826412.134738:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf410621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa787581-6963-4f39-b38f-836255c71d7c+76:87518:x1874668790025728:12345-192.168.203.9@tcp:35:cat.0 Request processed in 105us (634us total) trans 8590016932 rc 0/0 00000100:00100000:1.0:1787826412.134745:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2806 00010000:00010000:1.0:1787826412.418896:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787826413.056036:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826413.056045:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826413.056243:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9740 count 37 00000040:00080000:0.0:1787826413.056253:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:1.0:1787826413.440482:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826413.510781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826413.510884:0:38194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790025856 00000100:00100000:0.0:1787826413.510894:0:38194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790025856 00000100:00100000:0.0:1787826413.510970:0:38194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 815 00000100:00100000:0.0:1787826413.510980:0:38194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2400:x1874668790025856:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826413.514112:0:38194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:6bde37df-3766-41d5-a558-be13e58235fe+13:2400:x1874668790025856:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3122us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.514128:0:38194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 815 00000100:00100000:1.0:1787826413.515555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826413.515599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826413.515700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826413.515728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826413.515785:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790026112 00000100:00100000:0.0:1787826413.515794:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790026112 00000100:00100000:0.0:1787826413.515878:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790026624 00000100:00100000:0.0:1787826413.515881:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790026624 00000100:00100000:0.0:1787826413.515904:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5181 00000100:00100000:0.0:1787826413.515914:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2400:x1874668790026112:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826413.515980:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2400:x1874668790026112:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 67us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.515986:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5181 00000100:00100000:0.0:1787826413.516002:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5182 00000100:00100000:0.0:1787826413.516008:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2400:x1874668790026624:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826413.516032:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+48:2400:x1874668790026624:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.516038:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5182 00000100:00100000:1.0:1787826413.516314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826413.516579:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826413.516613:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790026368 00000100:00100000:2.0:1787826413.516618:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790026368 00000100:00100000:2.0:1787826413.516660:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790026880 00000100:00100000:2.0:1787826413.516663:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790026880 00000100:00100000:2.0:1787826413.516684:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3587 00000100:00100000:2.0:1787826413.516691:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668790026368:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826413.516727:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+26:2400:x1874668790026368:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 36us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.516734:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3587 00000100:00100000:2.0:1787826413.516746:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3588 00000100:00100000:2.0:1787826413.516752:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668790026880:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826413.516776:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0aa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa787581-6963-4f39-b38f-836255c71d7c+9:2400:x1874668790026880:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.516782:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3588 00000100:00100000:2.0:1787826413.516919:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790025984 00000100:00100000:2.0:1787826413.516924:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790025984 00000100:00100000:2.0:1787826413.516953:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5183 00000100:00100000:2.0:1787826413.516959:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2400:x1874668790025984:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826413.516989:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2400:x1874668790025984:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 30us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.516994:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5183 00000100:00100000:1.0:1787826413.517432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826413.517535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826413.517558:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790026240 00000100:00100000:1.0:1787826413.517562:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790026240 00000100:00100000:1.0:1787826413.517590:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790026752 00000100:00100000:1.0:1787826413.517593:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790026752 00000100:00100000:1.0:1787826413.517613:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3589 00000100:00100000:1.0:1787826413.517619:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2400:x1874668790026240:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826413.517691:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3590 00000100:00100000:2.0:1787826413.517700:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668790026752:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826413.517794:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+29:2400:x1874668790026240:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 174us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.517801:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3589 00000100:00100000:0.0:1787826413.517972:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790026496 00000100:00100000:0.0:1787826413.517977:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790026496 00000100:00100000:0.0:1787826413.518007:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5184 00000100:00100000:0.0:1787826413.518014:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+76:2400:x1874668790026496:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826413.518092:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+6:2400:x1874668790026752:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 392us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.518102:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3590 00000100:00080000:2.0:1787826413.518217:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826413.518221:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826413.518225:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826413.518227:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826413.520910:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+76:2400:x1874668790026496:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 2876us (3459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.520927:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5184 00000040:00080000:2.0:1787826413.697203:0:59457:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787826413.697213:0:59457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826413.697971:0:59457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787826413.697986:0:59457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787826413.893579:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968220 is committed 00000001:00080000:0.0:1787826413.893607:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968215 is committed 00000001:00080000:2.0:1787826413.894189:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968205 is committed 00000001:00080000:2.0:1787826413.894205:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968200 is committed 00000100:00100000:1.0:1787826414.400187:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778721792:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.400273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400323:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778722304:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.400586:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400612:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778722816:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.400648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400681:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778723328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826414.400705:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400722:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787826414.400727:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778721664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.400752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400769:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778722176:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.400790:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400806:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778722688:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.400825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400840:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1607bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778723200:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.400887:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400913:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778721920:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.400938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400955:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778722432:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.400975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.400990:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778722944:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.401009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.401026:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826414.401031:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778722048:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.401050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.401064:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778722560:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.401082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.401094:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1607b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778723072:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.401114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.401150:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778721792 00000100:00100000:1.0:1787826414.401156:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778721792 00000100:00100000:1.0:1787826414.401203:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778722816 00000100:00100000:1.0:1787826414.401206:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778722816 00000100:00100000:1.0:1787826414.401228:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3519 00000100:00100000:1.0:1787826414.401235:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778721792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.401304:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778721792:12345-0@lo:400:kworker.0 Request processed in 69us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.401311:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3519 00000100:00100000:1.0:1787826414.401330:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3520 00000100:00100000:1.0:1787826414.401337:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778722816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.401446:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778722304 00000100:00100000:2.0:1787826414.401450:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778722304 00000100:00100000:2.0:1787826414.401490:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778722688 00000100:00100000:2.0:1787826414.401493:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778722688 00000100:00100000:2.0:1787826414.401524:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778722944 00000100:00100000:2.0:1787826414.401527:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778722944 00000100:00100000:2.0:1787826414.401544:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778723072 00000100:00100000:2.0:1787826414.401547:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778723072 00000100:00100000:2.0:1787826414.401561:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3591 00000100:00100000:2.0:1787826414.401567:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778722304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.401604:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778722304:12345-0@lo:400:kworker.0 Request processed in 38us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.401610:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3591 00000100:00100000:2.0:1787826414.401634:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592 00000100:00100000:2.0:1787826414.401641:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778722688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.401669:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778722688:12345-0@lo:400:kworker.0 Request processed in 29us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.401678:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592 00000100:00100000:2.0:1787826414.401689:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3593 00000100:00100000:2.0:1787826414.401695:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778722944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.401728:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778722944:12345-0@lo:400:kworker.0 Request processed in 33us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.401734:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3593 00000100:00100000:2.0:1787826414.401745:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594 00000100:00100000:2.0:1787826414.401751:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778723072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.401778:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778723072:12345-0@lo:400:kworker.0 Request processed in 27us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.401783:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594 00000100:00100000:2.0:1787826414.401808:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778722176 00000100:00100000:2.0:1787826414.401812:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778722176 00000100:00100000:2.0:1787826414.401837:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778723200 00000100:00100000:2.0:1787826414.401839:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778723200 00000100:00100000:2.0:1787826414.401871:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5185 00000100:00100000:2.0:1787826414.401877:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778722176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.401907:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778722176:12345-0@lo:400:kworker.0 Request processed in 32us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.401913:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5185 00000100:00100000:2.0:1787826414.401924:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778721920 00000100:00100000:2.0:1787826414.401926:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778721920 00000100:00100000:2.0:1787826414.401943:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778722432 00000100:00100000:2.0:1787826414.401946:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778722432 00000100:00100000:2.0:1787826414.401961:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778722048 00000100:00100000:2.0:1787826414.401963:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778722048 00000100:00100000:2.0:1787826414.401974:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778722560 00000100:00100000:2.0:1787826414.401976:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778722560 00000100:00100000:2.0:1787826414.401988:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5186 00000100:00100000:2.0:1787826414.401993:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778723200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402018:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778723200:12345-0@lo:400:kworker.0 Request processed in 25us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.402024:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5186 00000100:00100000:2.0:1787826414.402035:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5187 00000100:00100000:2.0:1787826414.402040:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778721920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402067:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778721920:12345-0@lo:400:kworker.0 Request processed in 27us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.402073:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5187 00000100:00100000:2.0:1787826414.402084:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5188 00000100:00100000:2.0:1787826414.402089:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778722432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402115:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778722432:12345-0@lo:400:kworker.0 Request processed in 25us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.402120:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5188 00000100:00100000:2.0:1787826414.402132:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5189 00000100:00100000:2.0:1787826414.402138:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778722048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402165:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874668778722048:12345-0@lo:400:kworker.0 Request processed in 27us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.402170:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5189 00000100:00100000:2.0:1787826414.402180:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5190 00000100:00100000:2.0:1787826414.402185:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778722560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402206:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778722560:12345-0@lo:400:kworker.0 Request processed in 22us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.402214:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5190 00000100:00080000:2.0:1787826414.402237:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826414.402240:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826414.402242:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826414.402244:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826414.402288:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874668778722048:0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402299:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778722560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402307:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968205 gen 2 00000004:00080000:2.0:1787826414.402312:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968201 committed transno 4294968205 00000004:00080000:2.0:1787826414.402337:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968202 committed transno 4294968205 00000004:00080000:2.0:1787826414.402362:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968203 committed transno 4294968205 00000004:00080000:2.0:1787826414.402382:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968204 committed transno 4294968205 00000004:00080000:2.0:1787826414.402396:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dbc70c0, transno 4294968205 00000100:00100000:2.0:1787826414.402408:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1607b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778723072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402420:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778721920:0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402429:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778722432:0@lo:400:kworker.0 00000100:00100000:2.0:1787826414.402436:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968220 gen 2 00000004:00080000:2.0:1787826414.402439:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968216 committed transno 4294968220 00000004:00080000:2.0:1787826414.402448:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968217 committed transno 4294968220 00000004:00080000:2.0:1787826414.402457:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968218 committed transno 4294968220 00000004:00080000:2.0:1787826414.402470:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968219 committed transno 4294968220 00000004:00080000:2.0:1787826414.402481:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe0dbc6580, transno 4294968220 00000100:00100000:2.0:1787826414.402491:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778722944:0@lo:400:kworker.0 00000100:00100000:1.0:1787826414.403067:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16079680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778722816:12345-0@lo:400:kworker.0 Request processed in 1727us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.403076:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3520 00000100:00100000:1.0:1787826414.403106:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778723328 00000100:00100000:1.0:1787826414.403112:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778723328 00000100:00100000:1.0:1787826414.403184:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00100000:1.0:1787826414.403191:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778723328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826414.403211:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570133952 pending 0 free 3828535296 avail 3597012992 00000100:00100000:1.0:1787826414.403242:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778723328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.403258:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00100000:0.0:1787826414.403552:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778721664 00000100:00100000:0.0:1787826414.403557:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778721664 00000100:00100000:0.0:1787826414.403588:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1787826414.403595:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778721664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826414.403642:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778721664:12345-0@lo:400:kworker.0 Request processed in 48us (2889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.403648:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1787826414.403708:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778721664:0@lo:400:kworker.0 00000100:00100000:0.0:1787826414.403721:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778722176:0@lo:400:kworker.0 00000100:00100000:0.0:1787826414.403731:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778722688:0@lo:400:kworker.0 00000100:00100000:0.0:1787826414.403742:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1607bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778723200:0@lo:400:kworker.0 00000100:00100000:0.0:1787826414.403757:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778723328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826414.403769:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778721792:0@lo:400:kworker.0 00000100:00100000:0.0:1787826414.403777:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778722304:0@lo:400:kworker.0 00000100:00100000:0.0:1787826414.403786:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe160792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778722816:0@lo:400:kworker.0 00010000:00010000:2.0:1787826414.464028:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826414.915681:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778723456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826414.915754:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.916016:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778723456 00000100:00100000:1.0:1787826414.916024:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778723456 00000100:00100000:1.0:1787826414.916075:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:1.0:1787826414.916084:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778723456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826414.916113:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 670985664 pending 0 free 3894710272 avail 3663187968 00000100:00100000:1.0:1787826414.916160:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778723456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.916167:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00100000:2.0:1787826414.916245:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778723456:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826415.488738:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787826416.178491:0:59602:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826416.178500:0:59602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826416.179334:0:59602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9740 count 37 00000040:00080000:3.0:1787826416.179343:0:59602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:3.0:1787826416.179447:0:59602:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826416.179451:0:59602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826416.179732:0:59602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9740 count 37 00000040:00080000:3.0:1787826416.179739:0:59602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:3.0:1787826416.179811:0:59602:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1787826416.179814:0:59602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787826416.180103:0:59602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9740 count 37 00000040:00080000:3.0:1787826416.180107:0:59602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1787826416.450652:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826416.450677:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778723584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826416.450750:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826416.450834:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826416.450842:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778723712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826416.450890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826416.451021:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778723584 00000100:00100000:2.0:1787826416.451029:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778723584 00000100:00100000:2.0:1787826416.451077:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778723712 00000100:00100000:2.0:1787826416.451080:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778723712 00000100:00100000:2.0:1787826416.451105:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3521 00000100:00100000:2.0:1787826416.451115:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778723584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826416.451148:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440509952 avail 1294270464 00000100:00100000:2.0:1787826416.451194:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778723584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.451202:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3521 00000100:00100000:2.0:1787826416.451219:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3522 00000100:00100000:2.0:1787826416.451225:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778723712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826416.451241:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1787826416.451273:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778723712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.451279:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3522 00000100:00100000:2.0:1787826416.451320:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778723712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826416.451359:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778723584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826416.512116:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826416.960351:0:38205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3055071495757ns, next at 3056071492987ns, rc = 0 00000100:00100000:1.0:1787826416.960372:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826416.960391:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778723840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826416.960455:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826416.960509:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778723840 00000100:00100000:1.0:1787826416.960517:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778723840 00000100:00100000:1.0:1787826416.960568:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00100000:1.0:1787826416.960578:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778723840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826416.960604:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 670985664 pending 0 free 3894710272 avail 3663187968 00000100:00080000:3.0:1787826416.960893:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826416.960994:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778723840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 417us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826416.961002:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000004:00080000:2.0:1787826416.961175:0:38203:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3055072322308ns, next at 3056072320532ns, rc = 0 00000100:00100000:2.0:1787826416.961217:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf41060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778723968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826416.961248:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826416.961289:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778723968 00000100:00100000:2.0:1787826416.961294:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778723968 00000100:00100000:2.0:1787826416.961336:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:2.0:1787826416.961345:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778723968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826416.961361:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570133952 pending 0 free 3828535296 avail 3597012992 00000100:00100000:2.0:1787826416.961395:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778723968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.961401:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00100000:2.0:1787826416.961440:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf41060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778723968:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787826416.961460:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826416.961759:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778723840:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787826416.963433:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016932 is committed 00000004:00080000:2.0:1787826416.963463:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 27 committed 00000004:00080000:2.0:1787826416.963484:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 30 committed 00000020:00080000:2.0:1787826416.963518:0:38181:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294970911 batchid updated 00000020:00080000:2.0:1787826416.963535:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970911 00000020:00080000:2.0:1787826416.963566:0:38217:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294970911 00000100:00100000:2.0:1787826416.963621:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778724096:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826416.963650:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778724352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826416.963707:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826416.963747:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826416.963753:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778724224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826416.963774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826416.963805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826416.963807:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778724352 00000100:00100000:0.0:1787826416.963814:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778724352 00000100:00100000:2.0:1787826416.964074:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778724224 00000100:00100000:2.0:1787826416.964079:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778724224 00000100:00100000:2.0:1787826416.964110:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778724096 00000100:00100000:2.0:1787826416.964113:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778724096 00000100:00100000:2.0:1787826416.964132:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6511 00000100:00100000:2.0:1787826416.964140:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1874668778724352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826416.964163:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:214 count 1 00002000:00010000:2.0:1787826416.964360:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd6:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:2.0:1787826416.964369:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964391:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=3055s v=(0 0) 00010000:00010000:2.0:1787826416.964395:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826416.964402:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964417:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964427:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964435:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964454:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826416.964604:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3644:x1874668778724352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 464us (897us total) trans 4294968221 rc 0/0 00000100:00100000:2.0:1787826416.964622:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6511 00000100:00100000:2.0:1787826416.964878:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6512 00000100:00100000:2.0:1787826416.964888:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1874668778724224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826416.964901:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:213 count 1 00002000:00010000:2.0:1787826416.964918:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd5:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:2.0:1787826416.964923:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964937:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=3055s v=(0 0) 00010000:00010000:2.0:1787826416.964941:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826416.964945:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964953:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964962:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964970:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.964987:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1787826416.965054:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3644:x1874668778724224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 168us (1278us total) trans 4294968222 rc 0/0 00000100:00100000:2.0:1787826416.965060:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6512 00000100:00100000:2.0:1787826416.965075:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6513 00000100:00100000:2.0:1787826416.965081:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf41060f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1874668778724096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826416.965092:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:212 count 1 00002000:00010000:2.0:1787826416.965106:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd4:0x0] initial LVB size: 1516, mtime: 0x6a9010e6, atime: 0x0, ctime: 0x6a9010e6, blocks: 0x8 00010000:00010000:2.0:1787826416.965111:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.965124:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=3055s v=(0 0) 00010000:00010000:2.0:1787826416.965127:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826416.965131:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.965140:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.965148:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.965155:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.965168:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1787826416.966641:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778724480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787826416.966705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826416.966754:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826416.966761:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778724608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787826416.966784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826416.966810:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778724480 00000100:00100000:0.0:1787826416.966816:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778724480 00000100:00100000:0.0:1787826416.966849:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778724608 00000100:00100000:0.0:1787826416.966867:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778724608 00000100:00100000:0.0:1787826416.966887:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6514 00000100:00100000:0.0:1787826416.966894:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3645:x1874668778724480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787826416.966918:0:25038:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:213 count 1 00002000:00010000:0.0:1787826416.966944:0:25038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd5:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:0.0:1787826416.966953:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.966968:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=3055s v=(0 0) 00010000:00010000:0.0:1787826416.966973:0:25038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826416.966979:0:25038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.966995:0:25038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.967116:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6515 00000100:00100000:1.0:1787826416.967127:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874668778724608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826416.967140:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:214 count 1 00002000:00010000:1.0:1787826416.967155:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd6:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:1.0:1787826416.967161:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.967176:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=3055s v=(0 0) 00010000:00010000:1.0:1787826416.967180:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826416.967184:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.967194:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.967203:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.967210:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.967228:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1787826416.967353:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1874668778724608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 228us (567us total) trans 4294968206 rc 0/0 00000100:00100000:1.0:1787826416.967361:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6515 00000100:00100000:2.0:1787826416.967709:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf41060f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1874668778724096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2627us (3903us total) trans 4294968223 rc 0/0 00000100:00100000:2.0:1787826416.967717:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6513 00000004:00080000:2.0:1787826416.967763:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbf0cb592c0/2, rc 0, transno 4294968223 00000100:00100000:2.0:1787826416.967769:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778724096:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787826416.967786:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787826416.967793:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967803:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826416.967808:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967818:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967836:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967844:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3f99623/0x68019081f349dfef lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967877:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826416.967882:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967889:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826416.967893:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967901:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967911:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967919:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a89e4736/0x68019081f349dff6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967932:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826416.967935:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967942:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826416.967945:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967953:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967963:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967969:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006324b6eb/0x68019081f349dffd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967982:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826416.967987:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.967993:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826416.967997:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.968009:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.968020:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.968027:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb59078/0x68019081f349e00b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.968041:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826416.968043:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826416.968045:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826416.968052:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826416.968058:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826416.968062:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787826416.968120:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbf0cb5a1c0/2, rc 0, transno 4294968222 00000100:00100000:2.0:1787826416.968126:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778724224:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787826416.968136:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbf0cb58780/2, rc 0, transno 4294968221 00000100:00100000:2.0:1787826416.968140:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778724352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826416.968149:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826416.968156:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778724736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787826416.968190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826416.968261:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.968269:0:25038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.968454:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778724736 00000100:00100000:1.0:1787826416.968460:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778724736 00000100:00100000:1.0:1787826416.968507:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6516 00000100:00100000:1.0:1787826416.968514:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1874668778724736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826416.968532:0:8433:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:215 count 1 00002000:00010000:1.0:1787826416.968553:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd7:0x0] initial LVB size: 1516, mtime: 0x6a9010e7, atime: 0x0, ctime: 0x6a9010e7, blocks: 0x8 00010000:00010000:1.0:1787826416.968559:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.968570:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=3055s v=(0 0) 00010000:00010000:1.0:1787826416.968573:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826416.968579:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.968589:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.968598:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.968605:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.969776:0:25038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1787826416.969953:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c1f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3645:x1874668778724480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3056us (3245us total) trans 4294968207 rc 0/0 00000100:00100000:0.0:1787826416.969962:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6514 00000004:00080000:0.0:1787826416.970014:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe159f3480/2, rc 0, transno 4294968206 00000100:00100000:0.0:1787826416.970020:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778724608:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1787826416.970029:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe159f3c00/2, rc 0, transno 4294968207 00000100:00100000:0.0:1787826416.970032:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778724480:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787826416.973146:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787826416.973353:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3644:x1874668778724736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4835us (5159us total) trans 4294968208 rc 0/0 00000100:00100000:1.0:1787826416.973364:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6516 00010000:00010000:2.0:1787826416.974100:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826416.974111:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.974129:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe08bf5c00 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826416.974133:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.974144:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.974165:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.974173:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b1aab0d/0x68019081f349e004 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826416.974310:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bbe159f21c0/2, rc 0, transno 4294968208 00000100:00100000:2.0:1787826416.974319:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778724736:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787826416.974354:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826416.974359:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.974366:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6800 already unused, calling callback (ffffffffc0c00440) 00010000:00010000:2.0:1787826416.974370:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.974378:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.974389:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.974948:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aeb2325/0x68019081f349e012 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.974966:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826416.974967:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826416.974969:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826416.975860:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826417.536770:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.563577:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826418.635098:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826418.635136:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826418.635165:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826418.635227:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790027008 00000100:00100000:0.0:1787826418.635236:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790027008 00000100:00100000:0.0:1787826418.635287:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 817 00000100:00100000:0.0:1787826418.635297:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668790027008:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826418.635364:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6bde37df-3766-41d5-a558-be13e58235fe+13:2399:x1874668790027008:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 69us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.635371:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 817 00000100:00100000:1.0:1787826418.635621:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790027264 00000100:00100000:1.0:1787826418.635626:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790027264 00000100:00100000:1.0:1787826418.635687:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5191 00000100:00100000:1.0:1787826418.635696:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668790027264:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826418.635735:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2399:x1874668790027264:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 41us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.635742:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5191 00000100:00080000:0.0:1787826418.635924:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826418.639615:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790027520 00000100:00100000:2.0:1787826418.639628:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790027520 00000100:00100000:2.0:1787826418.639751:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3595 00000100:00100000:2.0:1787826418.639763:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2399:x1874668790027520:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826418.639838:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2399:x1874668790027520:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 79us (4672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.639845:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3595 00000100:00100000:3.0:1787826418.641714:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826418.641844:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826418.641888:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826418.641916:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826418.641934:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826418.641951:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826418.642333:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790028032 00000100:00100000:1.0:1787826418.642342:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790028032 00000100:00100000:2.0:1787826418.642401:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790027776 00000100:00100000:2.0:1787826418.642406:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790027776 00000100:00100000:3.0:1787826418.643262:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790027136 00000100:00100000:3.0:1787826418.643270:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790027136 00000100:00080000:0.0:1787826418.643383:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826418.643388:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826418.643391:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826418.643404:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790027392 00000100:00100000:0.0:1787826418.643408:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790027392 00000100:00100000:0.0:1787826418.643453:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790027904 00000100:00100000:0.0:1787826418.643456:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790027904 00000100:00100000:0.0:1787826418.643497:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3596 00000100:00100000:0.0:1787826418.643507:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2399:x1874668790027392:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826418.643579:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2399:x1874668790027392:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 73us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.643587:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3596 00000100:00100000:0.0:1787826418.643617:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3597 00000100:00100000:0.0:1787826418.643624:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668790027904:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826418.643649:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+6:2399:x1874668790027904:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.643655:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3597 00000100:00080000:0.0:1787826418.643966:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826418.644964:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3598 00000100:00100000:1.0:1787826418.644979:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668790028032:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826418.645087:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa787581-6963-4f39-b38f-836255c71d7c+9:2399:x1874668790028032:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 111us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.645094:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3598 00000100:00100000:2.0:1787826418.645380:0:45682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790027648 00000100:00100000:2.0:1787826418.645387:0:45682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790027648 00000100:00100000:2.0:1787826418.645416:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5192 00000100:00100000:2.0:1787826418.645423:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e6bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668790027776:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826418.645460:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e6bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+48:2399:x1874668790027776:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 38us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.645470:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5192 00000100:00100000:2.0:1787826418.645496:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5193 00000100:00100000:2.0:1787826418.645503:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+61:2399:x1874668790027648:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826418.645528:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:fa787581-6963-4f39-b38f-836255c71d7c+61:2399:x1874668790027648:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 27us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.645533:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5193 00000100:00080000:0.0:1787826418.646691:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826418.649538:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5194 00000100:00100000:3.0:1787826418.649557:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2399:x1874668790027136:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826418.649644:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf137643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2399:x1874668790027136:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 95us (7755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.649651:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5194 00000100:00100000:0.0:1787826419.520138:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778724992:0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.520197:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778724864:0@lo:400:kworker.0 00000100:00100000:2.0:1787826419.520335:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778725120:0@lo:400:kworker.0 00000100:00100000:1.0:1787826419.520391:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778725248:0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.523806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826419.523898:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778725376:0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.523942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826419.523965:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778725888:0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.523990:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826419.524010:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778726400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.524033:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826419.524120:0:38196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778724864 00000100:00100000:3.0:1787826419.524127:0:38196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778724864 00000100:00100000:3.0:1787826419.524170:0:38196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1787826419.524179:0:38196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0c025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778724864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.524232:0:38196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0c025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3644:x1874668778724864:12345-0@lo:400:kworker.0 Request processed in 54us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.524240:0:38196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1787826419.524270:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778725888 00000100:00100000:3.0:1787826419.524274:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778725888 00000100:00100000:3.0:1787826419.524314:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3599 00000100:00100000:3.0:1787826419.524323:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778725888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.524354:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778725888:12345-0@lo:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.524360:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3599 00000100:00100000:0.0:1787826419.525048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826419.525079:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778725504:0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.525109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826419.525127:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778726016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.525148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826419.525496:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778725376 00000100:00100000:3.0:1787826419.525502:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778725376 00000100:00100000:0.0:1787826419.525507:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0dbc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778726528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826419.525548:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778726400 00000100:00100000:3.0:1787826419.525553:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778726400 00000100:00100000:3.0:1787826419.525577:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5195 00000100:00100000:3.0:1787826419.525872:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778725376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.525928:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe17087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778725376:12345-0@lo:400:kworker.0 Request processed in 344us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.525935:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5195 00000100:00100000:3.0:1787826419.525952:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5196 00000100:00100000:3.0:1787826419.525958:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778726400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.525989:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe170870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778726400:12345-0@lo:400:kworker.0 Request processed in 31us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.525994:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5196 00000100:00100000:3.0:1787826419.526098:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778725504 00000100:00100000:3.0:1787826419.526102:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778725504 00000100:00100000:3.0:1787826419.526134:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600 00000100:00100000:3.0:1787826419.526141:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778725504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.526172:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778725504:12345-0@lo:400:kworker.0 Request processed in 32us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.526177:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600 00000100:00100000:0.0:1787826419.526276:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826419.526321:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778725504:0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.526356:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778724992 00000100:00100000:0.0:1787826419.526359:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778724992 00000100:00100000:0.0:1787826419.526387:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778726016 00000100:00100000:0.0:1787826419.526389:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778726016 00000100:00100000:0.0:1787826419.526406:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3523 00000100:00100000:0.0:1787826419.526414:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778724992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.526466:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874668778724992:12345-0@lo:400:kworker.0 Request processed in 53us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.526473:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3523 00000100:00100000:0.0:1787826419.526486:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3524 00000100:00100000:0.0:1787826419.526493:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778726016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.526602:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778726016:12345-0@lo:400:kworker.0 Request processed in 109us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.526608:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3524 00000100:00100000:0.0:1787826419.526649:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778724992:0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.526659:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778726016:0@lo:400:kworker.0 00000100:00080000:0.0:1787826419.526692:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826419.526696:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826419.526698:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826419.526714:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778726528 00000100:00100000:0.0:1787826419.526717:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778726528 00000100:00100000:0.0:1787826419.526743:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:0.0:1787826419.526750:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778726528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826419.526771:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570133952 pending 0 free 3828547584 avail 3597025280 00000100:00100000:0.0:1787826419.527206:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778726528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.527213:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00100000:0.0:1787826419.527251:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0dbc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778726528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826419.527378:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c687310c-1e82-4391-b632-324cfd2cb9dd:3644:1874668778724864:0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.527391:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778725376:0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.527402:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778725888:0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.527411:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778726400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826419.527723:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826419.527753:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1874668778725632:0@lo:400:kworker.0 00000100:00100000:2.0:1787826419.527783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826419.527816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778725120 00000100:00100000:2.0:1787826419.527821:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778725120 00000100:00100000:2.0:1787826419.527848:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778725632 00000100:00100000:2.0:1787826419.527863:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778725632 00000100:00100000:2.0:1787826419.527891:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5197 00000100:00100000:2.0:1787826419.527897:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778725120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826419.527933:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874668778725120:12345-0@lo:400:kworker.0 Request processed in 36us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.527940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5197 00000100:00100000:2.0:1787826419.527953:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5198 00000100:00100000:2.0:1787826419.527958:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874668778725632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826419.527984:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe160792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874668778725632:12345-0@lo:400:kworker.0 Request processed in 27us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.527990:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5198 00000100:00080000:2.0:1787826419.528007:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826419.528023:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1874668778725632:0@lo:400:kworker.0 00000100:00100000:2.0:1787826419.528030:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778726144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826419.528055:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826419.528085:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874668778725120:0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.529601:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778726144 00000100:00100000:3.0:1787826419.529611:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778726144 00000100:00100000:3.0:1787826419.529662:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601 00000100:00100000:3.0:1787826419.529672:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1874668778726144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.529756:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1874668778726144:12345-0@lo:400:kworker.0 Request processed in 87us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.529763:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601 00000100:00080000:2.0:1787826419.530450:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826419.530501:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778726144:0@lo:400:kworker.0 00000100:00100000:1.0:1787826419.531604:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826419.531702:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe0c1f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778725760:0@lo:400:kworker.0 00000100:00100000:1.0:1787826419.531745:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826419.531822:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe102de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778726272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826419.531874:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826419.532045:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778726272 00000100:00100000:0.0:1787826419.532053:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778726272 00000100:00100000:0.0:1787826419.532119:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3602 00000100:00100000:0.0:1787826419.532128:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3643:x1874668778726272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826419.532193:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3643:x1874668778726272:12345-0@lo:400:kworker.0 Request processed in 54us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.532201:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3602 00000100:00080000:1.0:1787826419.532337:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826419.532365:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe102de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778726272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.532682:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778725248 00000100:00100000:3.0:1787826419.532688:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778725248 00000100:00100000:3.0:1787826419.532754:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778725760 00000100:00100000:3.0:1787826419.532758:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778725760 00000100:00100000:3.0:1787826419.532785:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5199 00000100:00100000:3.0:1787826419.532792:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778725248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.532839:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778725248:12345-0@lo:400:kworker.0 Request processed in 48us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.532847:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5199 00000100:00100000:3.0:1787826419.532882:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5200 00000100:00100000:3.0:1787826419.532889:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778725760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826419.532919:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778725760:12345-0@lo:400:kworker.0 Request processed in 31us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.532925:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5200 00000100:00080000:1.0:1787826419.536119:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826419.536129:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826419.536195:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778725248:0@lo:400:kworker.0 00000100:00100000:1.0:1787826419.536212:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe0c1f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778725760:0@lo:400:kworker.0 00010000:00010000:2.0:1787826419.584024:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826420.032609:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe16078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778726656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826420.032682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826420.032809:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778726656 00000100:00100000:2.0:1787826420.032817:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778726656 00000100:00100000:2.0:1787826420.032886:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:2.0:1787826420.032896:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778726656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826420.032928:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 670985664 pending 0 free 3894722560 avail 3663200256 00000100:00100000:2.0:1787826420.032976:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778726656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.032983:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00100000:0.0:1787826420.033117:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe16078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778726656:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826420.608564:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787826420.864433:0:58480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787826420.864443:0:58480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826420.866461:0:58480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787826420.866484:0:58480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787826421.248596:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826421.248604:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826421.248815:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9740 count 37 00000040:00080000:0.0:1787826421.248824:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1787826421.568509:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08303840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778726784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826421.568599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826421.568787:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778726784 00000100:00100000:3.0:1787826421.568795:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778726784 00000100:00100000:0.0:1787826421.568966:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3525 00000100:00100000:0.0:1787826421.568978:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778726784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826421.569011:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826421.569062:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778726784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.569069:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3525 00000100:00100000:0.0:1787826421.569126:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08303840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778726784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826421.570679:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe159f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778726912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826421.570742:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826421.571403:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778726912 00000100:00100000:1.0:1787826421.571411:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778726912 00000100:00100000:1.0:1787826421.571465:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3526 00000100:00100000:1.0:1787826421.571476:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1607b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778726912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826421.571509:0:45678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440509952 avail 1294270464 00000100:00100000:1.0:1787826421.571584:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1607b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778726912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826421.571592:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3526 00000100:00100000:2.0:1787826421.571783:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe159f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778726912:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787826421.637008:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826421.705452:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826421.705621:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790028160 00000100:00100000:0.0:1787826421.705631:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790028160 00000100:00100000:0.0:1787826421.705710:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3527 00000100:00100000:0.0:1787826421.705721:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2401:x1874668790028160:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:0.0:1787826421.705755:0:46361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826421.705775:0:46361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349e019 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd734 expref: -99 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.705841:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.706060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826421.706087:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790028288 00000100:00100000:3.0:1787826421.706091:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790028288 00000100:00100000:3.0:1787826421.706160:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3528 00000100:00100000:3.0:1787826421.706168:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2400:x1874668790028288:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826421.706185:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.706195:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e027 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd73b expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.706221:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.706261:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.706273:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.706508:0:46361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.706528:0:46361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.706542:0:46361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787826421.706643:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826421.708917:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.708938:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.708962:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.708971:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.708978:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709026:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709033:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709039:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709046:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826421.709050:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709058:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709069:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826421.709072:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826421.709077:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709083:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e02e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709099:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709105:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709111:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709116:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826421.709119:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709129:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709136:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc95d90ba (ffff9bbe0fe8c100) 00010000:00010000:3.0:1787826421.709139:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826421.709142:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709148:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e03c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709186:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e027 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd73b expref: 50 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709197:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:3.0:1787826421.709199:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826421.709203:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e027 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd73b expref: 50 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.709213:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794c00, rc -2) 00000100:00100000:3.0:1787826421.709362:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2400:x1874668790028288:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 3193us (3301us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826421.709372:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3528 00010000:00010000:2.0:1787826421.713126:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713145:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713152:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713158:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe08bf5200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826421.713162:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713171:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713189:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826421.713192:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826421.713209:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713217:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5200/0x68019081f349e020 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713352:0:46361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713360:0:46361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713367:0:46361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713371:0:46361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826421.713374:0:46361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713380:0:46361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713389:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xc95d90ba (ffff9bbe0fe8c100) 00010000:00010000:2.0:1787826421.713391:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826421.713395:0:46361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713400:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e035 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xc95d90ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713445:0:46361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349e019 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd734 expref: 48 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713455:0:46361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:2.0:1787826421.713458:0:46361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826421.713462:0:46361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5800/0x68019081f349e019 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd734 expref: 48 pid: 46361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.713470:0:46361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe08bf5800, rc -2) 00000100:00100000:3.0:1787826421.713698:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe16078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2401:x1874668790028160:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 7976us (8251us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826421.713710:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3527 00000100:00100000:3.0:1787826422.080821:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826422.080845:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe08302d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778727040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826422.080942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826422.081074:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778727040 00000100:00100000:3.0:1787826422.081082:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778727040 00000100:00100000:3.0:1787826422.081136:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:3.0:1787826422.081145:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1874668778727040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826422.081173:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 670985664 pending 0 free 3894722560 avail 3663200256 00000100:00100000:3.0:1787826422.081213:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1874668778727040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.081220:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00100000:3.0:1787826422.081269:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe08302d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778727040:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787826422.082059:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826422.083250:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826422.083268:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778727168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826422.083328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826422.083377:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778727168 00000100:00100000:2.0:1787826422.083384:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778727168 00000100:00100000:2.0:1787826422.083432:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:2.0:1787826422.083441:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3645:x1874668778727168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826422.083579:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570133952 pending 0 free 3828547584 avail 3597025280 00000100:00100000:2.0:1787826422.083629:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3645:x1874668778727168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.083637:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00080000:2.0:1787826422.083657:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826422.083733:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778727168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826422.219163:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826422.219543:0:45684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790028416 00000100:00100000:1.0:1787826422.219554:0:45684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790028416 00000100:00100000:1.0:1787826422.219638:0:45684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3529 00000100:00100000:1.0:1787826422.219649:0:45684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+61:2400:x1874668790028416:12345-192.168.203.9@tcp:63:ll_sa.0 00010000:00010000:1.0:1787826422.219683:0:45684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.219701:0:45684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e043 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd742 expref: -99 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219759:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219772:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219785:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219798:0:45684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219804:0:45684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219811:0:45684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219877:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219885:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219891:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219896:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826422.219900:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219907:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219918:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826422.219921:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.219925:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219931:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e04a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219943:0:45684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219948:0:45684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219953:0:45684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219958:0:45684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826422.219961:0:45684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219967:0:45684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219974:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0xa1f7a3ac (ffff9bbe1342ff00) 00010000:00010000:1.0:1787826422.219977:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.219979:0:45684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.219984:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e051 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0xa1f7a3ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.220012:0:45684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e043 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd742 expref: 62 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.220022:0:45684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9bbe0fe8c000) 00010000:00010000:1.0:1787826422.220024:0:45684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826422.220028:0:45684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e043 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd742 expref: 62 pid: 45684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.220036:0:45684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc -2) 00000100:00100000:1.0:1787826422.220099:0:45684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:fa787581-6963-4f39-b38f-836255c71d7c+61:2400:x1874668790028416:12345-192.168.203.9@tcp:63:ll_sa.0 Request processed in 452us (945us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826422.220107:0:45684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3529 00000100:00080000:3.0:1787826422.221140:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787826422.276669:0:59798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 104: Copy tool data field ============= 06:27:01 (1787826421) 00000100:00100000:1.0:1787826422.346515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826422.346554:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790028544 00000100:00100000:1.0:1787826422.346563:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790028544 00000100:00100000:1.0:1787826422.346627:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112041 00000100:00100000:1.0:1787826422.346637:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+61:88145:x1874668790028544:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826422.346655:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.346674:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd749 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.346747:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.346762:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.346774:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.346790:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.346797:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.346802:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347319:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347328:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347335:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347341:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826422.347344:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347351:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347363:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:1.0:1787826422.347367:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.347371:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347377:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e05f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347389:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347394:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347399:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347403:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826422.347406:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347415:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347422:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe558ad (ffff9bbe1342ff00) 00010000:00010000:1.0:1787826422.347424:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.347426:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347431:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e066 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347464:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e058 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd749 expref: 62 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347474:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:1.0:1787826422.347476:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.347480:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd749 expref: 62 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.347489:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826422.347561:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+61:88145:x1874668790028544:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 924us (1054us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826422.347579:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112041 00000100:00100000:1.0:1787826422.355162:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826422.355235:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790028800 00000100:00100000:2.0:1787826422.355244:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790028800 00000100:00100000:2.0:1787826422.355305:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112042 00000100:00100000:2.0:1787826422.355314:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+61:88145:x1874668790028800:12345-192.168.203.9@tcp:36:lfs.0 00010000:00010000:2.0:1787826422.355366:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826422.355392:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41205c00/0x68019081f349d3cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce74 expref: 61 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.355411:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:2.0:1787826422.355415:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826422.355479:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.355493:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce89 expref: 46 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.355502:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.355537:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce89 expref: 46 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.355549:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce89 expref: 46 pid: 45683 timeout: 3160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.355562:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdde00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778727296:192.168.203.9@tcp:104: 00000100:00100000:2.0:1787826422.355657:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bbe0f53dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826422.364256:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826422.364338:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdde00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1874668778727296:192.168.203.9@tcp:104: 00010000:00010000:3.0:1787826422.364366:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.364432:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790028928 00000100:00100000:1.0:1787826422.364440:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790028928 00010000:00010000:1.0:1787826422.364476:0:9521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce89 expref: 47 pid: 45683 timeout: 3160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.364519:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3210 00000100:00100000:1.0:1787826422.364528:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0c7dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+47:2402:x1874668790028928:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826422.364543:0:9521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826422.364550:0:9521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce89 expref: 47 pid: 45683 timeout: 3160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.364562:0:9521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce89 expref: 47 pid: 45683 timeout: 3160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.364595:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe09ceba00/0x68019081f349d40a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fce89 expref: 47 pid: 45683 timeout: 3160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.364609:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:1.0:1787826422.364614:0:9521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.364624:0:9521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.364631:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.364653:0:9521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826422.364704:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0c7dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+46:2402:x1874668790028928:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 176us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.364711:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3210 00010000:00010000:3.0:1787826422.364953:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.364961:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.364984:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe558ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.364993:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365006:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365581:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365591:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365599:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826422.365613:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3758a5f reply state 000000008a2e1a02 transno 8590016933 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365624:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365631:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:3.0:1787826422.365633:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826422.365636:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787826422.365641:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x56:0x0]: returning size 4096 00010000:00010000:3.0:1787826422.365649:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365655:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365660:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365665:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365671:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826422.365675:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365681:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365689:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:3.0:1787826422.365691:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826422.365695:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365701:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2e00/0x68019081f349e06d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826422.365712:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3758a5f reply state 000000008a2e1a02 transno 8590016933 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365719:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.365725:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe558ad (ffff9bbe12458c00) 00010000:00010000:3.0:1787826422.365727:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826422.365729:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787826422.365791:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa787581-6963-4f39-b38f-836255c71d7c+62:88145:x1874668790028800:12345-192.168.203.9@tcp:36:lfs.0 Request processed in 10476us (10636us total) trans 8590016933 rc 0/0 00000100:00100000:3.0:1787826422.365799:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112042 00000001:00080000:2.0:1787826422.369009:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016933 is committed 00000004:00080000:2.0:1787826422.369023:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 31 committed 00000004:00080000:2.0:1787826422.369041:0:38181:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 28 committed 00010000:00010000:3.0:1787826422.369099:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369115:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369123:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369129:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41794c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826422.369133:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369141:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369158:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe558ad (ffff9bbe12458c00) 00010000:00010000:3.0:1787826422.369162:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826422.369167:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369173:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e074 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369193:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369200:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369205:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369210:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf41795a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826422.369213:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369219:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369225:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe12458d00) 00010000:00010000:3.0:1787826422.369228:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826422.369230:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.369235:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41795a00/0x68019081f349e07b lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.417924:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826422.418136:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790029056 00000100:00100000:1.0:1787826422.418146:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790029056 00000100:00100000:1.0:1787826422.418195:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112043 00000100:00100000:1.0:1787826422.418203:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+46:88152:x1874668790029056:12345-192.168.203.9@tcp:101:mkdir.0 00010000:00010000:1.0:1787826422.418223:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.418242:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd750 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.418297:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e089 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.418308:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.418319:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826422.418362:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787826422.418365:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826422.418383:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.418404:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd750 expref: 48 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.418418:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e089 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd750 expref: 47 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.418426:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:1.0:1787826422.418429:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826422.418432:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f6400, rc 0) 00000100:00100000:1.0:1787826422.418507:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+47:88152:x1874668790029056:12345-192.168.203.9@tcp:101:mkdir.0 Request processed in 303us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.418514:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112043 00000100:00100000:3.0:1787826422.428211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826422.428264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826422.428293:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790029184 00000100:00100000:3.0:1787826422.428302:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790029184 00000100:00100000:3.0:1787826422.428348:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790029440 00000100:00100000:3.0:1787826422.428351:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790029440 00000100:00100000:3.0:1787826422.428373:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112044 00000100:00100000:3.0:1787826422.428384:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2401:x1874668790029184:12345-192.168.203.9@tcp:41:mkdir.0 00000004:00000024:3.0:1787826422.428419:0:12105:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440505856 avail 1294266368 00000100:00100000:3.0:1787826422.428495:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+48:2401:x1874668790029184:12345-192.168.203.9@tcp:41:mkdir.0 Request processed in 112us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.428503:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112044 00000100:00100000:3.0:1787826422.428520:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112045 00000100:00100000:3.0:1787826422.428527:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+47:88152:x1874668790029440:12345-192.168.203.9@tcp:36:mkdir.0 00010000:00010000:3.0:1787826422.428578:0:12105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826422.428606:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e089 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd750 expref: 47 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.428623:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:3.0:1787826422.428627:0:12105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826422.428716:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+46:88152:x1874668790029440:12345-192.168.203.9@tcp:36:mkdir.0 Request processed in 189us (452us total) trans 0 rc -17/-17 00000100:00100000:3.0:1787826422.428722:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112045 00000100:00100000:1.0:1787826422.440642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826422.440713:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790029568 00000100:00100000:2.0:1787826422.440723:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790029568 00000100:00100000:2.0:1787826422.440780:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112046 00000100:00100000:2.0:1787826422.440790:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+46:88152:x1874668790029568:12345-192.168.203.9@tcp:101:mkdir.0 00010000:00010000:2.0:1787826422.440809:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.440828:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349e090 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd757 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.440912:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349e097 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.440926:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349e097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.440937:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349e097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826422.440984:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787826422.440989:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826422.441007:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349e097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.441034:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349e090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd757 expref: 48 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.441050:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2c00/0x68019081f349e097 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd757 expref: 47 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.441058:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:2.0:1787826422.441061:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826422.441065:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2c00, rc 0) 00000100:00100000:2.0:1787826422.441128:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bb930b33-002c-4632-a90b-528a6bdcd03e+47:88152:x1874668790029568:12345-192.168.203.9@tcp:101:mkdir.0 Request processed in 339us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.441136:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112046 00000100:00100000:0.0:1787826422.450686:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826422.452865:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790029696 00000100:00100000:1.0:1787826422.452878:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790029696 00000100:00100000:1.0:1787826422.452938:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112047 00000100:00100000:1.0:1787826422.452947:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+47:88152:x1874668790029696:12345-192.168.203.9@tcp:101:mkdir.0 00010000:00010000:1.0:1787826422.452977:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.452997:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e09e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd75e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453055:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453070:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453080:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453093:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453101:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453108:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453183:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e0b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453192:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453198:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826422.453235:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x56:0x0]: returning size 4096 00000004:00200000:1.0:1787826422.453239:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826422.453257:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453270:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453276:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453282:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453288:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453294:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826422.453297:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453304:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453316:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:1.0:1787826422.453320:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.453324:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453330:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e0a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453344:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453352:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453357:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453362:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826422.453364:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453370:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453377:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe558ad (ffff9bbe1342ff00) 00010000:00010000:1.0:1787826422.453379:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.453382:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453387:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e0ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453414:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e09e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd75e expref: 49 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453432:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd75e expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.453439:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe1342f300) 00010000:00010000:1.0:1787826422.453442:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826422.453444:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7c00, rc 0) 00000100:00100000:1.0:1787826422.453517:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+48:88152:x1874668790029696:12345-192.168.203.9@tcp:101:mkdir.0 Request processed in 570us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.453525:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112047 00000100:00100000:3.0:1787826422.470259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826422.470354:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790029824 00000100:00100000:2.0:1787826422.470363:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790029824 00000100:00100000:2.0:1787826422.470423:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112048 00000100:00100000:2.0:1787826422.470433:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+48:88158:x1874668790029824:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1787826422.470450:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.470481:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349e0ba lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd765 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470544:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470562:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470585:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470600:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470607:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470613:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470654:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470661:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470667:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470674:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470680:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826422.470685:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470692:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470704:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe1342f300) 00010000:00010000:2.0:1787826422.470707:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826422.470712:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470718:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e0c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470732:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470738:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470744:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470749:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c3e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826422.470752:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470757:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470764:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x29cdb50 (ffff9bbe16cc5100) 00010000:00010000:2.0:1787826422.470766:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826422.470769:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470774:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e0c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470809:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349e0ba lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd765 expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470820:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe1342f300) 00010000:00010000:2.0:1787826422.470822:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826422.470825:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3600/0x68019081f349e0ba lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd765 expref: 49 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.470834:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3600, rc 0) 00000100:00100000:2.0:1787826422.470916:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+48:88158:x1874668790029824:12345-192.168.203.9@tcp:101:rm.0 Request processed in 484us (665us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826422.470922:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112048 00000100:00100000:3.0:1787826422.486838:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826422.486994:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790030080 00000100:00100000:0.0:1787826422.487004:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790030080 00000100:00100000:0.0:1787826422.487065:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112049 00000100:00100000:0.0:1787826422.487075:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe08303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+48:88160:x1874668790030080:12345-192.168.203.9@tcp:101:dd.0 00010000:00010000:0.0:1787826422.487096:0:12105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826422.487100:0:12105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787826422.487126:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7c00/0x68019081f349e0b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd75e expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.487145:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe1342f300) 00010000:00010000:0.0:1787826422.487156:0:12105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826422.487173:0:12105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4200/0x68019081f349e0cf lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd76c expref: -99 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.487275:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.487288:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.487298:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.487311:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.487318:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.487325:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826422.487834:0:12105:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd7:0x0], index 0: 0 00010000:00010000:0.0:1787826422.488118:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4c00/0x68019081f349e0e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x151:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488130:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4c00/0x68019081f349e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488139:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4c00/0x68019081f349e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488174:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488182:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488189:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488196:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488202:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe08bf4400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826422.488206:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488214:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488225:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe16467c00) 00010000:00010000:0.0:1787826422.488228:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826422.488232:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488239:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0d6 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826422.488251:0:12105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004063ecfc reply state 00000000b341084e transno 8590016934 ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488262:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488268:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x29cdb50 (ffff9bbe16467000) 00010000:00010000:0.0:1787826422.488272:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826422.488275:0:12105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826422.488304:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4200/0x68019081f349e0cf lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd76c expref: 50 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488324:0:12105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4c00/0x68019081f349e0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd76c expref: 49 pid: 12105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.488331:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x151:0x0].0x0 (ffff9bbe16467b00) 00010000:00010000:0.0:1787826422.488333:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826422.488335:0:12105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe08bf4c00, rc 0) 00000100:00100000:0.0:1787826422.488444:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe08303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+50:88160:x1874668790030080:12345-192.168.203.9@tcp:101:dd.0 Request processed in 1370us (1616us total) trans 8590016934 rc 0/0 00000100:00100000:0.0:1787826422.488517:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112049 00000100:00100000:2.0:1787826422.498686:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826422.499320:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790030336 00000100:00100000:0.0:1787826422.499330:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790030336 00000100:00100000:0.0:1787826422.499393:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2807 00000100:00100000:0.0:1787826422.499403:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+50:88160:x1874668790030336:12345-192.168.203.9@tcp:35:dd.0 00000100:00100000:0.0:1787826422.499684:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+51:88160:x1874668790030336:12345-192.168.203.9@tcp:35:dd.0 Request processed in 283us (1006us total) trans 8590016935 rc 0/0 00000100:00100000:0.0:1787826422.499709:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2807 00000100:00100000:0.0:1787826422.543588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826422.543622:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790030464 00000100:00100000:0.0:1787826422.543631:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790030464 00000100:00100000:0.0:1787826422.543678:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112050 00000100:00100000:0.0:1787826422.543686:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+51:88162:x1874668790030464:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1787826422.543710:0:23845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826422.543729:0:23845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4200/0x68019081f349e0f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd773 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.543789:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.543803:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.543814:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.543826:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.543833:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.543839:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.543935:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5c00/0x68019081f349e107 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.543944:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5c00/0x68019081f349e107 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.543955:0:23845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5c00/0x68019081f349e107 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826422.543985:0:23845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x56:0x0]: returning size 4096 00000004:00200000:0.0:1787826422.543989:0:23845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826422.544008:0:23845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5c00/0x68019081f349e107 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544020:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544025:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544031:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544037:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe08bf4400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826422.544041:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544048:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544059:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:0.0:1787826422.544062:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826422.544067:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544073:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4400/0x68019081f349e0f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544088:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544095:0:23845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544100:0:23845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544105:0:23845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe08bf4000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1787826422.544108:0:23845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544113:0:23845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544120:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe558ad (ffff9bbe16467c00) 00010000:00010000:0.0:1787826422.544122:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826422.544125:0:23845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544131:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4000/0x68019081f349e100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544157:0:23845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf4200/0x68019081f349e0f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd773 expref: 53 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544169:0:23845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5c00/0x68019081f349e107 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd773 expref: 52 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.544181:0:23845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe16467d00) 00010000:00010000:0.0:1787826422.544253:0:23845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787826422.544256:0:23845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe08bf5c00, rc 0) 00000100:00100000:0.0:1787826422.544314:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+52:88162:x1874668790030464:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 627us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.544321:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112050 00000100:00100000:0.0:1787826422.560555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826422.560631:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790030592 00000100:00100000:2.0:1787826422.560640:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790030592 00000100:00100000:2.0:1787826422.560703:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112051 00000100:00100000:2.0:1787826422.560713:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+60:88164:x1874668790030592:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826422.560736:0:25759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.560754:0:25759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e10e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd77a expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.560822:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e115 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.560836:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e115 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.560878:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e115 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826422.560963:0:25759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787826422.560968:0:25759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826422.560988:0:25759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e115 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.561012:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e10e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd77a expref: 62 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.561028:0:25759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2800/0x68019081f349e115 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd77a expref: 61 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.561038:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:3.0:1787826422.561040:0:25759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826422.561044:0:25759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c2800, rc 0) 00000100:00100000:3.0:1787826422.561111:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa787581-6963-4f39-b38f-836255c71d7c+61:88164:x1874668790030592:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 400us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.561118:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112051 00000100:00100000:0.0:1787826422.565463:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1787826422.565531:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790030720 00000100:00100000:1.0:1787826422.565541:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790030720 00000100:00100000:1.0:1787826422.565611:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112052 00000100:00100000:1.0:1787826422.565621:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+61:88164:x1874668790030720:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1787826422.565641:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.565659:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e11c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd781 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565720:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565735:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565747:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565762:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565771:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565777:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565899:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349e131 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565908:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349e131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565915:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349e131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826422.565947:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x56:0x0]: returning size 4096 00000004:00200000:1.0:1787826422.565950:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826422.565968:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349e131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565981:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565987:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565993:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.565998:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566008:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826422.566012:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566019:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566032:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bbe0812c600) 00010000:00010000:1.0:1787826422.566035:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.566039:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566045:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6000/0x68019081f349e123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566057:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566063:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566069:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566074:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe083f6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1787826422.566077:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566082:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566093:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe558ad (ffff9bbe1342ff00) 00010000:00010000:1.0:1787826422.566096:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.566098:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566103:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6400/0x68019081f349e12a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe558ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566131:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f6600/0x68019081f349e11c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd781 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566144:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe083f7600/0x68019081f349e131 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd781 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.566151:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe16467d00) 00010000:00010000:1.0:1787826422.566154:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787826422.566156:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbe083f7600, rc 0) 00000100:00100000:1.0:1787826422.566211:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+62:88164:x1874668790030720:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 592us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.566219:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112052 00000100:00100000:0.0:1787826422.569141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826422.569230:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790030848 00000100:00100000:2.0:1787826422.569237:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790030848 00000100:00100000:2.0:1787826422.569284:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112053 00000100:00100000:2.0:1787826422.569293:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+62:88164:x1874668790030848:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1787826422.569314:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.569332:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349e138 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd788 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569389:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569403:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569413:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569424:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569432:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569443:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569529:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e14d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x151:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569538:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e14d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x151:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569545:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e14d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x151:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826422.569594:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x151:0x0]: returning size 0 00000004:00200000:2.0:1787826422.569598:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826422.569615:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e14d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x151:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569627:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e14d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569635:0:25756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569641:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569648:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569655:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569661:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826422.569665:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569673:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569684:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe16467d00) 00010000:00010000:2.0:1787826422.569687:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826422.569691:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569697:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2600/0x68019081f349e13f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569712:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569718:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569723:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569728:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbf417c2400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1787826422.569730:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569736:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569743:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x29cdb50 (ffff9bbe16467000) 00010000:00010000:2.0:1787826422.569746:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826422.569748:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569754:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c2400/0x68019081f349e146 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569781:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3c00/0x68019081f349e138 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd788 expref: 64 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569795:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf417c3e00/0x68019081f349e14d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd788 expref: 63 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.569802:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x151:0x0].0x0 (ffff9bbe16467b00) 00010000:00010000:2.0:1787826422.569804:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826422.569806:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf417c3e00, rc 0) 00000100:00100000:2.0:1787826422.569957:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fa787581-6963-4f39-b38f-836255c71d7c+63:88164:x1874668790030848:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 664us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.569965:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112053 00000100:00100000:0.0:1787826422.576506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826422.576637:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790030976 00000100:00100000:3.0:1787826422.576646:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790030976 00000100:00100000:3.0:1787826422.576722:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6517 00000100:00100000:3.0:1787826422.576731:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+6:2401:x1874668790030976:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.576748:0:8605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.576773:0:8605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cf70200/0x68019081f349e154 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd78f expref: -99 pid: 8605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826422.576798:0:8605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826422.576817:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd7:0x0].0x0 since=3060s v=(0 0) 00010000:00010000:3.0:1787826422.576822:0:8605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826422.576830:0:8605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cf70200/0x68019081f349e154 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd78f expref: 7 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.576882:0:8605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001cf70200/0x68019081f349e154 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd78f expref: 7 pid: 8605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.576897:0:8605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41795a00, rc 0) 00000100:00100000:3.0:1787826422.576950:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+7:2401:x1874668790030976:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 220us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.576958:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6517 00000100:00080000:2.0:1787826422.577266:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826422.581272:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826422.581347:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790031104 00000100:00100000:3.0:1787826422.581358:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790031104 00000100:00100000:3.0:1787826422.581418:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112054 00000100:00100000:3.0:1787826422.581427:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+63:88164:x1874668790031104:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.581447:0:45683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.581468:0:45683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e15b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf88c47bd9f8fd796 expref: -99 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.581543:0:45683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e162 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.581556:0:45683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.581575:0:45683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826422.581616:0:45683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x56:0x0]: returning size 4096 00000004:00200000:3.0:1787826422.581621:0:45683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826422.581639:0:45683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.581662:0:45683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794c00/0x68019081f349e15b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd796 expref: 65 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.581679:0:45683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbf41794800/0x68019081f349e162 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xf88c47bd9f8fd796 expref: 64 pid: 45683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.581687:0:45683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x0 (ffff9bbe16467d00) 00010000:00010000:3.0:1787826422.581689:0:45683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826422.581692:0:45683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bbf41794800, rc 0) 00000100:00100000:3.0:1787826422.581760:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:fa787581-6963-4f39-b38f-836255c71d7c+64:88164:x1874668790031104:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 333us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.581767:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112054 00000100:00100000:1.0:1787826422.589836:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826422.589991:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790031360 00000100:00100000:0.0:1787826422.590000:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790031360 00000100:00100000:0.0:1787826422.590060:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112055 00000100:00100000:0.0:1787826422.590070:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+64:88164:x1874668790031360:12345-192.168.203.9@tcp:58:lfs.0 00000040:00080000:0.0:1787826422.590250:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9740, 144 off1316304 00000100:00100000:0.0:1787826422.590329:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fa787581-6963-4f39-b38f-836255c71d7c+64:88164:x1874668790031360:12345-192.168.203.9@tcp:58:lfs.0 Request processed in 260us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.590337:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112055 00000001:00080000:1.0:1787826422.594775:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968223 is committed 00000001:00080000:2.0:1787826422.596325:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968208 is committed 00010000:00010000:2.0:1787826422.656806:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787826423.296078:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826423.296087:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826423.296420:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9741 count 38 00000040:00080000:0.0:1787826423.296429:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:1.0:1787826423.323238:0:59847:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826423.323248:0:59847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826423.324151:0:59847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9741 count 38 00000040:00080000:1.0:1787826423.324172:0:59847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:1.0:1787826423.324253:0:59847:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826423.324257:0:59847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826423.325202:0:59847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9741 count 38 00000040:00080000:1.0:1787826423.325211:0:59847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:1.0:1787826423.325297:0:59847:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826423.325301:0:59847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826423.326260:0:59847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9741 count 38 00000040:00080000:1.0:1787826423.326267:0:59847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:0.0:1787826423.681728:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826423.751075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826423.751120:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826423.751146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826423.751161:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790031488 00000100:00100000:3.0:1787826423.751169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826423.751172:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790031488 00000100:00100000:3.0:1787826423.751193:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826423.751214:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1787826423.751237:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 819 00000100:00100000:2.0:1787826423.751252:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0a8e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668790031488:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826423.751256:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826423.751282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1787826423.751441:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790032000 00000100:00100000:0.0:1787826423.751447:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790032000 00000100:00100000:0.0:1787826423.751485:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790032512 00000100:00100000:0.0:1787826423.751488:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790032512 00000100:00100000:0.0:1787826423.751506:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790031872 00000100:00100000:0.0:1787826423.751509:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790031872 00000100:00100000:0.0:1787826423.751532:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3603 00000100:00100000:0.0:1787826423.751540:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2401:x1874668790032000:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1787826423.751600:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0a8e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bde37df-3766-41d5-a558-be13e58235fe+13:2401:x1874668790031488:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 351us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.751608:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 819 00000100:00080000:2.0:1787826423.752446:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826423.752451:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826423.753658:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826423.753700:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790031744 00000100:00100000:3.0:1787826423.753707:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790031744 00000100:00100000:3.0:1787826423.753756:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790032256 00000100:00100000:3.0:1787826423.753760:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790032256 00000100:00100000:3.0:1787826423.753781:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790031616 00000100:00100000:3.0:1787826423.753784:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790031616 00000100:00100000:3.0:1787826423.753803:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790032128 00000100:00100000:3.0:1787826423.753806:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790032128 00000100:00100000:3.0:1787826423.753825:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5201 00000100:00100000:3.0:1787826423.753833:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668790031744:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826423.754659:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790032384 00000100:00100000:1.0:1787826423.754667:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790032384 00000100:00100000:1.0:1787826423.754698:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3604 00000100:00100000:1.0:1787826423.754708:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668790032512:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826423.754766:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+9:2401:x1874668790032512:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 61us (3573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.754773:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3604 00000100:00100000:1.0:1787826423.754789:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3605 00000100:00100000:1.0:1787826423.754795:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668790031872:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826423.754818:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2401:x1874668790031872:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (3578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.754823:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3605 00000100:00100000:1.0:1787826423.754833:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3606 00000100:00100000:1.0:1787826423.754838:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+7:2401:x1874668790032384:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1787826423.755632:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa787581-6963-4f39-b38f-836255c71d7c+7:2401:x1874668790032384:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 787us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.755640:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3606 00000100:00100000:0.0:1787826423.757494:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2401:x1874668790032000:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 5944us (6336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.757510:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3603 00000100:00100000:0.0:1787826423.757572:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5202 00000100:00100000:0.0:1787826423.757585:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1003a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668790032256:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826423.757637:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1003a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+48:2401:x1874668790032256:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 57us (6468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.757643:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5202 00000100:00100000:0.0:1787826423.757672:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5203 00000100:00100000:0.0:1787826423.757680:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+52:2401:x1874668790031616:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826423.757706:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb930b33-002c-4632-a90b-528a6bdcd03e+52:2401:x1874668790031616:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (6491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.757712:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5203 00000100:00100000:0.0:1787826423.757724:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5204 00000100:00100000:0.0:1787826423.757730:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+64:2401:x1874668790032128:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826423.757758:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe10038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa787581-6963-4f39-b38f-836255c71d7c+64:2401:x1874668790032128:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 27us (6475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.757764:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5204 00000100:00080000:0.0:1787826423.757877:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826423.757882:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826423.761162:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2401:x1874668790031744:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 7317us (10028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.761182:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5201 00000040:00080000:1.0:1787826424.321834:0:59897:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1787826424.321844:0:59897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826424.322098:0:59897:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9741 count 38 00000040:00080000:1.0:1787826424.322121:0:59897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1787826424.640111:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe100383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778727552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.640202:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778727424:0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.640206:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826424.640279:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778727680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826424.640335:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778727552 00000100:00100000:3.0:1787826424.640343:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778727552 00000100:00100000:3.0:1787826424.640403:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3530 00000100:00100000:3.0:1787826424.640412:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778727552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.640715:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe100392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778728064:0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.640745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.640782:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778728576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.640809:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.640826:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778729088:0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.640845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.640906:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778728576 00000100:00100000:2.0:1787826424.640910:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778728576 00000100:00100000:2.0:1787826424.640953:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607 00000100:00100000:2.0:1787826424.640960:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778728576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.640996:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874668778728576:12345-0@lo:400:kworker.0 Request processed in 37us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.641003:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607 00000100:00100000:2.0:1787826424.641025:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778728064 00000100:00100000:2.0:1787826424.641028:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778728064 00000100:00100000:2.0:1787826424.641053:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778729088 00000100:00100000:2.0:1787826424.641057:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778729088 00000100:00100000:2.0:1787826424.641074:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5205 00000100:00100000:2.0:1787826424.641080:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778728064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.641111:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874668778728064:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.641117:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5205 00000100:00100000:2.0:1787826424.641129:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5206 00000100:00100000:2.0:1787826424.641134:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778729088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.641159:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874668778729088:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.641165:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5206 00000100:00100000:0.0:1787826424.641764:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826424.641800:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778727936:0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.641829:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe100392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874668778728064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.641842:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.641845:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778728576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.641881:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874668778729088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.641888:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10038b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778728448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.641918:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826424.641941:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778728960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.641957:0:38193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778727424 00000100:00100000:2.0:1787826424.641963:0:38193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778727424 00000100:00100000:0.0:1787826424.641968:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.642001:0:38193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1787826424.642010:0:38193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf1337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778727424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.642012:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778727936 00000100:00100000:0.0:1787826424.642019:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778727936 00000100:00100000:0.0:1787826424.642055:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778728448 00000100:00100000:0.0:1787826424.642059:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778728448 00000100:00100000:2.0:1787826424.642060:0:38193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf1337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778727424:12345-0@lo:400:kworker.0 Request processed in 51us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.642070:0:38193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1787826424.642092:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5207 00000100:00100000:0.0:1787826424.642103:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778727936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.642107:0:45682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5208 00000100:00100000:2.0:1787826424.642118:0:45682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778728448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.642156:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874668778727936:12345-0@lo:400:kworker.0 Request processed in 56us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.642163:0:45682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874668778728448:12345-0@lo:400:kworker.0 Request processed in 45us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.642170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5207 00000100:00100000:2.0:1787826424.642182:0:45682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5208 00000100:00100000:0.0:1787826424.642517:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778728960 00000100:00100000:0.0:1787826424.642522:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778728960 00000100:00100000:0.0:1787826424.642567:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3608 00000100:00100000:0.0:1787826424.642575:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778728960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.642612:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0dd2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778728960:12345-0@lo:400:kworker.0 Request processed in 38us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.642618:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3608 00000100:00100000:0.0:1787826424.642657:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778727424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.642670:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874668778727936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.642679:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10038b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874668778728448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.642686:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968208 gen 2 00000004:00080000:0.0:1787826424.642691:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe159f3480, transno 4294968206 00000004:00080000:0.0:1787826424.642701:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe159f3c00, transno 4294968207 00000004:00080000:0.0:1787826424.642703:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbe159f21c0, transno 4294968208 00000100:00100000:0.0:1787826424.642707:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778728960:0@lo:400:kworker.0 00000004:00080000:0.0:1787826424.642832:0:38204:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00080000:2.0:1787826424.642929:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826424.642933:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826424.642936:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826424.643839:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826424.643963:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778728192:0@lo:400:kworker.0 00000100:00100000:1.0:1787826424.643995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826424.644090:0:45683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778727680 00000100:00100000:0.0:1787826424.644097:0:45683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778727680 00000100:00100000:0.0:1787826424.644136:0:45683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5209 00000100:00100000:0.0:1787826424.644144:0:45683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778727680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.644187:0:45683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0b9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778727680:12345-0@lo:400:kworker.0 Request processed in 44us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.644195:0:45683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5209 00000100:00100000:1.0:1787826424.644967:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778728704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826424.645004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826424.645049:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778727680:0@lo:400:kworker.0 00000100:00100000:1.0:1787826424.645071:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826424.645078:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778727808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826424.645104:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826424.645124:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778728320:0@lo:400:kworker.0 00000100:00100000:1.0:1787826424.645147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826424.645165:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778728832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826424.645186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826424.645664:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778728704 00000100:00100000:0.0:1787826424.645672:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778728704 00000100:00100000:0.0:1787826424.645719:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3531 00000100:00100000:0.0:1787826424.645728:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778728704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826424.645781:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe0e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778728704:12345-0@lo:400:kworker.0 Request processed in 55us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.645789:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3531 00000100:00100000:3.0:1787826424.648717:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778727552:12345-0@lo:400:kworker.0 Request processed in 8297us (8500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.648733:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3530 00000100:00100000:3.0:1787826424.648794:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778727808 00000100:00100000:3.0:1787826424.648802:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778727808 00000100:00100000:3.0:1787826424.648880:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:3.0:1787826424.648889:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778727808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826424.648918:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570133952 pending 0 free 3828547584 avail 3597025280 00000100:00100000:3.0:1787826424.648959:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778727808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (3853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.648966:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:3.0:1787826424.649010:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe100383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778727552:0@lo:400:kworker.0 00000100:00100000:3.0:1787826424.649055:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778728320 00000100:00100000:3.0:1787826424.649059:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778728320 00000100:00100000:3.0:1787826424.649093:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5210 00000100:00100000:3.0:1787826424.649100:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778728320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826424.649132:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874668778728320:12345-0@lo:400:kworker.0 Request processed in 33us (3983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.649139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5210 00000100:00080000:3.0:1787826424.649167:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826424.649172:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826424.656378:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778728704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826424.656420:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778727808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826424.656434:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874668778728320:0@lo:400:kworker.0 00000100:00100000:2.0:1787826424.657388:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778728192 00000100:00100000:2.0:1787826424.657398:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778728192 00000100:00100000:2.0:1787826424.657460:0:45681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778728832 00000100:00100000:2.0:1787826424.657464:0:45681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778728832 00000100:00100000:2.0:1787826424.657513:0:45681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3609 00000100:00100000:2.0:1787826424.657524:0:45681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778728192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826424.657537:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610 00000100:00100000:1.0:1787826424.657551:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778728832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826424.657628:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778728832:12345-0@lo:400:kworker.0 Request processed in 81us (12439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.657638:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610 00000100:00080000:3.0:1787826424.657742:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826424.657823:0:45681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe1283d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1874668778728192:12345-0@lo:400:kworker.0 Request processed in 300us (13824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.657831:0:45681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3609 00000100:00100000:1.0:1787826424.664344:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968223 gen 2 00000004:00080000:1.0:1787826424.664356:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf0cb58780, transno 4294968221 00000004:00080000:1.0:1787826424.664376:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf0cb5a1c0, transno 4294968222 00000004:00080000:1.0:1787826424.664379:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bbf0cb592c0, transno 4294968223 00000100:00100000:1.0:1787826424.664387:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778728832:0@lo:400:kworker.0 00000004:00080000:0.0:1787826424.664714:0:38202:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:0.0:1787826424.664748:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874668778728192:0@lo:400:kworker.0 00010000:00010000:2.0:1787826424.703963:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826425.152095:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826425.152118:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778729216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826425.152183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826425.152309:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778729216 00000100:00100000:2.0:1787826425.152328:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778729216 00000100:00100000:2.0:1787826425.152388:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:2.0:1787826425.152398:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778729216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826425.152426:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 670985664 pending 0 free 3894722560 avail 3663200256 00000100:00100000:2.0:1787826425.152522:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778729216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.152530:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00100000:1.0:1787826425.153097:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778729216:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826425.733328:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787826425.984170:0:59945:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787826425.984179:0:59945:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787826425.984748:0:59945:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787826425.984759:0:59945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787826426.688403:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826426.688426:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778729344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826426.688487:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826426.688766:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826426.688777:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778729472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826426.688816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826426.688934:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778729344 00000100:00100000:0.0:1787826426.688942:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778729344 00000100:00100000:0.0:1787826426.688988:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778729472 00000100:00100000:0.0:1787826426.688992:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778729472 00000100:00100000:0.0:1787826426.689015:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3532 00000100:00100000:0.0:1787826426.689034:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778729344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826426.689164:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1787826426.689209:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778729344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.689216:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3532 00000100:00100000:0.0:1787826426.689232:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3533 00000100:00100000:0.0:1787826426.689238:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778729472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826426.689254:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440505856 avail 1294266368 00000100:00100000:0.0:1787826426.689282:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778729472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.689287:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3533 00000100:00100000:3.0:1787826426.689502:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778729472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826426.689758:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778729344:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787826426.751996:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826427.200017:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778729600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826427.200017:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778729728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826427.200191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826427.200315:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826427.208005:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778729600 00000100:00100000:0.0:1787826427.208019:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778729600 00000100:00080000:1.0:1787826427.208136:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826427.209667:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778729728 00000100:00100000:3.0:1787826427.209679:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778729728 00000100:00080000:1.0:1787826427.209779:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826427.209823:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222 00000100:00100000:3.0:1787826427.209835:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778729600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826427.209888:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570133952 pending 0 free 3828547584 avail 3597025280 00000100:00100000:3.0:1787826427.209987:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778729600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (9797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826427.209994:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222 00000100:00100000:3.0:1787826427.210012:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223 00000100:00100000:3.0:1787826427.210018:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778729728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826427.210034:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 670985664 pending 0 free 3894722560 avail 3663200256 00000100:00100000:3.0:1787826427.210066:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874668778729728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (9751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826427.210072:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223 00000100:00100000:1.0:1787826427.213847:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778729600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826427.214005:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874668778729728:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787826427.718135:0:38181:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8590016935 is committed 00010000:00010000:3.0:1787826427.718182:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826427.718195:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826427.718203:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826427.718209:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bbe08bf5000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1787826427.718214:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826427.718223:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826427.718241:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x56:0x0].0x29cdb50 (ffff9bbe16467000) 00010000:00010000:3.0:1787826427.718244:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826427.718249:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826427.718259:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bbe08bf5000/0x68019081f349e0dd lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x56:0x0].0x29cdb50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826427.776352:0:10335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826428.804225:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826428.874606:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826428.875313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826428.875350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826428.875376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826428.875398:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826428.875434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826428.875456:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826428.875476:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826428.875503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1787826428.875549:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790033152 00000100:00100000:3.0:1787826428.875562:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790033152 00000100:00100000:3.0:1787826428.875635:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790033664 00000100:00100000:3.0:1787826428.875639:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790033664 00000100:00100000:3.0:1787826428.875661:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790033024 00000100:00100000:3.0:1787826428.875664:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790033024 00000100:00100000:3.0:1787826428.875687:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790033536 00000100:00100000:3.0:1787826428.875690:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790033536 00000100:00100000:3.0:1787826428.875713:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3611 00000100:00100000:3.0:1787826428.875724:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668790033152:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.875821:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+18:2402:x1874668790033152:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 98us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.875830:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3611 00000100:00100000:3.0:1787826428.875875:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3612 00000100:00100000:3.0:1787826428.875883:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668790033664:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.875910:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+9:2402:x1874668790033664:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.875916:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3612 00000100:00100000:3.0:1787826428.875926:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3613 00000100:00100000:3.0:1787826428.875932:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2402:x1874668790033024:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.875954:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bb930b33-002c-4632-a90b-528a6bdcd03e+21:2402:x1874668790033024:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.875960:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3613 00000100:00100000:3.0:1787826428.875969:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3614 00000100:00100000:3.0:1787826428.875975:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+7:2402:x1874668790033536:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.875997:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fa787581-6963-4f39-b38f-836255c71d7c+7:2402:x1874668790033536:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.876003:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3614 00000100:00100000:3.0:1787826428.876023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790032896 00000100:00100000:3.0:1787826428.876026:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790032896 00000100:00100000:3.0:1787826428.876055:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790033408 00000100:00100000:3.0:1787826428.876058:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790033408 00000100:00100000:3.0:1787826428.876073:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790032768 00000100:00100000:3.0:1787826428.876075:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790032768 00000100:00100000:3.0:1787826428.876093:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790033280 00000100:00100000:3.0:1787826428.876096:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790033280 00000100:00100000:3.0:1787826428.876114:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5211 00000100:00100000:3.0:1787826428.876119:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668790032896:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.876147:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+23:2402:x1874668790032896:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.876156:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5211 00000100:00100000:3.0:1787826428.876165:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5212 00000100:00100000:3.0:1787826428.876170:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668790033408:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.876187:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+48:2402:x1874668790033408:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 18us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.876192:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5212 00000100:00100000:3.0:1787826428.876201:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5213 00000100:00100000:3.0:1787826428.876205:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2402:x1874668790032768:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.876223:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb930b33-002c-4632-a90b-528a6bdcd03e+49:2402:x1874668790032768:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 18us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.876229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5213 00000100:00100000:3.0:1787826428.876238:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5214 00000100:00100000:3.0:1787826428.876243:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+64:2402:x1874668790033280:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.876264:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa787581-6963-4f39-b38f-836255c71d7c+64:2402:x1874668790033280:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.876270:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5214 00000100:00080000:3.0:1787826428.876303:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826428.876307:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826428.876311:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826428.876313:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826428.882565:0:38196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668790032640 00000100:00100000:0.0:1787826428.882581:0:38196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668790032640 00000100:00100000:0.0:1787826428.882659:0:38196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 821 00000100:00100000:0.0:1787826428.882672:0:38196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf1337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668790032640:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1787826428.882778:0:38196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf1337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:6bde37df-3766-41d5-a558-be13e58235fe+13:2402:x1874668790032640:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 109us (8188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826428.882786:0:38196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 821 00000100:00100000:0.0:1787826429.760655:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778729856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826429.760763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826429.761169:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778729856 00000100:00100000:1.0:1787826429.761179:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778729856 00000100:00100000:1.0:1787826429.761250:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:1.0:1787826429.761261:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778729856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826429.761299:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570133952 pending 0 free 3828547584 avail 3597025280 00000100:00100000:1.0:1787826429.761359:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778729856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826429.761367:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00000100:00100000:1.0:1787826429.761435:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778729856:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787826429.761582:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826429.763086:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf0cb212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778729984:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.763169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826429.763221:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe100383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778730496:0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.763253:0:38186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778729984 00000100:00100000:0.0:1787826429.763256:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826429.763264:0:38186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778729984 00000100:00100000:0.0:1787826429.763293:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778731008:0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.763322:0:38186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:0.0:1787826429.763327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826429.763336:0:38186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe06383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778729984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.763352:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787826429.763360:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10038f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778730112:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.763396:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826429.763401:0:38186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe06383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c687310c-1e82-4391-b632-324cfd2cb9dd+24:3643:x1874668778729984:12345-0@lo:400:kworker.0 Request processed in 69us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.763410:0:38186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:0.0:1787826429.763435:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778730624:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.763463:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826429.763489:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe100392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778731136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.763527:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826429.763559:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf0cb212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c687310c-1e82-4391-b632-324cfd2cb9dd:3643:1874668778729984:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.763592:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778731008 00000100:00100000:0.0:1787826429.763596:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778731008 00000100:00100000:0.0:1787826429.763625:0:45678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778730112 00000100:00100000:0.0:1787826429.763628:0:45678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778730112 00000100:00100000:0.0:1787826429.763645:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534 00000100:00100000:0.0:1787826429.763652:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778731008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.763693:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778731008:12345-0@lo:400:kworker.0 Request processed in 40us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826429.763699:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534 00000100:00100000:0.0:1787826429.763711:0:45678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3535 00000100:00100000:0.0:1787826429.763717:0:45678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778730112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.763742:0:45678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1874668778730112:12345-0@lo:400:kworker.0 Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826429.763748:0:45678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3535 00000100:00100000:1.0:1787826429.763908:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778730240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826429.764031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826429.771360:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe10038b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778730752:0@lo:400:kworker.0 00000100:00100000:1.0:1787826429.775253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826429.777076:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778730496 00000100:00100000:2.0:1787826429.777096:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778730496 00000100:00100000:2.0:1787826429.777209:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778730624 00000100:00100000:2.0:1787826429.777213:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778730624 00000100:00100000:2.0:1787826429.777238:0:7736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778730240 00000100:00100000:2.0:1787826429.777241:0:7736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778730240 00000100:00100000:2.0:1787826429.777270:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5215 00000100:00100000:2.0:1787826429.777281:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778730496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.777392:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874668778730496:12345-0@lo:400:kworker.0 Request processed in 112us (14135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.777400:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5215 00000100:00100000:2.0:1787826429.777419:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5216 00000100:00100000:2.0:1787826429.777425:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778730624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.777459:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874668778730624:12345-0@lo:400:kworker.0 Request processed in 34us (13994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.777465:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5216 00000100:00100000:2.0:1787826429.777683:0:7736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5217 00000100:00100000:2.0:1787826429.777694:0:7736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778730240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.777730:0:7736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874668778730240:12345-0@lo:400:kworker.0 Request processed in 38us (13698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.777735:0:7736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5217 00000100:00080000:2.0:1787826429.777791:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826429.777797:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826429.777884:0:25038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778731136 00000100:00100000:2.0:1787826429.777889:0:25038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778731136 00000100:00100000:2.0:1787826429.777934:0:25038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3615 00000100:00100000:2.0:1787826429.777941:0:25038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe159f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778731136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.777977:0:25038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe159f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778731136:12345-0@lo:400:kworker.0 Request processed in 37us (14459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.777984:0:25038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3615 00000100:00080000:2.0:1787826429.778002:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826429.778045:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10038f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778730112:0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.778061:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874668778730624:0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.778074:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe100392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778731136:0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.778087:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10039a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778731008:0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.778098:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe100383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874668778730496:0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.778176:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874668778730368:0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.780401:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778730752 00000100:00100000:2.0:1787826429.780417:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778730752 00000100:00100000:0.0:1787826429.780502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826429.780543:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778731264:0@lo:400:kworker.0 00000100:00100000:1.0:1787826429.780619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826429.780650:0:19335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778731264 00000100:00100000:1.0:1787826429.780655:0:19335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778731264 00000100:00100000:1.0:1787826429.780693:0:19335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616 00000100:00100000:1.0:1787826429.780703:0:19335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778731264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826429.780758:0:19335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778731264:12345-0@lo:400:kworker.0 Request processed in 56us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826429.780766:0:19335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616 00000100:00100000:1.0:1787826429.780815:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778731264:0@lo:400:kworker.0 00000100:00100000:1.0:1787826429.780880:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874668778730240:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.781456:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe1003b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778730880:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.781505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826429.781539:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778731392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.781568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826429.783362:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778730368 00000100:00100000:2.0:1787826429.783380:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778730368 00000100:00100000:2.0:1787826429.783458:0:23845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778731392 00000100:00100000:2.0:1787826429.783463:0:23845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778731392 00000100:00100000:0.0:1787826429.783504:0:8605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778730880 00000100:00100000:0.0:1787826429.783509:0:8605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778730880 00000100:00100000:0.0:1787826429.783562:0:8605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3617 00000100:00100000:0.0:1787826429.783573:0:8605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf417c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778730880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.783658:0:8605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf417c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874668778730880:12345-0@lo:400:kworker.0 Request processed in 87us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826429.783666:0:8605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3617 00000100:00100000:2.0:1787826429.784010:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5218 00000100:00100000:2.0:1787826429.784021:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778730752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.784071:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874668778730752:12345-0@lo:400:kworker.0 Request processed in 53us (8832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.784078:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5218 00000100:00100000:2.0:1787826429.784093:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5219 00000100:00100000:2.0:1787826429.784102:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874668778730368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.784134:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf0cb212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874668778730368:12345-0@lo:400:kworker.0 Request processed in 36us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.784140:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5219 00000100:00100000:2.0:1787826429.784150:0:23845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5220 00000100:00100000:2.0:1787826429.784157:0:23845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778731392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826429.784182:0:23845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874668778731392:12345-0@lo:400:kworker.0 Request processed in 26us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.784186:0:23845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5220 00000100:00100000:0.0:1787826429.784359:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874668778730368:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.784374:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe1003b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874668778730880:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.784384:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874668778731392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826429.784635:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe10038b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874668778730752:0@lo:400:kworker.0 00000100:00080000:0.0:1787826429.784679:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826429.784688:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826429.784691:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787826429.824622:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787826430.081627:0:58480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787826430.081636:0:58480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787826430.082218:0:58480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787826430.082228:0:58480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787826430.286198:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778731520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826430.286273:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826430.286414:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778731520 00000100:00100000:2.0:1787826430.286421:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778731520 00000100:00100000:2.0:1787826430.286476:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:2.0:1787826430.286485:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778731520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826430.286524:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 670985664 pending 0 free 3894722560 avail 3663200256 00000100:00100000:2.0:1787826430.286583:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874668778731520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826430.286591:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00100000:3.0:1787826430.286723:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf3fc7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874668778731520:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826430.848056:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787826431.490157:0:58431:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1787826431.490168:0:58431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787826431.490381:0:58431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 9741 count 38 00000040:00080000:2.0:1787826431.490493:0:58431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1787826431.809053:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778731648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826431.809121:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826431.809192:0:46361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778731648 00000100:00100000:1.0:1787826431.809198:0:46361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778731648 00000100:00100000:1.0:1787826431.809241:0:46361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3536 00000100:00100000:1.0:1787826431.809249:0:46361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778731648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826431.809278:0:46361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1440505856 avail 1294266368 00000100:00100000:1.0:1787826431.809321:0:46361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf05cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1874668778731648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826431.809327:0:46361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3536 00000100:00100000:1.0:1787826431.809371:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874668778731648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826431.811753:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778731776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826431.811821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826431.811995:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778731776 00000100:00100000:1.0:1787826431.812002:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778731776 00000100:00100000:1.0:1787826431.812041:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3537 00000100:00100000:1.0:1787826431.812049:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778731776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826431.812077:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1787826431.812120:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874668778731776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826431.812126:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3537 00000100:00100000:1.0:1787826431.812164:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874668778731776:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826431.873119:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826432.322056:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbf05cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778731904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826432.322131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826432.322319:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778731904 00000100:00100000:1.0:1787826432.322326:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778731904 00000100:00100000:1.0:1787826432.322394:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226 00000100:00100000:1.0:1787826432.322404:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778731904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826432.322432:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 570133952 pending 0 free 3828547584 avail 3597025280 00000100:00100000:1.0:1787826432.322490:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbe102dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874668778731904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826432.322497:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226 00000100:00080000:0.0:1787826432.322652:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826432.322689:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbf05cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874668778731904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826432.324694:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bbe083fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778732032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826432.324759:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826432.326067:0:11431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668778732032 00000100:00100000:1.0:1787826432.326079:0:11431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668778732032 00000100:00100000:1.0:1787826432.326153:0:11431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:1.0:1787826432.326164:0:11431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778732032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826432.326193:0:11431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 670985664 pending 0 free 3894722560 avail 3663200256 00000100:00080000:3.0:1787826432.326281:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826432.327960:0:11431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bbf3fc7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874668778732032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1791us (3193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826432.327972:0:11431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00100000:2.0:1787826432.331662:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bbe083fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874668778732032:0@lo:13:osp-pre-1-0.0 Debug log: 65786 lines, 65786 kept, 0 dropped, 0 bad.